[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:11:48.845798  2017 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.248.126:46437
I20260709 12:11:48.847406  2017 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:11:48.848515  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:48.866678  2024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:48.866683  2023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:48.866729  2026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:50.176414  2025 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1307 milliseconds
I20260709 12:11:50.176578  2017 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:11:50.177932  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:50.178212  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:50.178450  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599110178412 us; error 0 us; skew 500 ppm
I20260709 12:11:50.179351  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:50.186338  2017 webserver.cc:533] Webserver started at http://127.1.248.126:34091/ using document root <none> and password file <none>
I20260709 12:11:50.187230  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:50.187491  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:50.187932  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:50.194936  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/master-0-root/instance:
uuid: "fdc82fec187b4e12bdd1b12d2f5811f7"
format_stamp: "Formatted at 2026-07-09 12:11:50 on dist-test-slave-z9f9"
I20260709 12:11:50.207013  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:11:50.212956  2032 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:50.214401  2017 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:11:50.214855  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/master-0-root
uuid: "fdc82fec187b4e12bdd1b12d2f5811f7"
format_stamp: "Formatted at 2026-07-09 12:11:50 on dist-test-slave-z9f9"
I20260709 12:11:50.215305  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:50.286509  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:50.288328  2017 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:11:50.288839  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:50.369066  2083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.126:46437 every 8 connection(s)
I20260709 12:11:50.369138  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.126:46437
I20260709 12:11:50.377653  2084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:50.401017  2084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7: Bootstrap starting.
I20260709 12:11:50.407233  2084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:50.409318  2084 log.cc:826] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7: Log is configured to *not* fsync() on all Append() calls
I20260709 12:11:50.414850  2084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7: No bootstrap required, opened a new log
I20260709 12:11:50.437500  2084 raft_consensus.cc:359] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdc82fec187b4e12bdd1b12d2f5811f7" member_type: VOTER }
I20260709 12:11:50.438143  2084 raft_consensus.cc:385] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:50.438548  2084 raft_consensus.cc:740] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc82fec187b4e12bdd1b12d2f5811f7, State: Initialized, Role: FOLLOWER
I20260709 12:11:50.439760  2084 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdc82fec187b4e12bdd1b12d2f5811f7" member_type: VOTER }
I20260709 12:11:50.440310  2084 raft_consensus.cc:399] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:11:50.440635  2084 raft_consensus.cc:493] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:11:50.441015  2084 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:50.445344  2084 raft_consensus.cc:515] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdc82fec187b4e12bdd1b12d2f5811f7" member_type: VOTER }
I20260709 12:11:50.446200  2084 leader_election.cc:304] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdc82fec187b4e12bdd1b12d2f5811f7; no voters: 
I20260709 12:11:50.448107  2084 leader_election.cc:290] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:11:50.448455  2087 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:50.451545  2087 raft_consensus.cc:697] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [term 1 LEADER]: Becoming Leader. State: Replica: fdc82fec187b4e12bdd1b12d2f5811f7, State: Running, Role: LEADER
I20260709 12:11:50.452600  2087 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdc82fec187b4e12bdd1b12d2f5811f7" member_type: VOTER }
I20260709 12:11:50.453658  2084 sys_catalog.cc:565] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:11:50.465947  2088 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdc82fec187b4e12bdd1b12d2f5811f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdc82fec187b4e12bdd1b12d2f5811f7" member_type: VOTER } }
I20260709 12:11:50.466850  2088 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:11:50.467541  2089 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdc82fec187b4e12bdd1b12d2f5811f7. Latest consensus state: current_term: 1 leader_uuid: "fdc82fec187b4e12bdd1b12d2f5811f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdc82fec187b4e12bdd1b12d2f5811f7" member_type: VOTER } }
I20260709 12:11:50.468393  2089 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:11:50.470876  2097 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:11:50.485163  2097 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:11:50.487644  2017 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:11:50.504179  2097 catalog_manager.cc:1383] Generated new cluster ID: 0aa03d659f51473e96087de07ea024a1
I20260709 12:11:50.504523  2097 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:11:50.534555  2097 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:11:50.536410  2097 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:11:50.555984  2097 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7: Generated new TSK 0
I20260709 12:11:50.557158  2097 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:11:50.619290  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:50.628047  2106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:50.629627  2107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:50.634158  2109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:50.634377  2017 server_base.cc:1061] running on GCE node
I20260709 12:11:50.635268  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:50.635543  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:50.635707  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599110635693 us; error 0 us; skew 500 ppm
I20260709 12:11:50.636363  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:50.641057  2017 webserver.cc:533] Webserver started at http://127.1.248.65:36297/ using document root <none> and password file <none>
I20260709 12:11:50.641649  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:50.641845  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:50.642205  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:50.643561  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-0-root/instance:
uuid: "03f117f42d154ad1a4764eb50c377a35"
format_stamp: "Formatted at 2026-07-09 12:11:50 on dist-test-slave-z9f9"
I20260709 12:11:50.649786  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:11:50.654791  2114 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:50.655860  2017 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:11:50.656196  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-0-root
uuid: "03f117f42d154ad1a4764eb50c377a35"
format_stamp: "Formatted at 2026-07-09 12:11:50 on dist-test-slave-z9f9"
I20260709 12:11:50.656525  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:50.670480  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:50.672024  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:50.674952  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:50.679791  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:50.680078  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:50.680356  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:50.680557  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:50.793108  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.65:34987
I20260709 12:11:50.793172  2176 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.65:34987 every 8 connection(s)
I20260709 12:11:50.803399  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:50.819388  2181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:50.821367  2182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:50.827970  2017 server_base.cc:1061] running on GCE node
W20260709 12:11:50.829054  2184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:50.830293  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:50.830561  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:50.830770  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599110830753 us; error 0 us; skew 500 ppm
I20260709 12:11:50.831367  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:50.833412  2177 heartbeater.cc:344] Connected to a master server at 127.1.248.126:46437
I20260709 12:11:50.833912  2177 heartbeater.cc:461] Registering TS with master...
I20260709 12:11:50.834618  2017 webserver.cc:533] Webserver started at http://127.1.248.66:42907/ using document root <none> and password file <none>
I20260709 12:11:50.835103  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:50.835059  2177 heartbeater.cc:507] Master 127.1.248.126:46437 requested a full tablet report, sending...
I20260709 12:11:50.835343  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:50.835695  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:50.837054  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-1-root/instance:
uuid: "0015a277ef40476e95fa121ca04b60a4"
format_stamp: "Formatted at 2026-07-09 12:11:50 on dist-test-slave-z9f9"
I20260709 12:11:50.838797  2049 ts_manager.cc:194] Registered new tserver with Master: 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987)
I20260709 12:11:50.841980  2049 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60632
I20260709 12:11:50.844492  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:11:50.849411  2189 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:50.850406  2017 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:11:50.850739  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-1-root
uuid: "0015a277ef40476e95fa121ca04b60a4"
format_stamp: "Formatted at 2026-07-09 12:11:50 on dist-test-slave-z9f9"
I20260709 12:11:50.851056  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:50.873714  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:50.875006  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:50.877206  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:50.880131  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:50.880371  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:50.880615  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:50.880791  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:50.979638  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.66:43455
I20260709 12:11:50.979754  2251 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.66:43455 every 8 connection(s)
I20260709 12:11:50.986351  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:50.996498  2255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:50.998435  2256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:51.007056  2252 heartbeater.cc:344] Connected to a master server at 127.1.248.126:46437
I20260709 12:11:51.007591  2252 heartbeater.cc:461] Registering TS with master...
W20260709 12:11:51.008728  2258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:51.008843  2252 heartbeater.cc:507] Master 127.1.248.126:46437 requested a full tablet report, sending...
I20260709 12:11:51.009130  2017 server_base.cc:1061] running on GCE node
I20260709 12:11:51.010701  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:51.010978  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:51.011241  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599111011218 us; error 0 us; skew 500 ppm
I20260709 12:11:51.011861  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:51.011806  2049 ts_manager.cc:194] Registered new tserver with Master: 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:51.013892  2049 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60636
I20260709 12:11:51.014971  2017 webserver.cc:533] Webserver started at http://127.1.248.67:46865/ using document root <none> and password file <none>
I20260709 12:11:51.015657  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:51.015902  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:51.016198  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:51.017295  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-2-root/instance:
uuid: "bd0f951bbfa84993912f6b0b555d35bd"
format_stamp: "Formatted at 2026-07-09 12:11:51 on dist-test-slave-z9f9"
I20260709 12:11:51.022209  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:11:51.025938  2263 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:51.026858  2017 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:11:51.027205  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-2-root
uuid: "bd0f951bbfa84993912f6b0b555d35bd"
format_stamp: "Formatted at 2026-07-09 12:11:51 on dist-test-slave-z9f9"
I20260709 12:11:51.027607  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599108657414-2017-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:51.046016  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:51.047701  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:51.050299  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:51.054389  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:51.054672  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:51.055007  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:51.055256  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:51.142311  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.67:34013
I20260709 12:11:51.142407  2325 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.67:34013 every 8 connection(s)
I20260709 12:11:51.167261  2326 heartbeater.cc:344] Connected to a master server at 127.1.248.126:46437
I20260709 12:11:51.167727  2326 heartbeater.cc:461] Registering TS with master...
I20260709 12:11:51.168733  2326 heartbeater.cc:507] Master 127.1.248.126:46437 requested a full tablet report, sending...
I20260709 12:11:51.171308  2049 ts_manager.cc:194] Registered new tserver with Master: bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:11:51.171938  2017 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.023796399s
I20260709 12:11:51.173117  2049 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60648
I20260709 12:11:51.238086  2049 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60652:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:11:51.243278  2049 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:11:51.337522  2217 tablet_service.cc:1511] Processing CreateTablet for tablet e3bf9e35e5334190b45626fbeb734353 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:51.339221  2217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3bf9e35e5334190b45626fbeb734353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.339600  2291 tablet_service.cc:1511] Processing CreateTablet for tablet e3bf9e35e5334190b45626fbeb734353 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:51.340965  2291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3bf9e35e5334190b45626fbeb734353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.349562  2216 tablet_service.cc:1511] Processing CreateTablet for tablet 53e3a35f59e8482daa31ef06b865ad54 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:51.351015  2216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e3a35f59e8482daa31ef06b865ad54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.359014  2290 tablet_service.cc:1511] Processing CreateTablet for tablet 53e3a35f59e8482daa31ef06b865ad54 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:51.360526  2290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e3a35f59e8482daa31ef06b865ad54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.377602  2344 tablet_bootstrap.cc:492] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd: Bootstrap starting.
I20260709 12:11:51.386649  2141 tablet_service.cc:1511] Processing CreateTablet for tablet 53e3a35f59e8482daa31ef06b865ad54 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:51.385430  2142 tablet_service.cc:1511] Processing CreateTablet for tablet e3bf9e35e5334190b45626fbeb734353 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:51.390801  2140 tablet_service.cc:1511] Processing CreateTablet for tablet 73ba54154cab456eb913ddb40a164f54 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:51.391110  2141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e3a35f59e8482daa31ef06b865ad54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.394825  2217 tablet_service.cc:1511] Processing CreateTablet for tablet 73ba54154cab456eb913ddb40a164f54 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:51.397536  2217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ba54154cab456eb913ddb40a164f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.398926  2290 tablet_service.cc:1511] Processing CreateTablet for tablet 73ba54154cab456eb913ddb40a164f54 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:51.400698  2290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ba54154cab456eb913ddb40a164f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.395183  2142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3bf9e35e5334190b45626fbeb734353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.404500  2140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ba54154cab456eb913ddb40a164f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.415100  2139 tablet_service.cc:1511] Processing CreateTablet for tablet 4f1b96975bc044d481d87d7b5878c724 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:51.417392  2139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1b96975bc044d481d87d7b5878c724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.422513  2344 tablet_bootstrap.cc:654] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.429260  2215 tablet_service.cc:1511] Processing CreateTablet for tablet 4f1b96975bc044d481d87d7b5878c724 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:51.431798  2215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1b96975bc044d481d87d7b5878c724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.431953  2291 tablet_service.cc:1511] Processing CreateTablet for tablet 4f1b96975bc044d481d87d7b5878c724 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:51.434669  2291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1b96975bc044d481d87d7b5878c724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.448638  2138 tablet_service.cc:1511] Processing CreateTablet for tablet 25ec792334174b458d4eee1729e73d54 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:51.451171  2138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ec792334174b458d4eee1729e73d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.454356  2345 tablet_bootstrap.cc:492] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4: Bootstrap starting.
I20260709 12:11:51.461931  2216 tablet_service.cc:1511] Processing CreateTablet for tablet 25ec792334174b458d4eee1729e73d54 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:51.463495  2216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ec792334174b458d4eee1729e73d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.472095  2289 tablet_service.cc:1511] Processing CreateTablet for tablet 25ec792334174b458d4eee1729e73d54 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
W20260709 12:11:51.477207  2096 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:11:51.485903  2137 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdb6c5047f14ebe8d6758ce69a6a110 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:51.486430  2289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ec792334174b458d4eee1729e73d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.497416  2137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdb6c5047f14ebe8d6758ce69a6a110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.495460  2214 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdb6c5047f14ebe8d6758ce69a6a110 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:51.500702  2214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdb6c5047f14ebe8d6758ce69a6a110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.510524  2288 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdb6c5047f14ebe8d6758ce69a6a110 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:51.512565  2288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdb6c5047f14ebe8d6758ce69a6a110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.518679  2136 tablet_service.cc:1511] Processing CreateTablet for tablet 594880bc88c14b6b9783dbffaea89395 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:51.522181  2136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594880bc88c14b6b9783dbffaea89395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.543690  2217 tablet_service.cc:1511] Processing CreateTablet for tablet 594880bc88c14b6b9783dbffaea89395 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:51.545830  2217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594880bc88c14b6b9783dbffaea89395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.569166  2345 tablet_bootstrap.cc:654] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.571277  2290 tablet_service.cc:1511] Processing CreateTablet for tablet 594880bc88c14b6b9783dbffaea89395 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:51.576114  2344 tablet_bootstrap.cc:492] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd: No bootstrap required, opened a new log
I20260709 12:11:51.576277  2290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594880bc88c14b6b9783dbffaea89395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.576653  2344 ts_tablet_manager.cc:1403] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd: Time spent bootstrapping tablet: real 0.200s	user 0.018s	sys 0.019s
I20260709 12:11:51.573096  2347 tablet_bootstrap.cc:492] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35: Bootstrap starting.
I20260709 12:11:51.592993  2139 tablet_service.cc:1511] Processing CreateTablet for tablet 108b362c9f7046e6b80dbb5e26ee0ca7 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:51.598549  2344 raft_consensus.cc:359] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:11:51.599445  2344 raft_consensus.cc:385] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.599766  2344 raft_consensus.cc:740] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.601794  2347 tablet_bootstrap.cc:654] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.600140  2139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108b362c9f7046e6b80dbb5e26ee0ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.604686  2215 tablet_service.cc:1511] Processing CreateTablet for tablet 108b362c9f7046e6b80dbb5e26ee0ca7 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:51.607841  2291 tablet_service.cc:1511] Processing CreateTablet for tablet 108b362c9f7046e6b80dbb5e26ee0ca7 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:51.609833  2291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108b362c9f7046e6b80dbb5e26ee0ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.617002  2215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108b362c9f7046e6b80dbb5e26ee0ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.642622  2345 tablet_bootstrap.cc:492] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4: No bootstrap required, opened a new log
I20260709 12:11:51.642920  2142 tablet_service.cc:1511] Processing CreateTablet for tablet ce7f2777e02e4a4da9ab5e1867f12147 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:51.643355  2345 ts_tablet_manager.cc:1403] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4: Time spent bootstrapping tablet: real 0.192s	user 0.015s	sys 0.017s
I20260709 12:11:51.610458  2344 consensus_queue.cc:260] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:11:51.645505  2142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7f2777e02e4a4da9ab5e1867f12147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.665726  2288 tablet_service.cc:1511] Processing CreateTablet for tablet ce7f2777e02e4a4da9ab5e1867f12147 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:51.668553  2216 tablet_service.cc:1511] Processing CreateTablet for tablet ce7f2777e02e4a4da9ab5e1867f12147 (DEFAULT_TABLE table=test-workload [id=5cf1708cb86c4e0e8b89c8a873c1a1a6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:51.669090  2288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7f2777e02e4a4da9ab5e1867f12147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.669796  2216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7f2777e02e4a4da9ab5e1867f12147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:51.680761  2326 heartbeater.cc:499] Master 127.1.248.126:46437 was elected leader, sending a full tablet report...
I20260709 12:11:51.681933  2347 tablet_bootstrap.cc:492] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35: No bootstrap required, opened a new log
I20260709 12:11:51.683389  2347 ts_tablet_manager.cc:1403] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35: Time spent bootstrapping tablet: real 0.111s	user 0.008s	sys 0.027s
I20260709 12:11:51.690156  2345 raft_consensus.cc:359] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.692513  2344 ts_tablet_manager.cc:1434] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd: Time spent starting tablet: real 0.116s	user 0.011s	sys 0.024s
I20260709 12:11:51.693763  2344 tablet_bootstrap.cc:492] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd: Bootstrap starting.
I20260709 12:11:51.692682  2345 raft_consensus.cc:385] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.694978  2347 raft_consensus.cc:359] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.697326  2345 raft_consensus.cc:740] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.697499  2347 raft_consensus.cc:385] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.698028  2347 raft_consensus.cc:740] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.699076  2347 consensus_queue.cc:260] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.698398  2345 consensus_queue.cc:260] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.713394  2344 tablet_bootstrap.cc:654] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.715363  2347 ts_tablet_manager.cc:1434] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:11:51.715788  2177 heartbeater.cc:499] Master 127.1.248.126:46437 was elected leader, sending a full tablet report...
I20260709 12:11:51.720912  2347 tablet_bootstrap.cc:492] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35: Bootstrap starting.
I20260709 12:11:51.731879  2252 heartbeater.cc:499] Master 127.1.248.126:46437 was elected leader, sending a full tablet report...
I20260709 12:11:51.732326  2345 ts_tablet_manager.cc:1434] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4: Time spent starting tablet: real 0.088s	user 0.010s	sys 0.010s
W20260709 12:11:51.736651  2253 tablet.cc:2406] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:11:51.737056  2347 tablet_bootstrap.cc:654] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.741396  2345 tablet_bootstrap.cc:492] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4: Bootstrap starting.
I20260709 12:11:51.749027  2344 tablet_bootstrap.cc:492] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd: No bootstrap required, opened a new log
I20260709 12:11:51.749670  2344 ts_tablet_manager.cc:1403] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.005s
I20260709 12:11:51.750135  2345 tablet_bootstrap.cc:654] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.751369  2347 tablet_bootstrap.cc:492] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35: No bootstrap required, opened a new log
I20260709 12:11:51.751904  2347 ts_tablet_manager.cc:1403] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.006s
I20260709 12:11:51.753789  2344 raft_consensus.cc:359] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.754689  2344 raft_consensus.cc:385] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.755143  2344 raft_consensus.cc:740] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.756342  2344 consensus_queue.cc:260] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.755085  2347 raft_consensus.cc:359] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.757959  2347 raft_consensus.cc:385] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.758345  2347 raft_consensus.cc:740] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.759503  2344 ts_tablet_manager.cc:1434] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:11:51.768709  2344 tablet_bootstrap.cc:492] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd: Bootstrap starting.
I20260709 12:11:51.769457  2347 consensus_queue.cc:260] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.774169  2345 tablet_bootstrap.cc:492] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4: No bootstrap required, opened a new log
I20260709 12:11:51.774941  2345 ts_tablet_manager.cc:1403] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.015s
I20260709 12:11:51.777573  2345 raft_consensus.cc:359] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:11:51.778185  2345 raft_consensus.cc:385] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.778455  2345 raft_consensus.cc:740] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.779096  2345 consensus_queue.cc:260] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:11:51.780414  2347 ts_tablet_manager.cc:1434] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.003s
I20260709 12:11:51.781466  2347 tablet_bootstrap.cc:492] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35: Bootstrap starting.
I20260709 12:11:51.788237  2344 tablet_bootstrap.cc:654] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.789148  2347 tablet_bootstrap.cc:654] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.791630  2345 ts_tablet_manager.cc:1434] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 12:11:51.792965  2345 tablet_bootstrap.cc:492] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4: Bootstrap starting.
I20260709 12:11:51.794307  2350 raft_consensus.cc:493] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.794796  2350 raft_consensus.cc:515] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:11:51.803344  2350 leader_election.cc:290] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455), 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987)
I20260709 12:11:51.809279  2345 tablet_bootstrap.cc:654] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.817912  2347 tablet_bootstrap.cc:492] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35: No bootstrap required, opened a new log
I20260709 12:11:51.818483  2347 ts_tablet_manager.cc:1403] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.007s
I20260709 12:11:51.823356  2347 raft_consensus.cc:359] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:11:51.826062  2347 raft_consensus.cc:385] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.826465  2347 raft_consensus.cc:740] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.827337  2347 consensus_queue.cc:260] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:11:51.828054  2344 tablet_bootstrap.cc:492] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd: No bootstrap required, opened a new log
I20260709 12:11:51.829023  2344 ts_tablet_manager.cc:1403] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.021s
I20260709 12:11:51.830561  2347 ts_tablet_manager.cc:1434] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:11:51.831658  2347 tablet_bootstrap.cc:492] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35: Bootstrap starting.
I20260709 12:11:51.832195  2344 raft_consensus.cc:359] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.833083  2344 raft_consensus.cc:385] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.833441  2344 raft_consensus.cc:740] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.834434  2344 consensus_queue.cc:260] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.838617  2347 tablet_bootstrap.cc:654] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.840305  2344 ts_tablet_manager.cc:1434] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:11:51.841372  2344 tablet_bootstrap.cc:492] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd: Bootstrap starting.
I20260709 12:11:51.846653  2345 tablet_bootstrap.cc:492] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4: No bootstrap required, opened a new log
I20260709 12:11:51.847175  2345 ts_tablet_manager.cc:1403] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.009s
I20260709 12:11:51.849012  2344 tablet_bootstrap.cc:654] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.850124  2345 raft_consensus.cc:359] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.850886  2345 raft_consensus.cc:385] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.851186  2345 raft_consensus.cc:740] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.852931  2152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35" is_pre_election: true
I20260709 12:11:51.853940  2152 raft_consensus.cc:2468] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 0.
I20260709 12:11:51.856261  2266 leader_election.cc:304] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:51.855921  2345 consensus_queue.cc:260] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.856806  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4" is_pre_election: true
I20260709 12:11:51.857468  2227 raft_consensus.cc:2468] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 0.
I20260709 12:11:51.858412  2350 raft_consensus.cc:2804] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:51.858760  2350 raft_consensus.cc:493] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.859109  2350 raft_consensus.cc:3060] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:51.860364  2345 ts_tablet_manager.cc:1434] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 12:11:51.861400  2345 tablet_bootstrap.cc:492] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4: Bootstrap starting.
I20260709 12:11:51.862417  2347 tablet_bootstrap.cc:492] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35: No bootstrap required, opened a new log
I20260709 12:11:51.862919  2347 ts_tablet_manager.cc:1403] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.009s
I20260709 12:11:51.866299  2347 raft_consensus.cc:359] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.867132  2347 raft_consensus.cc:385] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.867820  2350 raft_consensus.cc:515] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:11:51.868503  2345 tablet_bootstrap.cc:654] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.870625  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:51.871002  2347 raft_consensus.cc:740] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.871223  2227 raft_consensus.cc:3060] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:51.871991  2347 consensus_queue.cc:260] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.874282  2347 ts_tablet_manager.cc:1434] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:11:51.874356  2345 tablet_bootstrap.cc:492] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4: No bootstrap required, opened a new log
I20260709 12:11:51.874940  2345 ts_tablet_manager.cc:1403] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:11:51.875417  2347 tablet_bootstrap.cc:492] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35: Bootstrap starting.
I20260709 12:11:51.878176  2345 raft_consensus.cc:359] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.878945  2345 raft_consensus.cc:385] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.879149  2227 raft_consensus.cc:2468] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:51.879276  2345 raft_consensus.cc:740] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.880103  2345 consensus_queue.cc:260] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.880517  2264 leader_election.cc:304] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:51.882551  2345 ts_tablet_manager.cc:1434] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:11:51.883625  2345 tablet_bootstrap.cc:492] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4: Bootstrap starting.
I20260709 12:11:51.889097  2152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:51.889812  2152 raft_consensus.cc:3060] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:51.887899  2350 leader_election.cc:290] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Requested vote from peers 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455), 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987)
I20260709 12:11:51.890451  2350 raft_consensus.cc:2804] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:51.890928  2350 raft_consensus.cc:697] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Leader. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:51.891786  2350 consensus_queue.cc:237] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:11:51.893759  2347 tablet_bootstrap.cc:654] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.899871  2345 tablet_bootstrap.cc:654] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.904114  2344 tablet_bootstrap.cc:492] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd: No bootstrap required, opened a new log
I20260709 12:11:51.904758  2344 ts_tablet_manager.cc:1403] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.007s
I20260709 12:11:51.907627  2344 raft_consensus.cc:359] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.908349  2344 raft_consensus.cc:385] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.908656  2344 raft_consensus.cc:740] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.912312  2347 tablet_bootstrap.cc:492] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35: No bootstrap required, opened a new log
I20260709 12:11:51.912190  2152 raft_consensus.cc:2468] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:51.912848  2347 ts_tablet_manager.cc:1403] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.002s
I20260709 12:11:51.913455  2344 consensus_queue.cc:260] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.916244  2347 raft_consensus.cc:359] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.917116  2347 raft_consensus.cc:385] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.917444  2347 raft_consensus.cc:740] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.918195  2347 consensus_queue.cc:260] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.919598  2350 raft_consensus.cc:493] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.920058  2350 raft_consensus.cc:515] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.921479  2347 ts_tablet_manager.cc:1434] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:11:51.921139  2047 catalog_manager.cc:5697] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd reported cstate change: term changed from 0 to 1, leader changed from <none> to bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67). New cstate: current_term: 1 leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:51.922511  2347 tablet_bootstrap.cc:492] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35: Bootstrap starting.
I20260709 12:11:51.923241  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1b96975bc044d481d87d7b5878c724" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4" is_pre_election: true
I20260709 12:11:51.923864  2227 raft_consensus.cc:2468] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 0.
I20260709 12:11:51.925083  2264 leader_election.cc:304] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:51.926069  2364 raft_consensus.cc:2804] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:51.926461  2364 raft_consensus.cc:493] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.926797  2364 raft_consensus.cc:3060] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:51.929674  2347 tablet_bootstrap.cc:654] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.931690  2152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1b96975bc044d481d87d7b5878c724" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35" is_pre_election: true
I20260709 12:11:51.934006  2364 raft_consensus.cc:515] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.934329  2152 raft_consensus.cc:2468] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 0.
I20260709 12:11:51.936225  2350 leader_election.cc:290] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:51.936386  2351 raft_consensus.cc:493] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.937229  2344 ts_tablet_manager.cc:1434] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.003s
I20260709 12:11:51.937050  2151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1b96975bc044d481d87d7b5878c724" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:51.936933  2351 raft_consensus.cc:515] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.937734  2151 raft_consensus.cc:3060] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:51.938235  2344 tablet_bootstrap.cc:492] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd: Bootstrap starting.
I20260709 12:11:51.941195  2351 leader_election.cc:290] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:11:51.941768  2364 leader_election.cc:290] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:51.942731  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1b96975bc044d481d87d7b5878c724" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:51.943321  2227 raft_consensus.cc:3060] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:51.951992  2227 raft_consensus.cc:2468] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:51.956069  2264 leader_election.cc:304] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:51.957155  2364 raft_consensus.cc:2804] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:51.957990  2364 raft_consensus.cc:697] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Leader. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:51.959105  2364 consensus_queue.cc:237] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.966886  2344 tablet_bootstrap.cc:654] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.971691  2151 raft_consensus.cc:2468] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:51.978085  2345 tablet_bootstrap.cc:492] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4: No bootstrap required, opened a new log
I20260709 12:11:51.978670  2345 ts_tablet_manager.cc:1403] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.002s
I20260709 12:11:51.981839  2344 tablet_bootstrap.cc:492] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd: No bootstrap required, opened a new log
I20260709 12:11:51.981912  2345 raft_consensus.cc:359] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.982872  2345 raft_consensus.cc:385] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.983291  2345 raft_consensus.cc:740] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.984200  2345 consensus_queue.cc:260] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.982553  2344 ts_tablet_manager.cc:1403] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.005s
I20260709 12:11:51.986950  2345 ts_tablet_manager.cc:1434] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.009s
I20260709 12:11:51.988036  2345 tablet_bootstrap.cc:492] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4: Bootstrap starting.
I20260709 12:11:51.990960  2344 raft_consensus.cc:359] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.991782  2344 raft_consensus.cc:385] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:51.992110  2344 raft_consensus.cc:740] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Initialized, Role: FOLLOWER
I20260709 12:11:51.992971  2344 consensus_queue.cc:260] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:51.994954  2345 tablet_bootstrap.cc:654] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:51.995419  2344 ts_tablet_manager.cc:1434] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:11:51.996416  2344 tablet_bootstrap.cc:492] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd: Bootstrap starting.
I20260709 12:11:52.002919  2344 tablet_bootstrap.cc:654] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:52.012740  2345 tablet_bootstrap.cc:492] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4: No bootstrap required, opened a new log
I20260709 12:11:52.013296  2345 ts_tablet_manager.cc:1403] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.004s
I20260709 12:11:52.016381  2344 tablet_bootstrap.cc:492] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd: No bootstrap required, opened a new log
I20260709 12:11:52.016966  2344 ts_tablet_manager.cc:1403] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 12:11:52.016429  2345 raft_consensus.cc:359] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.021355  2344 raft_consensus.cc:359] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.022554  2344 raft_consensus.cc:385] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:52.022891  2344 raft_consensus.cc:740] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Initialized, Role: FOLLOWER
I20260709 12:11:52.023768  2344 consensus_queue.cc:260] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.026618  2344 ts_tablet_manager.cc:1434] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:11:52.027661  2344 tablet_bootstrap.cc:492] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd: Bootstrap starting.
I20260709 12:11:52.031292  2345 raft_consensus.cc:385] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:52.031875  2345 raft_consensus.cc:740] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Initialized, Role: FOLLOWER
I20260709 12:11:52.032833  2345 consensus_queue.cc:260] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.040104  2345 ts_tablet_manager.cc:1434] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 12:11:52.042626  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4" is_pre_election: true
I20260709 12:11:52.043717  2227 raft_consensus.cc:2468] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 0.
I20260709 12:11:52.047852  2347 tablet_bootstrap.cc:492] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35: No bootstrap required, opened a new log
I20260709 12:11:52.047773  2115 leader_election.cc:304] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, 03f117f42d154ad1a4764eb50c377a35; no voters: 
I20260709 12:11:52.048573  2347 ts_tablet_manager.cc:1403] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35: Time spent bootstrapping tablet: real 0.126s	user 0.021s	sys 0.047s
I20260709 12:11:52.049188  2351 raft_consensus.cc:2804] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:52.050246  2345 tablet_bootstrap.cc:492] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4: Bootstrap starting.
I20260709 12:11:52.050220  2351 raft_consensus.cc:493] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.050995  2351 raft_consensus.cc:3060] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.054484  2347 raft_consensus.cc:359] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.058948  2347 raft_consensus.cc:385] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:52.059336  2347 raft_consensus.cc:740] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Initialized, Role: FOLLOWER
I20260709 12:11:52.059053  2048 catalog_manager.cc:5697] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd reported cstate change: term changed from 0 to 1, leader changed from <none> to bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67). New cstate: current_term: 1 leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.061503  2351 raft_consensus.cc:515] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.065917  2351 leader_election.cc:290] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 1 election: Requested vote from peers 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:11:52.066847  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:52.067631  2227 raft_consensus.cc:3060] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.063869  2347 consensus_queue.cc:260] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.073393  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd" is_pre_election: true
I20260709 12:11:52.074208  2347 ts_tablet_manager.cc:1434] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:11:52.074290  2301 raft_consensus.cc:2468] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 0.
I20260709 12:11:52.071496  2344 tablet_bootstrap.cc:654] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:52.075968  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:11:52.075650  2347 tablet_bootstrap.cc:492] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35: Bootstrap starting.
I20260709 12:11:52.076759  2300 raft_consensus.cc:3060] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.085048  2300 raft_consensus.cc:2468] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 1.
I20260709 12:11:52.080868  2227 raft_consensus.cc:2468] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 1.
I20260709 12:11:52.086648  2345 tablet_bootstrap.cc:654] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:52.087519  2115 leader_election.cc:304] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, 03f117f42d154ad1a4764eb50c377a35; no voters: 
I20260709 12:11:52.089341  2351 raft_consensus.cc:2804] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:52.090080  2347 tablet_bootstrap.cc:654] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:52.099561  2351 raft_consensus.cc:697] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 1 LEADER]: Becoming Leader. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Running, Role: LEADER
I20260709 12:11:52.100332  2364 raft_consensus.cc:493] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.101256  2364 raft_consensus.cc:515] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.103420  2364 leader_election.cc:290] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:52.104976  2151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594880bc88c14b6b9783dbffaea89395" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35" is_pre_election: true
I20260709 12:11:52.104959  2351 consensus_queue.cc:237] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.105726  2151 raft_consensus.cc:2468] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 0.
I20260709 12:11:52.108059  2266 leader_election.cc:304] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:52.112463  2364 raft_consensus.cc:2804] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:52.114351  2364 raft_consensus.cc:493] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.114377  2350 raft_consensus.cc:493] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.114852  2364 raft_consensus.cc:3060] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.114964  2350 raft_consensus.cc:515] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.117112  2350 leader_election.cc:290] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:52.117877  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594880bc88c14b6b9783dbffaea89395" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4" is_pre_election: true
I20260709 12:11:52.118521  2227 raft_consensus.cc:2468] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 0.
I20260709 12:11:52.120281  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdb6c5047f14ebe8d6758ce69a6a110" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4" is_pre_election: true
I20260709 12:11:52.122102  2226 raft_consensus.cc:2468] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 0.
I20260709 12:11:52.122536  2151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdb6c5047f14ebe8d6758ce69a6a110" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35" is_pre_election: true
I20260709 12:11:52.123447  2151 raft_consensus.cc:2468] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 0.
I20260709 12:11:52.127391  2264 leader_election.cc:304] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:52.126924  2350 raft_consensus.cc:493] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.130582  2350 raft_consensus.cc:515] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.138873  2347 tablet_bootstrap.cc:492] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35: No bootstrap required, opened a new log
I20260709 12:11:52.139464  2347 ts_tablet_manager.cc:1403] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.008s
I20260709 12:11:52.139592  2350 leader_election.cc:290] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:52.140740  2350 raft_consensus.cc:2804] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:52.141822  2151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ba54154cab456eb913ddb40a164f54" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35" is_pre_election: true
I20260709 12:11:52.142726  2350 raft_consensus.cc:493] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.144537  2350 raft_consensus.cc:3060] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:11:52.149935  2266 leader_election.cc:343] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:52.159504  2345 tablet_bootstrap.cc:492] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4: No bootstrap required, opened a new log
I20260709 12:11:52.159627  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ba54154cab456eb913ddb40a164f54" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4" is_pre_election: true
I20260709 12:11:52.160164  2344 tablet_bootstrap.cc:492] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd: No bootstrap required, opened a new log
I20260709 12:11:52.160127  2345 ts_tablet_manager.cc:1403] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4: Time spent bootstrapping tablet: real 0.111s	user 0.037s	sys 0.022s
I20260709 12:11:52.160369  2226 raft_consensus.cc:2468] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 0.
I20260709 12:11:52.160805  2344 ts_tablet_manager.cc:1403] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd: Time spent bootstrapping tablet: real 0.133s	user 0.012s	sys 0.020s
I20260709 12:11:52.162010  2264 leader_election.cc:304] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, bd0f951bbfa84993912f6b0b555d35bd; no voters: 03f117f42d154ad1a4764eb50c377a35
I20260709 12:11:52.163151  2383 raft_consensus.cc:2804] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:52.163658  2383 raft_consensus.cc:493] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.163997  2383 raft_consensus.cc:3060] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.163861  2345 raft_consensus.cc:359] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.164045  2344 raft_consensus.cc:359] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.164784  2345 raft_consensus.cc:385] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:52.164950  2344 raft_consensus.cc:385] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:52.165205  2345 raft_consensus.cc:740] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Initialized, Role: FOLLOWER
I20260709 12:11:52.165352  2344 raft_consensus.cc:740] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Initialized, Role: FOLLOWER
I20260709 12:11:52.165107  2347 raft_consensus.cc:359] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.166020  2347 raft_consensus.cc:385] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:52.166589  2347 raft_consensus.cc:740] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Initialized, Role: FOLLOWER
I20260709 12:11:52.166231  2345 consensus_queue.cc:260] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.166419  2344 consensus_queue.cc:260] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.169605  2364 raft_consensus.cc:515] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.167577  2347 consensus_queue.cc:260] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.169083  2345 ts_tablet_manager.cc:1434] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:11:52.174916  2345 tablet_bootstrap.cc:492] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4: Bootstrap starting.
I20260709 12:11:52.174858  2151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594880bc88c14b6b9783dbffaea89395" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:52.175594  2151 raft_consensus.cc:3060] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.162981  2350 raft_consensus.cc:515] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.182317  2048 catalog_manager.cc:5697] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "03f117f42d154ad1a4764eb50c377a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.184128  2347 ts_tablet_manager.cc:1434] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.001s
I20260709 12:11:52.185508  2151 raft_consensus.cc:2468] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:52.187139  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594880bc88c14b6b9783dbffaea89395" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:52.191843  2226 raft_consensus.cc:3060] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.187796  2364 leader_election.cc:290] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:52.194237  2383 raft_consensus.cc:515] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.210685  2347 tablet_bootstrap.cc:492] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35: Bootstrap starting.
I20260709 12:11:52.211767  2364 raft_consensus.cc:493] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.212322  2364 raft_consensus.cc:515] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.217422  2266 leader_election.cc:304] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:52.219641  2383 leader_election.cc:290] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:52.220464  2383 raft_consensus.cc:2804] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:52.221019  2383 raft_consensus.cc:697] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Leader. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:52.221485  2226 raft_consensus.cc:2468] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:52.222317  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ba54154cab456eb913ddb40a164f54" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:52.222168  2383 consensus_queue.cc:237] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.223033  2227 raft_consensus.cc:3060] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.224388  2345 tablet_bootstrap.cc:654] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:52.225976  2151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ba54154cab456eb913ddb40a164f54" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:52.226763  2151 raft_consensus.cc:3060] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.227001  2152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdb6c5047f14ebe8d6758ce69a6a110" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:52.227651  2152 raft_consensus.cc:3060] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.238205  2227 raft_consensus.cc:2468] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:52.232306  2350 leader_election.cc:290] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:52.239885  2152 raft_consensus.cc:2468] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:52.240094  2264 leader_election.cc:304] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:52.235832  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdb6c5047f14ebe8d6758ce69a6a110" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:52.241199  2266 leader_election.cc:304] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:52.241442  2226 raft_consensus.cc:3060] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.245903  2350 raft_consensus.cc:2804] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:52.250820  2350 raft_consensus.cc:697] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Leader. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:52.254165  2386 raft_consensus.cc:2804] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:52.256707  2386 raft_consensus.cc:697] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Leader. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:52.256560  2350 consensus_queue.cc:237] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.255084  2151 raft_consensus.cc:2468] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:52.257891  2386 consensus_queue.cc:237] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.279305  2345 tablet_bootstrap.cc:492] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4: No bootstrap required, opened a new log
I20260709 12:11:52.279881  2345 ts_tablet_manager.cc:1403] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4: Time spent bootstrapping tablet: real 0.105s	user 0.024s	sys 0.009s
I20260709 12:11:52.282603  2344 ts_tablet_manager.cc:1434] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd: Time spent starting tablet: real 0.121s	user 0.030s	sys 0.028s
I20260709 12:11:52.284713  2344 tablet_bootstrap.cc:492] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd: Bootstrap starting.
I20260709 12:11:52.286902  2226 raft_consensus.cc:2468] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:52.287515  2345 raft_consensus.cc:359] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.288210  2345 raft_consensus.cc:385] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:52.288457  2345 raft_consensus.cc:740] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Initialized, Role: FOLLOWER
I20260709 12:11:52.290176  2345 consensus_queue.cc:260] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.293162  2345 ts_tablet_manager.cc:1434] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:11:52.294831  2345 tablet_bootstrap.cc:492] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4: Bootstrap starting.
I20260709 12:11:52.301954  2345 tablet_bootstrap.cc:654] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:52.303745  2347 tablet_bootstrap.cc:654] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:52.310803  2344 tablet_bootstrap.cc:654] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:52.310966  2345 tablet_bootstrap.cc:492] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4: No bootstrap required, opened a new log
I20260709 12:11:52.311682  2345 ts_tablet_manager.cc:1403] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:11:52.315375  2345 raft_consensus.cc:359] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.316236  2345 raft_consensus.cc:385] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:52.316867  2345 raft_consensus.cc:740] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Initialized, Role: FOLLOWER
I20260709 12:11:52.317880  2345 consensus_queue.cc:260] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.319007  2347 tablet_bootstrap.cc:492] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35: No bootstrap required, opened a new log
I20260709 12:11:52.320463  2345 ts_tablet_manager.cc:1434] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:11:52.320573  2347 ts_tablet_manager.cc:1403] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35: Time spent bootstrapping tablet: real 0.110s	user 0.021s	sys 0.009s
I20260709 12:11:52.322109  2344 tablet_bootstrap.cc:492] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd: No bootstrap required, opened a new log
I20260709 12:11:52.322111  2386 consensus_queue.cc:1048] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:52.322851  2344 ts_tablet_manager.cc:1403] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.009s
I20260709 12:11:52.323659  2347 raft_consensus.cc:359] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.324518  2347 raft_consensus.cc:385] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:52.324911  2347 raft_consensus.cc:740] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Initialized, Role: FOLLOWER
I20260709 12:11:52.325816  2347 consensus_queue.cc:260] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.326987  2344 raft_consensus.cc:359] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.327687  2344 raft_consensus.cc:385] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:52.328171  2344 raft_consensus.cc:740] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Initialized, Role: FOLLOWER
I20260709 12:11:52.328475  2151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ec792334174b458d4eee1729e73d54" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35" is_pre_election: true
I20260709 12:11:52.329131  2151 raft_consensus.cc:2468] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 0.
I20260709 12:11:52.328868  2344 consensus_queue.cc:260] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.330114  2347 ts_tablet_manager.cc:1434] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:11:52.330677  2266 leader_election.cc:304] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:52.331202  2347 tablet_bootstrap.cc:492] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35: Bootstrap starting.
I20260709 12:11:52.331506  2386 raft_consensus.cc:2804] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:52.331887  2386 raft_consensus.cc:493] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.332266  2386 raft_consensus.cc:3060] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.334527  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ec792334174b458d4eee1729e73d54" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4" is_pre_election: true
I20260709 12:11:52.335261  2227 raft_consensus.cc:2468] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 0.
I20260709 12:11:52.338162  2347 tablet_bootstrap.cc:654] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:52.339469  2344 ts_tablet_manager.cc:1434] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:11:52.340335  2344 tablet_bootstrap.cc:492] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd: Bootstrap starting.
I20260709 12:11:52.340929  2350 consensus_queue.cc:1048] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:52.339193  2386 raft_consensus.cc:515] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.345845  2386 leader_election.cc:290] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:52.347079  2152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ec792334174b458d4eee1729e73d54" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:52.347965  2152 raft_consensus.cc:3060] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.348984  2344 tablet_bootstrap.cc:654] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:52.352289  2347 tablet_bootstrap.cc:492] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35: No bootstrap required, opened a new log
I20260709 12:11:52.352865  2347 ts_tablet_manager.cc:1403] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 12:11:52.356029  2347 raft_consensus.cc:359] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.356410  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ec792334174b458d4eee1729e73d54" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:52.357055  2347 raft_consensus.cc:385] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:52.357764  2347 raft_consensus.cc:740] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Initialized, Role: FOLLOWER
I20260709 12:11:52.358767  2347 consensus_queue.cc:260] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.361423  2347 ts_tablet_manager.cc:1434] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:11:52.366226  2227 raft_consensus.cc:3060] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.327704  2364 leader_election.cc:290] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:52.376292  2364 consensus_queue.cc:1048] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:52.382299  2152 raft_consensus.cc:2468] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:52.383912  2266 leader_election.cc:304] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:52.383704  2049 catalog_manager.cc:5697] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd reported cstate change: term changed from 0 to 1, leader changed from <none> to bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67). New cstate: current_term: 1 leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.385124  2386 raft_consensus.cc:2804] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:52.385775  2386 raft_consensus.cc:697] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Leader. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:52.385787  2049 catalog_manager.cc:5697] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd reported cstate change: term changed from 0 to 1, leader changed from <none> to bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67). New cstate: current_term: 1 leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.387039  2386 consensus_queue.cc:237] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.388262  2227 raft_consensus.cc:2468] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:52.389621  2049 catalog_manager.cc:5697] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd reported cstate change: term changed from 0 to 1, leader changed from <none> to bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67). New cstate: current_term: 1 leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.395114  2350 raft_consensus.cc:493] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.395677  2350 raft_consensus.cc:515] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.397693  2352 raft_consensus.cc:493] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.398195  2352 raft_consensus.cc:515] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.403002  2352 leader_election.cc:290] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:11:52.404649  2350 leader_election.cc:290] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:52.408277  2149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35" is_pre_election: true
I20260709 12:11:52.409238  2149 raft_consensus.cc:2468] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 0.
I20260709 12:11:52.410846  2266 leader_election.cc:304] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:52.412356  2383 raft_consensus.cc:2804] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:52.412819  2383 raft_consensus.cc:493] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.413265  2383 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.424733  2383 raft_consensus.cc:515] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.433589  2383 leader_election.cc:290] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:52.442153  2151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:52.442970  2151 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.454936  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4" is_pre_election: true
I20260709 12:11:52.457044  2226 raft_consensus.cc:2468] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 0.
I20260709 12:11:52.461455  2049 catalog_manager.cc:5697] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd reported cstate change: term changed from 0 to 1, leader changed from <none> to bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67). New cstate: current_term: 1 leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.464985  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:52.465152  2148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35" is_pre_election: true
I20260709 12:11:52.468197  2226 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.477396  2383 consensus_queue.cc:1048] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:11:52.483944  2344 tablet_bootstrap.cc:492] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd: No bootstrap required, opened a new log
I20260709 12:11:52.484477  2344 ts_tablet_manager.cc:1403] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd: Time spent bootstrapping tablet: real 0.144s	user 0.040s	sys 0.047s
I20260709 12:11:52.488310  2151 raft_consensus.cc:2468] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:52.492627  2266 leader_election.cc:304] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:52.489221  2226 raft_consensus.cc:2468] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 1.
I20260709 12:11:52.495213  2383 raft_consensus.cc:2804] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:52.494905  2344 raft_consensus.cc:359] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.495775  2344 raft_consensus.cc:385] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:52.496098  2344 raft_consensus.cc:740] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Initialized, Role: FOLLOWER
I20260709 12:11:52.495801  2383 raft_consensus.cc:697] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Leader. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:52.496877  2344 consensus_queue.cc:260] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.497370  2383 consensus_queue.cc:237] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
W20260709 12:11:52.498345  2096 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:11:52.499123  2344 ts_tablet_manager.cc:1434] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:11:52.508701  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd" is_pre_election: true
I20260709 12:11:52.510712  2191 leader_election.cc:304] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4; no voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd
I20260709 12:11:52.511600  2352 raft_consensus.cc:2749] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:52.520205  2352 raft_consensus.cc:493] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.520705  2352 raft_consensus.cc:515] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.522682  2352 leader_election.cc:290] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:11:52.522739  2048 catalog_manager.cc:5697] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd reported cstate change: term changed from 0 to 1, leader changed from <none> to bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67). New cstate: current_term: 1 leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.524317  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7f2777e02e4a4da9ab5e1867f12147" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd" is_pre_election: true
I20260709 12:11:52.524977  2300 raft_consensus.cc:2468] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 0.
I20260709 12:11:52.526207  2191 leader_election.cc:304] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:52.527017  2352 raft_consensus.cc:2804] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:52.527356  2352 raft_consensus.cc:493] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.527714  2352 raft_consensus.cc:3060] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.529414  2151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7f2777e02e4a4da9ab5e1867f12147" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35" is_pre_election: true
I20260709 12:11:52.532002  2151 raft_consensus.cc:2468] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 0.
I20260709 12:11:52.534801  2352 raft_consensus.cc:515] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.540030  2352 leader_election.cc:290] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 1 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:11:52.540446  2151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7f2777e02e4a4da9ab5e1867f12147" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:52.540705  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7f2777e02e4a4da9ab5e1867f12147" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:11:52.541033  2151 raft_consensus.cc:3060] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.541214  2300 raft_consensus.cc:3060] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:52.547895  2300 raft_consensus.cc:2468] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 1.
I20260709 12:11:52.547895  2151 raft_consensus.cc:2468] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 1.
I20260709 12:11:52.549453  2192 leader_election.cc:304] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, 03f117f42d154ad1a4764eb50c377a35; no voters: 
I20260709 12:11:52.550314  2352 raft_consensus.cc:2804] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:52.551762  2352 raft_consensus.cc:697] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 1 LEADER]: Becoming Leader. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:11:52.552657  2352 consensus_queue.cc:237] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.562594  2049 catalog_manager.cc:5697] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "0015a277ef40476e95fa121ca04b60a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.637135  2383 consensus_queue.cc:1048] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:52.650244  2364 consensus_queue.cc:1048] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:52.655471  2351 consensus_queue.cc:1048] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:52.685247  2351 consensus_queue.cc:1048] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:52.698626  2364 consensus_queue.cc:1048] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:52.731442  2386 consensus_queue.cc:1048] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:52.850462  2300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
mode: GRACEFUL
new_leader_uuid: "03f117f42d154ad1a4764eb50c377a35"
 from {username='slave'} at 127.0.0.1:52658
I20260709 12:11:52.851104  2300 raft_consensus.cc:606] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Received request to transfer leadership to TS 03f117f42d154ad1a4764eb50c377a35
I20260709 12:11:52.859587  2300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73ba54154cab456eb913ddb40a164f54"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
mode: GRACEFUL
new_leader_uuid: "03f117f42d154ad1a4764eb50c377a35"
 from {username='slave'} at 127.0.0.1:52658
I20260709 12:11:52.860128  2300 raft_consensus.cc:606] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Received request to transfer leadership to TS 03f117f42d154ad1a4764eb50c377a35
I20260709 12:11:52.865970  2300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f1b96975bc044d481d87d7b5878c724"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
mode: GRACEFUL
new_leader_uuid: "03f117f42d154ad1a4764eb50c377a35"
 from {username='slave'} at 127.0.0.1:52658
I20260709 12:11:52.865975  2350 consensus_queue.cc:1048] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:52.866515  2300 raft_consensus.cc:606] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Received request to transfer leadership to TS 03f117f42d154ad1a4764eb50c377a35
I20260709 12:11:52.872483  2300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25ec792334174b458d4eee1729e73d54"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
mode: GRACEFUL
new_leader_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:52658
I20260709 12:11:52.873167  2300 raft_consensus.cc:606] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Received request to transfer leadership to TS 0015a277ef40476e95fa121ca04b60a4
I20260709 12:11:52.879647  2386 consensus_queue.cc:1048] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:52.888027  2300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bdb6c5047f14ebe8d6758ce69a6a110"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
mode: GRACEFUL
new_leader_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:52658
I20260709 12:11:52.888648  2300 raft_consensus.cc:606] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Received request to transfer leadership to TS 0015a277ef40476e95fa121ca04b60a4
I20260709 12:11:52.891333  2383 consensus_queue.cc:1048] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:52.903492  2385 consensus_queue.cc:1048] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:52.904795  2385 raft_consensus.cc:993] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd: : Instructing follower 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:11:52.905236  2386 raft_consensus.cc:1081] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Signalling peer 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:11:52.907124  2226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25ec792334174b458d4eee1729e73d54"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:38448
I20260709 12:11:52.907763  2226 raft_consensus.cc:493] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:52.908133  2226 raft_consensus.cc:3060] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:52.915230  2226 raft_consensus.cc:515] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.919934  2226 leader_election.cc:290] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 2 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:11:52.921370  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ec792334174b458d4eee1729e73d54" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:11:52.922030  2300 raft_consensus.cc:3055] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:52.922384  2300 raft_consensus.cc:740] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:52.922479  2150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ec792334174b458d4eee1729e73d54" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:52.923242  2300 consensus_queue.cc:260] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.924754  2300 raft_consensus.cc:3060] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:52.924883  2385 raft_consensus.cc:993] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd: : Instructing follower 03f117f42d154ad1a4764eb50c377a35 to start an election
I20260709 12:11:52.925482  2385 raft_consensus.cc:1081] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Signalling peer 03f117f42d154ad1a4764eb50c377a35 to start an election
I20260709 12:11:52.923254  2150 raft_consensus.cc:3060] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:52.932063  2300 raft_consensus.cc:2468] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 2.
I20260709 12:11:52.932854  2148 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353"
dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
 from {username='slave'} at 127.0.0.1:54570
I20260709 12:11:52.933440  2148 raft_consensus.cc:493] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:52.933823  2148 raft_consensus.cc:3060] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:52.940897  2148 raft_consensus.cc:515] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:11:52.943965  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:11:52.944617  2301 raft_consensus.cc:3055] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:52.944955  2301 raft_consensus.cc:740] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:52.945734  2301 consensus_queue.cc:260] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:11:52.946849  2301 raft_consensus.cc:3060] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:52.950292  2299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "594880bc88c14b6b9783dbffaea89395"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
mode: GRACEFUL
new_leader_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:52658
I20260709 12:11:52.950949  2299 raft_consensus.cc:606] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Received request to transfer leadership to TS 0015a277ef40476e95fa121ca04b60a4
I20260709 12:11:52.955034  2150 raft_consensus.cc:2468] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 2.
I20260709 12:11:52.956791  2192 leader_election.cc:304] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, 03f117f42d154ad1a4764eb50c377a35; no voters: 
I20260709 12:11:52.958693  2352 raft_consensus.cc:2804] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:52.959335  2352 raft_consensus.cc:697] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Becoming Leader. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:11:52.960456  2352 consensus_queue.cc:237] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:52.963691  2301 raft_consensus.cc:2468] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 2.
I20260709 12:11:52.965019  2116 leader_election.cc:304] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:52.966002  2415 raft_consensus.cc:2804] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:52.966477  2415 raft_consensus.cc:697] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Becoming Leader. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Running, Role: LEADER
I20260709 12:11:52.967548  2148 leader_election.cc:290] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 2 election: Requested vote from peers bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:52.967293  2415 consensus_queue.cc:237] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:11:52.970645  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:52.971452  2226 raft_consensus.cc:3060] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:52.981988  2301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
mode: GRACEFUL
new_leader_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:52658
I20260709 12:11:52.982676  2301 raft_consensus.cc:606] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Received request to transfer leadership to TS 0015a277ef40476e95fa121ca04b60a4
I20260709 12:11:52.990218  2226 raft_consensus.cc:2468] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 2.
I20260709 12:11:52.993284  2386 raft_consensus.cc:993] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd: : Instructing follower 03f117f42d154ad1a4764eb50c377a35 to start an election
I20260709 12:11:52.993745  2386 raft_consensus.cc:1081] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Signalling peer 03f117f42d154ad1a4764eb50c377a35 to start an election
I20260709 12:11:52.996565  2148 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73ba54154cab456eb913ddb40a164f54"
dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
 from {username='slave'} at 127.0.0.1:54570
I20260709 12:11:52.997203  2148 raft_consensus.cc:493] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:52.999099  2049 catalog_manager.cc:5697] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 reported cstate change: term changed from 1 to 2, leader changed from bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67) to 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "03f117f42d154ad1a4764eb50c377a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:53.003451  2148 raft_consensus.cc:3060] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.010177  2352 consensus_queue.cc:1048] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:53.012562  2385 consensus_queue.cc:1048] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:53.012343  2048 catalog_manager.cc:5697] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 reported cstate change: term changed from 1 to 2, leader changed from bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67) to 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "0015a277ef40476e95fa121ca04b60a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:53.016633  2148 raft_consensus.cc:515] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.019706  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ba54154cab456eb913ddb40a164f54" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:53.020375  2225 raft_consensus.cc:3060] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.021080  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ba54154cab456eb913ddb40a164f54" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:11:53.021754  2301 raft_consensus.cc:3055] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:53.022073  2301 raft_consensus.cc:740] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:53.022929  2301 consensus_queue.cc:260] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.024091  2301 raft_consensus.cc:3060] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.027465  2225 raft_consensus.cc:2468] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 2.
I20260709 12:11:53.028800  2115 leader_election.cc:304] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, 03f117f42d154ad1a4764eb50c377a35; no voters: 
I20260709 12:11:53.029704  2415 raft_consensus.cc:2804] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:53.030267  2415 raft_consensus.cc:697] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Becoming Leader. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Running, Role: LEADER
I20260709 12:11:53.030689  2148 leader_election.cc:290] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 2 election: Requested vote from peers 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:11:53.031119  2415 consensus_queue.cc:237] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.034005  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce7f2777e02e4a4da9ab5e1867f12147"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
mode: GRACEFUL
new_leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
 from {username='slave'} at 127.0.0.1:38964
I20260709 12:11:53.034749  2226 raft_consensus.cc:606] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 1 LEADER]: Received request to transfer leadership to TS bd0f951bbfa84993912f6b0b555d35bd
I20260709 12:11:53.031848  2301 raft_consensus.cc:2468] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 2.
I20260709 12:11:53.044701  2383 raft_consensus.cc:993] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd: : Instructing follower 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:11:53.045163  2383 raft_consensus.cc:1081] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Signalling peer 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:11:53.055642  2364 consensus_queue.cc:1048] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:53.057837  2049 catalog_manager.cc:5697] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 reported cstate change: term changed from 1 to 2, leader changed from bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67) to 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "03f117f42d154ad1a4764eb50c377a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:53.063053  2409 consensus_queue.cc:1048] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:53.072729  2227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:38448
I20260709 12:11:53.074105  2227 raft_consensus.cc:493] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:53.075124  2227 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.083120  2227 raft_consensus.cc:515] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.086513  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:11:53.087121  2300 raft_consensus.cc:3055] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:53.087456  2300 raft_consensus.cc:740] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:53.088238  2300 consensus_queue.cc:260] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.089323  2300 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.089995  2352 raft_consensus.cc:993] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4: : Instructing follower bd0f951bbfa84993912f6b0b555d35bd to start an election
I20260709 12:11:53.090415  2352 raft_consensus.cc:1081] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 1 LEADER]: Signalling peer bd0f951bbfa84993912f6b0b555d35bd to start an election
I20260709 12:11:53.091594  2148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:53.092260  2148 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.093643  2299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce7f2777e02e4a4da9ab5e1867f12147"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
 from {username='slave'} at 127.0.0.1:51078
I20260709 12:11:53.094462  2299 raft_consensus.cc:493] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:53.094815  2299 raft_consensus.cc:3060] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.095650  2227 leader_election.cc:290] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 2 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:11:53.096513  2300 raft_consensus.cc:2468] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 2.
I20260709 12:11:53.100061  2191 leader_election.cc:304] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:53.100879  2352 raft_consensus.cc:2804] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:53.101349  2352 raft_consensus.cc:697] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Becoming Leader. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:11:53.102101  2352 consensus_queue.cc:237] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.104559  2148 raft_consensus.cc:2468] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 2.
I20260709 12:11:53.107144  2299 raft_consensus.cc:515] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.110515  2148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7f2777e02e4a4da9ab5e1867f12147" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:53.110340  2048 catalog_manager.cc:5697] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 reported cstate change: term changed from 1 to 2, leader changed from bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67) to 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "0015a277ef40476e95fa121ca04b60a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:53.111881  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7f2777e02e4a4da9ab5e1867f12147" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:53.112538  2227 raft_consensus.cc:3055] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:53.112941  2227 raft_consensus.cc:740] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:11:53.113818  2227 consensus_queue.cc:260] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.114955  2227 raft_consensus.cc:3060] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.121819  2227 raft_consensus.cc:2468] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 2.
I20260709 12:11:53.122323  2299 leader_election.cc:290] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 2 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:53.111171  2148 raft_consensus.cc:3060] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.128306  2264 leader_election.cc:304] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:53.129103  2386 raft_consensus.cc:2804] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:53.129649  2386 raft_consensus.cc:697] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [term 2 LEADER]: Becoming Leader. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:53.129761  2148 raft_consensus.cc:2468] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 2.
I20260709 12:11:53.130613  2386 consensus_queue.cc:237] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.138437  2386 raft_consensus.cc:993] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd: : Instructing follower 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:11:53.138880  2350 raft_consensus.cc:1081] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Signalling peer 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:11:53.138146  2048 catalog_manager.cc:5697] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd reported cstate change: term changed from 1 to 2, leader changed from 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66) to bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67). New cstate: current_term: 2 leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:53.140704  2227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "594880bc88c14b6b9783dbffaea89395"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:38448
I20260709 12:11:53.141284  2227 raft_consensus.cc:493] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:53.141700  2227 raft_consensus.cc:3060] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.149173  2227 raft_consensus.cc:515] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.151561  2227 leader_election.cc:290] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 2 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:11:53.152551  2148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594880bc88c14b6b9783dbffaea89395" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:53.152714  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594880bc88c14b6b9783dbffaea89395" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:11:53.153175  2148 raft_consensus.cc:3060] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.153401  2299 raft_consensus.cc:3055] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:53.153786  2299 raft_consensus.cc:740] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:53.154644  2299 consensus_queue.cc:260] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.156533  2299 raft_consensus.cc:3060] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.160624  2148 raft_consensus.cc:2468] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 2.
I20260709 12:11:53.162395  2192 leader_election.cc:304] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, 03f117f42d154ad1a4764eb50c377a35; no voters: 
I20260709 12:11:53.163494  2409 raft_consensus.cc:2804] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:53.164021  2409 raft_consensus.cc:697] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Becoming Leader. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:11:53.164501  2299 raft_consensus.cc:2468] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 2.
I20260709 12:11:53.164875  2409 consensus_queue.cc:237] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.174312  2048 catalog_manager.cc:5697] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 reported cstate change: term changed from 1 to 2, leader changed from bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67) to 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "0015a277ef40476e95fa121ca04b60a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:53.205547  2386 raft_consensus.cc:993] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd: : Instructing follower 03f117f42d154ad1a4764eb50c377a35 to start an election
I20260709 12:11:53.205996  2350 raft_consensus.cc:1081] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Signalling peer 03f117f42d154ad1a4764eb50c377a35 to start an election
I20260709 12:11:53.207573  2148 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f1b96975bc044d481d87d7b5878c724"
dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
 from {username='slave'} at 127.0.0.1:54570
I20260709 12:11:53.208149  2148 raft_consensus.cc:493] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:53.208524  2148 raft_consensus.cc:3060] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.215236  2148 raft_consensus.cc:515] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.218398  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1b96975bc044d481d87d7b5878c724" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:11:53.219007  2299 raft_consensus.cc:3055] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:53.219143  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1b96975bc044d481d87d7b5878c724" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:53.219756  2148 leader_election.cc:290] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 2 election: Requested vote from peers 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:11:53.219900  2227 raft_consensus.cc:3060] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.219380  2299 raft_consensus.cc:740] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:53.221836  2299 consensus_queue.cc:260] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.223173  2299 raft_consensus.cc:3060] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.226176  2227 raft_consensus.cc:2468] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 2.
I20260709 12:11:53.227183  2115 leader_election.cc:304] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, 03f117f42d154ad1a4764eb50c377a35; no voters: 
I20260709 12:11:53.227919  2351 raft_consensus.cc:2804] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:53.228358  2351 raft_consensus.cc:697] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Becoming Leader. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Running, Role: LEADER
I20260709 12:11:53.229167  2351 consensus_queue.cc:237] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.229779  2299 raft_consensus.cc:2468] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 2.
I20260709 12:11:53.236526  2048 catalog_manager.cc:5697] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 reported cstate change: term changed from 1 to 2, leader changed from bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67) to 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "03f117f42d154ad1a4764eb50c377a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:53.247035  2385 raft_consensus.cc:993] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd: : Instructing follower 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:11:53.247702  2350 raft_consensus.cc:1081] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Signalling peer 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:11:53.249456  2227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bdb6c5047f14ebe8d6758ce69a6a110"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:38448
I20260709 12:11:53.249986  2227 raft_consensus.cc:493] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:53.250649  2227 raft_consensus.cc:3060] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.255762  2227 raft_consensus.cc:515] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.258150  2227 leader_election.cc:290] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 2 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:11:53.258980  2148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdb6c5047f14ebe8d6758ce69a6a110" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:53.259636  2148 raft_consensus.cc:3060] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.259761  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdb6c5047f14ebe8d6758ce69a6a110" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:11:53.260452  2299 raft_consensus.cc:3055] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:53.260747  2299 raft_consensus.cc:740] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:53.261520  2299 consensus_queue.cc:260] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.262693  2299 raft_consensus.cc:3060] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:53.266856  2148 raft_consensus.cc:2468] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 2.
I20260709 12:11:53.267663  2299 raft_consensus.cc:2468] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 2.
I20260709 12:11:53.268370  2192 leader_election.cc:304] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, 03f117f42d154ad1a4764eb50c377a35; no voters: 
I20260709 12:11:53.269556  2409 raft_consensus.cc:2804] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:53.270051  2409 raft_consensus.cc:697] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Becoming Leader. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:11:53.270900  2409 consensus_queue.cc:237] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:53.278628  2048 catalog_manager.cc:5697] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 reported cstate change: term changed from 1 to 2, leader changed from bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67) to 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "0015a277ef40476e95fa121ca04b60a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:53.441071  2148 raft_consensus.cc:1275] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.442425  2409 consensus_queue.cc:1048] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:53.450950  2299 raft_consensus.cc:1275] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.453248  2430 consensus_queue.cc:1048] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:11:53.520891  2227 raft_consensus.cc:1275] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Refusing update from remote peer 03f117f42d154ad1a4764eb50c377a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.522368  2351 consensus_queue.cc:1048] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:53.532909  2299 raft_consensus.cc:1275] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Refusing update from remote peer 03f117f42d154ad1a4764eb50c377a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.536720  2415 consensus_queue.cc:1048] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:53.546002  2301 raft_consensus.cc:1275] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Refusing update from remote peer 03f117f42d154ad1a4764eb50c377a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.547658  2415 consensus_queue.cc:1048] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:53.556943  2227 raft_consensus.cc:1275] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Refusing update from remote peer 03f117f42d154ad1a4764eb50c377a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.559396  2351 consensus_queue.cc:1048] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:53.589210  2148 raft_consensus.cc:1275] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.590632  2430 consensus_queue.cc:1048] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:53.599663  2299 raft_consensus.cc:1275] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.601429  2352 consensus_queue.cc:1048] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:53.618934  2148 raft_consensus.cc:1275] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Refusing update from remote peer bd0f951bbfa84993912f6b0b555d35bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.620602  2350 consensus_queue.cc:1048] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:11:53.621819  2299 raft_consensus.cc:1275] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.623602  2430 consensus_queue.cc:1048] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:53.631327  2227 raft_consensus.cc:1275] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Refusing update from remote peer bd0f951bbfa84993912f6b0b555d35bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.633183  2386 consensus_queue.cc:1048] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:53.636207  2227 raft_consensus.cc:1275] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Refusing update from remote peer 03f117f42d154ad1a4764eb50c377a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.637719  2351 consensus_queue.cc:1048] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:53.641535  2151 raft_consensus.cc:1275] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.644418  2409 consensus_queue.cc:1048] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:53.694916  2299 raft_consensus.cc:1275] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Refusing update from remote peer 03f117f42d154ad1a4764eb50c377a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.696965  2414 consensus_queue.cc:1048] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:53.725502  2299 raft_consensus.cc:1275] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.726924  2352 consensus_queue.cc:1048] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:53.735773  2148 raft_consensus.cc:1275] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:53.737531  2409 consensus_queue.cc:1048] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:56.069216  2017 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:11:56.069936  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:56.085129  2227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
mode: GRACEFUL
new_leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
 from {username='slave'} at 127.0.0.1:38970
I20260709 12:11:56.085637  2227 raft_consensus.cc:606] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Received request to transfer leadership to TS bd0f951bbfa84993912f6b0b555d35bd
I20260709 12:11:56.096645  2148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54"
dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
mode: GRACEFUL
new_leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
 from {username='slave'} at 127.0.0.1:35190
I20260709 12:11:56.097251  2148 raft_consensus.cc:606] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 1 LEADER]: Received request to transfer leadership to TS bd0f951bbfa84993912f6b0b555d35bd
I20260709 12:11:56.098522  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:11:56.099061  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:56.194248  2438 raft_consensus.cc:993] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4: : Instructing follower bd0f951bbfa84993912f6b0b555d35bd to start an election
I20260709 12:11:56.194914  2409 raft_consensus.cc:1081] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Signalling peer bd0f951bbfa84993912f6b0b555d35bd to start an election
I20260709 12:11:56.196617  2301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
 from {username='slave'} at 127.0.0.1:51078
I20260709 12:11:56.197407  2301 raft_consensus.cc:493] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:56.197824  2301 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:56.205646  2301 raft_consensus.cc:515] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:56.207901  2301 leader_election.cc:290] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 3 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:56.208596  2148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:56.208964  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:56.209198  2148 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:56.209470  2227 raft_consensus.cc:3055] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:11:56.209779  2227 raft_consensus.cc:740] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:11:56.210409  2227 consensus_queue.cc:260] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:56.211212  2227 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:56.213973  2148 raft_consensus.cc:2468] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 3.
I20260709 12:11:56.215191  2266 leader_election.cc:304] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:56.215337  2227 raft_consensus.cc:2468] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 3.
I20260709 12:11:56.216171  2433 raft_consensus.cc:2804] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:11:56.217411  2433 raft_consensus.cc:697] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 3 LEADER]: Becoming Leader. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:56.218457  2433 consensus_queue.cc:237] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:56.230639  2049 catalog_manager.cc:5697] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd reported cstate change: term changed from 2 to 3, leader changed from 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66) to bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67). New cstate: current_term: 3 leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:56.406555  2414 raft_consensus.cc:993] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35: : Instructing follower bd0f951bbfa84993912f6b0b555d35bd to start an election
I20260709 12:11:56.407048  2439 raft_consensus.cc:1081] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 1 LEADER]: Signalling peer bd0f951bbfa84993912f6b0b555d35bd to start an election
I20260709 12:11:56.408506  2301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
 from {username='slave'} at 127.0.0.1:51072
I20260709 12:11:56.408951  2301 raft_consensus.cc:493] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:56.409271  2301 raft_consensus.cc:3060] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:56.413813  2301 raft_consensus.cc:515] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:56.415326  2301 leader_election.cc:290] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 2 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:11:56.416290  2148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:11:56.416407  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:11:56.416970  2148 raft_consensus.cc:3055] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:56.417016  2227 raft_consensus.cc:3060] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:56.417325  2148 raft_consensus.cc:740] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Running, Role: LEADER
I20260709 12:11:56.418041  2148 consensus_queue.cc:260] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:56.418922  2148 raft_consensus.cc:3060] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:56.421362  2227 raft_consensus.cc:2468] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 2.
I20260709 12:11:56.422307  2264 leader_election.cc:304] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:11:56.423026  2433 raft_consensus.cc:2804] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:56.423411  2433 raft_consensus.cc:697] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 LEADER]: Becoming Leader. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:11:56.423628  2148 raft_consensus.cc:2468] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 2.
I20260709 12:11:56.424220  2433 consensus_queue.cc:237] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:11:56.431185  2049 catalog_manager.cc:5697] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd reported cstate change: term changed from 1 to 2, leader changed from 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65) to bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67). New cstate: current_term: 2 leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:56.619692  2148 raft_consensus.cc:1275] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Refusing update from remote peer bd0f951bbfa84993912f6b0b555d35bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:56.621045  2433 consensus_queue.cc:1048] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:56.632201  2227 raft_consensus.cc:1275] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Refusing update from remote peer bd0f951bbfa84993912f6b0b555d35bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:56.633783  2452 consensus_queue.cc:1048] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:56.808171  2226 raft_consensus.cc:1275] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Refusing update from remote peer bd0f951bbfa84993912f6b0b555d35bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:56.809453  2452 consensus_queue.cc:1048] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:56.818440  2148 raft_consensus.cc:1275] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Refusing update from remote peer bd0f951bbfa84993912f6b0b555d35bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:56.820465  2433 consensus_queue.cc:1048] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:57.099954  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:57.104843  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:57.105293  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:58.106192  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:58.110937  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:58.111390  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:59.112792  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:59.118703  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:59.119174  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:00.120376  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:00.125229  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:00.125661  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:01.126605  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:01.131402  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:01.131858  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:02.132876  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:02.138545  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:02.139067  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:03.140012  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:03.144856  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:03.145229  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:04.146199  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:04.153548  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:04.154035  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:05.155366  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:05.160466  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:05.160838  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:06.192757  2017 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:12:06.214226  2148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353"
dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
mode: GRACEFUL
new_leader_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:42298
I20260709 12:12:06.214980  2148 raft_consensus.cc:606] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Received request to transfer leadership to TS 0015a277ef40476e95fa121ca04b60a4
I20260709 12:12:06.220769  2301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
mode: GRACEFUL
new_leader_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:52658
I20260709 12:12:06.221308  2301 raft_consensus.cc:606] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 LEADER]: Received request to transfer leadership to TS 0015a277ef40476e95fa121ca04b60a4
I20260709 12:12:06.226873  2148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73ba54154cab456eb913ddb40a164f54"
dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
mode: GRACEFUL
new_leader_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:42298
I20260709 12:12:06.227528  2148 raft_consensus.cc:606] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Received request to transfer leadership to TS 0015a277ef40476e95fa121ca04b60a4
I20260709 12:12:06.232318  2148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f1b96975bc044d481d87d7b5878c724"
dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
mode: GRACEFUL
new_leader_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:42298
I20260709 12:12:06.232851  2148 raft_consensus.cc:606] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Received request to transfer leadership to TS 0015a277ef40476e95fa121ca04b60a4
I20260709 12:12:06.245764  2301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
mode: GRACEFUL
new_leader_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:52658
I20260709 12:12:06.246436  2301 raft_consensus.cc:606] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 3 LEADER]: Received request to transfer leadership to TS 0015a277ef40476e95fa121ca04b60a4
I20260709 12:12:06.340032  2468 raft_consensus.cc:993] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35: : Instructing follower 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:12:06.340634  2464 raft_consensus.cc:1081] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Signalling peer 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:12:06.342527  2226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f1b96975bc044d481d87d7b5878c724"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:38464
I20260709 12:12:06.343079  2226 raft_consensus.cc:493] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:06.343406  2226 raft_consensus.cc:3060] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:06.348105  2226 raft_consensus.cc:515] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:06.349858  2226 leader_election.cc:290] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 3 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:12:06.350847  2148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1b96975bc044d481d87d7b5878c724" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:12:06.350963  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1b96975bc044d481d87d7b5878c724" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:12:06.351619  2148 raft_consensus.cc:3055] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:06.351660  2301 raft_consensus.cc:3060] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:06.351925  2148 raft_consensus.cc:740] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Running, Role: LEADER
I20260709 12:12:06.352618  2148 consensus_queue.cc:260] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:06.353644  2148 raft_consensus.cc:3060] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:06.357467  2301 raft_consensus.cc:2468] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 3.
I20260709 12:12:06.358744  2191 leader_election.cc:304] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:12:06.359015  2148 raft_consensus.cc:2468] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 3.
I20260709 12:12:06.359671  2461 raft_consensus.cc:2804] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:06.360703  2461 raft_consensus.cc:697] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Becoming Leader. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:12:06.361462  2461 consensus_queue.cc:237] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:06.368530  2048 catalog_manager.cc:5697] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 reported cstate change: term changed from 2 to 3, leader changed from 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65) to 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66). New cstate: current_term: 3 leader_uuid: "0015a277ef40476e95fa121ca04b60a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.422485  2468 raft_consensus.cc:993] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35: : Instructing follower 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:12:06.422925  2464 raft_consensus.cc:1081] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Signalling peer 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:12:06.424537  2226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:38464
I20260709 12:12:06.425117  2226 raft_consensus.cc:493] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:06.425454  2226 raft_consensus.cc:3060] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:06.426692  2464 raft_consensus.cc:993] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35: : Instructing follower 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:12:06.427153  2468 raft_consensus.cc:1081] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Signalling peer 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:12:06.428680  2227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73ba54154cab456eb913ddb40a164f54"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:38464
I20260709 12:12:06.429162  2227 raft_consensus.cc:493] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:06.429481  2227 raft_consensus.cc:3060] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:06.431638  2226 raft_consensus.cc:515] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:12:06.433883  2226 leader_election.cc:290] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 3 election: Requested vote from peers bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013), 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987)
I20260709 12:12:06.434383  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:12:06.434756  2148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:12:06.434955  2301 raft_consensus.cc:3060] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:06.435241  2148 raft_consensus.cc:3055] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:06.435555  2148 raft_consensus.cc:740] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Running, Role: LEADER
I20260709 12:12:06.436195  2227 raft_consensus.cc:515] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:06.436380  2148 consensus_queue.cc:260] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:12:06.437685  2148 raft_consensus.cc:3060] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:06.438081  2227 leader_election.cc:290] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 3 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:12:06.438730  2151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ba54154cab456eb913ddb40a164f54" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:12:06.439213  2151 raft_consensus.cc:3055] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:06.439502  2151 raft_consensus.cc:740] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Running, Role: LEADER
I20260709 12:12:06.440160  2151 consensus_queue.cc:260] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:06.441002  2151 raft_consensus.cc:3060] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:06.441745  2301 raft_consensus.cc:2468] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 3.
I20260709 12:12:06.443833  2148 raft_consensus.cc:2468] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 3.
I20260709 12:12:06.444902  2191 leader_election.cc:304] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:12:06.445662  2461 raft_consensus.cc:2804] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:06.445171  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ba54154cab456eb913ddb40a164f54" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:12:06.446169  2461 raft_consensus.cc:697] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Becoming Leader. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:12:06.446434  2301 raft_consensus.cc:3060] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:06.446496  2151 raft_consensus.cc:2468] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 3.
I20260709 12:12:06.447660  2192 leader_election.cc:304] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, 03f117f42d154ad1a4764eb50c377a35; no voters: 
I20260709 12:12:06.447264  2461 consensus_queue.cc:237] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:12:06.448489  2469 raft_consensus.cc:2804] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:06.449846  2469 raft_consensus.cc:697] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Becoming Leader. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:12:06.450621  2469 consensus_queue.cc:237] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:06.453090  2301 raft_consensus.cc:2468] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 3.
I20260709 12:12:06.456568  2048 catalog_manager.cc:5697] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 reported cstate change: term changed from 2 to 3, leader changed from 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65) to 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66). New cstate: current_term: 3 leader_uuid: "0015a277ef40476e95fa121ca04b60a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.468875  2048 catalog_manager.cc:5697] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 reported cstate change: term changed from 2 to 3, leader changed from 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65) to 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66). New cstate: current_term: 3 leader_uuid: "0015a277ef40476e95fa121ca04b60a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.471629  2478 raft_consensus.cc:993] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd: : Instructing follower 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:12:06.472306  2465 raft_consensus.cc:1081] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 LEADER]: Signalling peer 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:12:06.474002  2227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:38448
I20260709 12:12:06.474524  2227 raft_consensus.cc:493] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:06.474869  2227 raft_consensus.cc:3060] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:06.480000  2227 raft_consensus.cc:515] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:06.481307  2227 leader_election.cc:290] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 3 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:12:06.482126  2151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:12:06.482277  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:12:06.482760  2151 raft_consensus.cc:3060] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:06.482784  2301 raft_consensus.cc:3055] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:06.483295  2301 raft_consensus.cc:740] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:12:06.484058  2301 consensus_queue.cc:260] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:06.485183  2301 raft_consensus.cc:3060] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:06.489547  2151 raft_consensus.cc:2468] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 3.
I20260709 12:12:06.490782  2192 leader_election.cc:304] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, 03f117f42d154ad1a4764eb50c377a35; no voters: 
I20260709 12:12:06.491021  2301 raft_consensus.cc:2468] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 3.
I20260709 12:12:06.491705  2469 raft_consensus.cc:2804] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:06.492216  2469 raft_consensus.cc:697] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Becoming Leader. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:12:06.492993  2469 consensus_queue.cc:237] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:06.499300  2048 catalog_manager.cc:5697] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 reported cstate change: term changed from 2 to 3, leader changed from bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67) to 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66). New cstate: current_term: 3 leader_uuid: "0015a277ef40476e95fa121ca04b60a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.751713  2151 raft_consensus.cc:1275] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:06.753083  2469 consensus_queue.cc:1048] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:06.765590  2301 raft_consensus.cc:1275] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:06.766925  2461 consensus_queue.cc:1048] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:06.774832  2478 raft_consensus.cc:993] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd: : Instructing follower 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:12:06.775384  2465 raft_consensus.cc:1081] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 3 LEADER]: Signalling peer 0015a277ef40476e95fa121ca04b60a4 to start an election
I20260709 12:12:06.776928  2227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
 from {username='slave'} at 127.0.0.1:38448
I20260709 12:12:06.777436  2227 raft_consensus.cc:493] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:06.777702  2227 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:06.782366  2227 raft_consensus.cc:515] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:06.783957  2227 leader_election.cc:290] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 4 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:12:06.784778  2151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:12:06.785368  2151 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:06.787809  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "0015a277ef40476e95fa121ca04b60a4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:12:06.788306  2301 raft_consensus.cc:3055] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:06.788539  2301 raft_consensus.cc:740] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:12:06.789098  2301 consensus_queue.cc:260] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:06.790360  2151 raft_consensus.cc:2468] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 4.
I20260709 12:12:06.790575  2301 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:06.791714  2192 leader_election.cc:304] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, 03f117f42d154ad1a4764eb50c377a35; no voters: 
I20260709 12:12:06.792444  2461 raft_consensus.cc:2804] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:06.792958  2461 raft_consensus.cc:697] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 4 LEADER]: Becoming Leader. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:12:06.793889  2461 consensus_queue.cc:237] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:06.798103  2301 raft_consensus.cc:2468] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0015a277ef40476e95fa121ca04b60a4 in term 4.
I20260709 12:12:06.803516  2049 catalog_manager.cc:5697] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 reported cstate change: term changed from 3 to 4, leader changed from bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67) to 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66). New cstate: current_term: 4 leader_uuid: "0015a277ef40476e95fa121ca04b60a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.864070  2151 raft_consensus.cc:1275] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:06.865454  2461 consensus_queue.cc:1048] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:06.875157  2299 raft_consensus.cc:1275] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:06.876564  2461 consensus_queue.cc:1048] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:06.880656  2301 raft_consensus.cc:1275] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:06.882102  2469 consensus_queue.cc:1048] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:06.894220  2151 raft_consensus.cc:1275] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:06.896925  2461 consensus_queue.cc:1048] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:06.897750  2301 raft_consensus.cc:1275] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:06.899017  2461 consensus_queue.cc:1048] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:06.912189  2151 raft_consensus.cc:1275] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:06.914247  2469 consensus_queue.cc:1048] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:07.346652  2151 raft_consensus.cc:1275] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 4 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:07.347930  2475 consensus_queue.cc:1048] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:07.356997  2301 raft_consensus.cc:1275] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 4 FOLLOWER]: Refusing update from remote peer 0015a277ef40476e95fa121ca04b60a4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:07.358829  2461 consensus_queue.cc:1048] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:09.655311  2017 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:12:09.656164  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:09.663293  2227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
mode: GRACEFUL
new_leader_uuid: "03f117f42d154ad1a4764eb50c377a35"
 from {username='slave'} at 127.0.0.1:38970
I20260709 12:12:09.664222  2227 raft_consensus.cc:606] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 4 LEADER]: Received request to transfer leadership to TS 03f117f42d154ad1a4764eb50c377a35
I20260709 12:12:09.667327  2227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25ec792334174b458d4eee1729e73d54"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
mode: GRACEFUL
new_leader_uuid: "03f117f42d154ad1a4764eb50c377a35"
 from {username='slave'} at 127.0.0.1:38970
I20260709 12:12:09.667821  2227 raft_consensus.cc:606] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Received request to transfer leadership to TS 03f117f42d154ad1a4764eb50c377a35
I20260709 12:12:09.670136  2227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bdb6c5047f14ebe8d6758ce69a6a110"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
mode: GRACEFUL
new_leader_uuid: "03f117f42d154ad1a4764eb50c377a35"
 from {username='slave'} at 127.0.0.1:38970
I20260709 12:12:09.670565  2227 raft_consensus.cc:606] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Received request to transfer leadership to TS 03f117f42d154ad1a4764eb50c377a35
I20260709 12:12:09.672991  2227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
mode: GRACEFUL
new_leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
 from {username='slave'} at 127.0.0.1:38970
I20260709 12:12:09.673354  2227 raft_consensus.cc:606] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Received request to transfer leadership to TS bd0f951bbfa84993912f6b0b555d35bd
I20260709 12:12:09.675460  2227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353"
dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
mode: GRACEFUL
new_leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
 from {username='slave'} at 127.0.0.1:38970
I20260709 12:12:09.675834  2227 raft_consensus.cc:606] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Received request to transfer leadership to TS bd0f951bbfa84993912f6b0b555d35bd
I20260709 12:12:09.676847  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:09.677224  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:09.716701  2475 raft_consensus.cc:993] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4: : Instructing follower bd0f951bbfa84993912f6b0b555d35bd to start an election
I20260709 12:12:09.717284  2495 raft_consensus.cc:1081] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Signalling peer bd0f951bbfa84993912f6b0b555d35bd to start an election
I20260709 12:12:09.718813  2299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
 from {username='slave'} at 127.0.0.1:51078
I20260709 12:12:09.719329  2299 raft_consensus.cc:493] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:09.719794  2299 raft_consensus.cc:3060] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:09.725584  2299 raft_consensus.cc:515] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:12:09.727843  2299 leader_election.cc:290] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 4 election: Requested vote from peers 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455), 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987)
I20260709 12:12:09.728752  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:12:09.729282  2149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bf9e35e5334190b45626fbeb734353" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:12:09.729530  2227 raft_consensus.cc:3055] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:09.729792  2149 raft_consensus.cc:3060] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:09.729862  2227 raft_consensus.cc:740] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:12:09.730644  2227 consensus_queue.cc:260] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:12:09.731582  2227 raft_consensus.cc:3060] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:09.735142  2149 raft_consensus.cc:2468] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 4.
I20260709 12:12:09.736174  2227 raft_consensus.cc:2468] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 4.
I20260709 12:12:09.736436  2266 leader_election.cc:304] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:12:09.737411  2465 raft_consensus.cc:2804] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:09.738229  2465 raft_consensus.cc:697] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 4 LEADER]: Becoming Leader. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:12:09.738970  2465 consensus_queue.cc:237] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } }
I20260709 12:12:09.749910  2048 catalog_manager.cc:5697] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd reported cstate change: term changed from 3 to 4, leader changed from 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66) to bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67). New cstate: current_term: 4 leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:09.801191  2475 raft_consensus.cc:993] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4: : Instructing follower 03f117f42d154ad1a4764eb50c377a35 to start an election
I20260709 12:12:09.801667  2495 raft_consensus.cc:1081] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Signalling peer 03f117f42d154ad1a4764eb50c377a35 to start an election
I20260709 12:12:09.803051  2149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bdb6c5047f14ebe8d6758ce69a6a110"
dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
 from {username='slave'} at 127.0.0.1:54576
I20260709 12:12:09.803515  2149 raft_consensus.cc:493] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:09.803766  2149 raft_consensus.cc:3060] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:09.808182  2149 raft_consensus.cc:515] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:09.810245  2149 leader_election.cc:290] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 3 election: Requested vote from peers 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:12:09.811072  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdb6c5047f14ebe8d6758ce69a6a110" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:12:09.811189  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdb6c5047f14ebe8d6758ce69a6a110" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:12:09.811697  2227 raft_consensus.cc:3055] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:09.811761  2299 raft_consensus.cc:3060] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:09.811918  2227 raft_consensus.cc:740] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:12:09.812618  2227 consensus_queue.cc:260] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:09.813467  2227 raft_consensus.cc:3060] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:09.816130  2299 raft_consensus.cc:2468] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 3.
I20260709 12:12:09.817569  2116 leader_election.cc:304] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:12:09.818850  2227 raft_consensus.cc:2468] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 3.
I20260709 12:12:09.819825  2504 raft_consensus.cc:2804] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:09.821014  2504 raft_consensus.cc:697] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 3 LEADER]: Becoming Leader. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Running, Role: LEADER
I20260709 12:12:09.821835  2504 consensus_queue.cc:237] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
W20260709 12:12:09.828838  2248 debug-util.cc:398] Leaking SignalData structure 0x7b080012b000 after lost signal to thread 2020
W20260709 12:12:09.829908  2248 debug-util.cc:398] Leaking SignalData structure 0x7b080012b6e0 after lost signal to thread 2083
I20260709 12:12:09.830001  2048 catalog_manager.cc:5697] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 reported cstate change: term changed from 2 to 3, leader changed from 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66) to 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "03f117f42d154ad1a4764eb50c377a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:09.831151  2248 debug-util.cc:398] Leaking SignalData structure 0x7b080015af40 after lost signal to thread 2176
W20260709 12:12:09.833536  2248 debug-util.cc:398] Leaking SignalData structure 0x7b08001d9a20 after lost signal to thread 2251
W20260709 12:12:09.834625  2248 debug-util.cc:398] Leaking SignalData structure 0x7b0800118740 after lost signal to thread 2325
I20260709 12:12:09.835763  2475 raft_consensus.cc:993] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4: : Instructing follower 03f117f42d154ad1a4764eb50c377a35 to start an election
I20260709 12:12:09.836196  2475 raft_consensus.cc:1081] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Signalling peer 03f117f42d154ad1a4764eb50c377a35 to start an election
I20260709 12:12:09.838922  2149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25ec792334174b458d4eee1729e73d54"
dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
 from {username='slave'} at 127.0.0.1:54576
I20260709 12:12:09.839500  2149 raft_consensus.cc:493] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:09.839921  2149 raft_consensus.cc:3060] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:09.848142  2149 raft_consensus.cc:515] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:09.850522  2149 leader_election.cc:290] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 3 election: Requested vote from peers 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:12:09.851141  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ec792334174b458d4eee1729e73d54" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:12:09.851730  2227 raft_consensus.cc:3055] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:09.851682  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ec792334174b458d4eee1729e73d54" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:12:09.852257  2227 raft_consensus.cc:740] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:12:09.852640  2299 raft_consensus.cc:3060] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:09.853472  2227 consensus_queue.cc:260] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:09.854912  2227 raft_consensus.cc:3060] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:09.857200  2299 raft_consensus.cc:2468] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 3.
I20260709 12:12:09.858196  2116 leader_election.cc:304] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:12:09.858956  2504 raft_consensus.cc:2804] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:09.859422  2504 raft_consensus.cc:697] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 3 LEADER]: Becoming Leader. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Running, Role: LEADER
I20260709 12:12:09.860328  2504 consensus_queue.cc:237] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:09.863381  2227 raft_consensus.cc:2468] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 3.
I20260709 12:12:09.869314  2048 catalog_manager.cc:5697] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 reported cstate change: term changed from 2 to 3, leader changed from 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66) to 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "03f117f42d154ad1a4764eb50c377a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:09.879184  2475 raft_consensus.cc:993] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4: : Instructing follower 03f117f42d154ad1a4764eb50c377a35 to start an election
I20260709 12:12:09.879752  2495 raft_consensus.cc:1081] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 4 LEADER]: Signalling peer 03f117f42d154ad1a4764eb50c377a35 to start an election
I20260709 12:12:09.881270  2149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7"
dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
 from {username='slave'} at 127.0.0.1:54576
I20260709 12:12:09.881800  2149 raft_consensus.cc:493] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:09.882119  2149 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:09.886978  2149 raft_consensus.cc:515] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:09.889298  2149 leader_election.cc:290] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 5 election: Requested vote from peers 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455), bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67:34013)
I20260709 12:12:09.889647  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:12:09.890009  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108b362c9f7046e6b80dbb5e26ee0ca7" candidate_uuid: "03f117f42d154ad1a4764eb50c377a35" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
I20260709 12:12:09.890287  2227 raft_consensus.cc:3055] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:09.890563  2299 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:09.890780  2227 raft_consensus.cc:740] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:12:09.891780  2227 consensus_queue.cc:260] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:09.894232  2227 raft_consensus.cc:3060] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:09.896373  2299 raft_consensus.cc:2468] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 5.
I20260709 12:12:09.897392  2116 leader_election.cc:304] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f117f42d154ad1a4764eb50c377a35, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:12:09.898134  2504 raft_consensus.cc:2804] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:09.898617  2504 raft_consensus.cc:697] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 5 LEADER]: Becoming Leader. State: Replica: 03f117f42d154ad1a4764eb50c377a35, State: Running, Role: LEADER
I20260709 12:12:09.899577  2504 consensus_queue.cc:237] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:09.901422  2227 raft_consensus.cc:2468] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f117f42d154ad1a4764eb50c377a35 in term 5.
I20260709 12:12:09.908360  2048 catalog_manager.cc:5697] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 reported cstate change: term changed from 4 to 5, leader changed from 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66) to 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65). New cstate: current_term: 5 leader_uuid: "03f117f42d154ad1a4764eb50c377a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:10.142004  2149 raft_consensus.cc:1275] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 4 FOLLOWER]: Refusing update from remote peer bd0f951bbfa84993912f6b0b555d35bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:10.143550  2465 consensus_queue.cc:1048] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:10.162310  2227 raft_consensus.cc:1275] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 4 FOLLOWER]: Refusing update from remote peer bd0f951bbfa84993912f6b0b555d35bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:10.165087  2512 consensus_queue.cc:1048] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:10.273376  2227 raft_consensus.cc:1275] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Refusing update from remote peer 03f117f42d154ad1a4764eb50c377a35: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:10.274678  2504 consensus_queue.cc:1048] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:10.279485  2226 raft_consensus.cc:1275] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 5 FOLLOWER]: Refusing update from remote peer 03f117f42d154ad1a4764eb50c377a35: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:10.282670  2504 consensus_queue.cc:1048] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:12:10.286150  2299 raft_consensus.cc:1275] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Refusing update from remote peer 03f117f42d154ad1a4764eb50c377a35: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:10.287266  2475 raft_consensus.cc:993] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4: : Instructing follower bd0f951bbfa84993912f6b0b555d35bd to start an election
I20260709 12:12:10.288123  2495 raft_consensus.cc:1081] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Signalling peer bd0f951bbfa84993912f6b0b555d35bd to start an election
I20260709 12:12:10.287840  2504 consensus_queue.cc:1048] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:10.294075  2299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54"
dest_uuid: "bd0f951bbfa84993912f6b0b555d35bd"
 from {username='slave'} at 127.0.0.1:51078
I20260709 12:12:10.297094  2299 raft_consensus.cc:493] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:10.298444  2299 raft_consensus.cc:3060] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:10.294910  2300 raft_consensus.cc:1275] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Refusing update from remote peer 03f117f42d154ad1a4764eb50c377a35: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:10.300776  2505 consensus_queue.cc:1048] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:10.317826  2299 raft_consensus.cc:515] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:10.321431  2149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "03f117f42d154ad1a4764eb50c377a35"
I20260709 12:12:10.322255  2149 raft_consensus.cc:3060] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:10.331933  2226 raft_consensus.cc:1275] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Refusing update from remote peer 03f117f42d154ad1a4764eb50c377a35: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:10.336975  2299 leader_election.cc:290] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 4 election: Requested vote from peers 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987), 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455)
I20260709 12:12:10.344266  2521 consensus_queue.cc:1048] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:10.349669  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e3a35f59e8482daa31ef06b865ad54" candidate_uuid: "bd0f951bbfa84993912f6b0b555d35bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0015a277ef40476e95fa121ca04b60a4"
I20260709 12:12:10.350453  2226 raft_consensus.cc:3055] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:10.350802  2226 raft_consensus.cc:740] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0015a277ef40476e95fa121ca04b60a4, State: Running, Role: LEADER
I20260709 12:12:10.351940  2226 consensus_queue.cc:260] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
I20260709 12:12:10.354676  2226 raft_consensus.cc:3060] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:10.361073  2298 raft_consensus.cc:1275] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 5 FOLLOWER]: Refusing update from remote peer 03f117f42d154ad1a4764eb50c377a35: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:10.363276  2505 consensus_queue.cc:1048] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:12:10.373728  2226 raft_consensus.cc:2468] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 4.
I20260709 12:12:10.363651  2149 raft_consensus.cc:2468] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd0f951bbfa84993912f6b0b555d35bd in term 4.
I20260709 12:12:10.375068  2264 leader_election.cc:304] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0015a277ef40476e95fa121ca04b60a4, bd0f951bbfa84993912f6b0b555d35bd; no voters: 
I20260709 12:12:10.376087  2465 raft_consensus.cc:2804] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:10.376673  2465 raft_consensus.cc:697] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 4 LEADER]: Becoming Leader. State: Replica: bd0f951bbfa84993912f6b0b555d35bd, State: Running, Role: LEADER
I20260709 12:12:10.377622  2465 consensus_queue.cc:237] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } }
W20260709 12:12:10.387241  2115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:43455, user_credentials={real_user=slave}} blocked reactor thread for 49089.4us
I20260709 12:12:10.402925  2048 catalog_manager.cc:5697] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd reported cstate change: term changed from 3 to 4, leader changed from 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66) to bd0f951bbfa84993912f6b0b555d35bd (127.1.248.67). New cstate: current_term: 4 leader_uuid: "bd0f951bbfa84993912f6b0b555d35bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd0f951bbfa84993912f6b0b555d35bd" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 34013 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:10.679214  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:10.687565  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:10.688177  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:10.896402  2149 raft_consensus.cc:1275] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 4 FOLLOWER]: Refusing update from remote peer bd0f951bbfa84993912f6b0b555d35bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:10.897754  2465 consensus_queue.cc:1048] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f117f42d154ad1a4764eb50c377a35" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:10.901791  2227 raft_consensus.cc:1275] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 4 FOLLOWER]: Refusing update from remote peer bd0f951bbfa84993912f6b0b555d35bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:10.903204  2465 consensus_queue.cc:1048] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0015a277ef40476e95fa121ca04b60a4" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:11.689549  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:11.699810  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:11.700314  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:12.701329  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:12.706308  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:12.706755  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:13.809701  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:13.814493  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:13.814916  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:13.901305  2248 debug-util.cc:398] Leaking SignalData structure 0x7b08001ab4a0 after lost signal to thread 2020
W20260709 12:12:13.902123  2248 debug-util.cc:398] Leaking SignalData structure 0x7b08001df120 after lost signal to thread 2083
W20260709 12:12:13.903026  2248 debug-util.cc:398] Leaking SignalData structure 0x7b080012b100 after lost signal to thread 2176
W20260709 12:12:13.903862  2248 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1bc0 after lost signal to thread 2251
W20260709 12:12:13.904539  2248 debug-util.cc:398] Leaking SignalData structure 0x7b08001dcce0 after lost signal to thread 2325
I20260709 12:12:14.816141  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:14.821339  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:14.821760  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:15.822880  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:15.829039  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:15.829526  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:16.830646  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:16.835561  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:16.835963  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:17.837024  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:17.841841  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:17.842263  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:18.843291  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:18.848942  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:18.849331  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:19.881029  2017 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:12:19.881630  2017 tablet_server.cc:179] TabletServer@127.1.248.65:0 shutting down...
W20260709 12:12:19.888118  2192 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:19.892320  2192 consensus_peers.cc:597] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 -> Peer 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987): Couldn't send request to peer 03f117f42d154ad1a4764eb50c377a35. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:19.917615  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:19.918648  2017 tablet_replica.cc:333] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35: stopping tablet replica
I20260709 12:12:19.919464  2017 raft_consensus.cc:2243] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:19.920451  2017 raft_consensus.cc:2272] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 03f117f42d154ad1a4764eb50c377a35 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:19.922834  2017 tablet_replica.cc:333] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35: stopping tablet replica
I20260709 12:12:19.923404  2017 raft_consensus.cc:2243] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:19.923913  2017 raft_consensus.cc:2272] T 73ba54154cab456eb913ddb40a164f54 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:19.925611  2017 tablet_replica.cc:333] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35: stopping tablet replica
I20260709 12:12:19.926097  2017 raft_consensus.cc:2243] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:19.926851  2017 raft_consensus.cc:2272] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:19.928653  2017 tablet_replica.cc:333] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35: stopping tablet replica
I20260709 12:12:19.929206  2017 raft_consensus.cc:2243] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:19.929994  2017 raft_consensus.cc:2272] T 25ec792334174b458d4eee1729e73d54 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:19.931864  2017 tablet_replica.cc:333] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35: stopping tablet replica
I20260709 12:12:19.932394  2017 raft_consensus.cc:2243] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:19.932806  2017 raft_consensus.cc:2272] T 594880bc88c14b6b9783dbffaea89395 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:19.934382  2017 tablet_replica.cc:333] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35: stopping tablet replica
I20260709 12:12:19.934880  2017 raft_consensus.cc:2243] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:19.935314  2017 raft_consensus.cc:2272] T 4f1b96975bc044d481d87d7b5878c724 P 03f117f42d154ad1a4764eb50c377a35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:19.937065  2017 tablet_replica.cc:333] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35: stopping tablet replica
I20260709 12:12:19.937541  2017 raft_consensus.cc:2243] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:19.937954  2017 raft_consensus.cc:2272] T e3bf9e35e5334190b45626fbeb734353 P 03f117f42d154ad1a4764eb50c377a35 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:19.939831  2017 tablet_replica.cc:333] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35: stopping tablet replica
I20260709 12:12:19.940368  2017 raft_consensus.cc:2243] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:19.940874  2017 raft_consensus.cc:2272] T ce7f2777e02e4a4da9ab5e1867f12147 P 03f117f42d154ad1a4764eb50c377a35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:19.942483  2017 tablet_replica.cc:333] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35: stopping tablet replica
I20260709 12:12:19.942938  2017 raft_consensus.cc:2243] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:19.943370  2017 raft_consensus.cc:2272] T 53e3a35f59e8482daa31ef06b865ad54 P 03f117f42d154ad1a4764eb50c377a35 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:19.957448  2266 consensus_peers.cc:597] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd -> Peer 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987): Couldn't send request to peer 03f117f42d154ad1a4764eb50c377a35. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:20.044577  2017 tablet_server.cc:196] TabletServer@127.1.248.65:0 shutdown complete.
I20260709 12:12:20.067920  2017 tablet_server.cc:179] TabletServer@127.1.248.66:0 shutting down...
I20260709 12:12:20.097451  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:20.098220  2017 tablet_replica.cc:333] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4: stopping tablet replica
I20260709 12:12:20.099001  2017 raft_consensus.cc:2243] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:20.099685  2017 raft_consensus.cc:2272] T 108b362c9f7046e6b80dbb5e26ee0ca7 P 0015a277ef40476e95fa121ca04b60a4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.101737  2017 tablet_replica.cc:333] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4: stopping tablet replica
I20260709 12:12:20.102257  2017 raft_consensus.cc:2243] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:20.102670  2017 raft_consensus.cc:2272] T 3bdb6c5047f14ebe8d6758ce69a6a110 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.104755  2017 tablet_replica.cc:333] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4: stopping tablet replica
I20260709 12:12:20.105386  2017 raft_consensus.cc:2243] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:20.105811  2017 raft_consensus.cc:2272] T e3bf9e35e5334190b45626fbeb734353 P 0015a277ef40476e95fa121ca04b60a4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.107688  2017 tablet_replica.cc:333] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4: stopping tablet replica
I20260709 12:12:20.108179  2017 raft_consensus.cc:2243] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:20.108940  2017 raft_consensus.cc:2272] T 4f1b96975bc044d481d87d7b5878c724 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.110766  2017 tablet_replica.cc:333] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4: stopping tablet replica
I20260709 12:12:20.111532  2017 raft_consensus.cc:2243] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:20.112012  2017 raft_consensus.cc:2272] T 25ec792334174b458d4eee1729e73d54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.113688  2017 tablet_replica.cc:333] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4: stopping tablet replica
I20260709 12:12:20.114168  2017 raft_consensus.cc:2243] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:20.114926  2017 raft_consensus.cc:2272] T 594880bc88c14b6b9783dbffaea89395 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.116798  2017 tablet_replica.cc:333] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4: stopping tablet replica
I20260709 12:12:20.117259  2017 raft_consensus.cc:2243] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:20.117977  2017 raft_consensus.cc:2272] T 73ba54154cab456eb913ddb40a164f54 P 0015a277ef40476e95fa121ca04b60a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.119779  2017 tablet_replica.cc:333] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4: stopping tablet replica
I20260709 12:12:20.120225  2017 raft_consensus.cc:2243] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:20.120664  2017 raft_consensus.cc:2272] T ce7f2777e02e4a4da9ab5e1867f12147 P 0015a277ef40476e95fa121ca04b60a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.122756  2017 tablet_replica.cc:333] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4: stopping tablet replica
I20260709 12:12:20.123165  2017 raft_consensus.cc:2243] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:20.123611  2017 raft_consensus.cc:2272] T 53e3a35f59e8482daa31ef06b865ad54 P 0015a277ef40476e95fa121ca04b60a4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.177341  2017 tablet_server.cc:196] TabletServer@127.1.248.66:0 shutdown complete.
I20260709 12:12:20.197571  2017 tablet_server.cc:179] TabletServer@127.1.248.67:0 shutting down...
W20260709 12:12:20.214038  2264 consensus_peers.cc:597] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd -> Peer 0015a277ef40476e95fa121ca04b60a4 (127.1.248.66:43455): Couldn't send request to peer 0015a277ef40476e95fa121ca04b60a4. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:43455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:20.229884  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:20.230566  2017 tablet_replica.cc:333] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd: stopping tablet replica
I20260709 12:12:20.231194  2017 raft_consensus.cc:2243] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:20.231750  2017 raft_consensus.cc:2272] T 108b362c9f7046e6b80dbb5e26ee0ca7 P bd0f951bbfa84993912f6b0b555d35bd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.233624  2017 tablet_replica.cc:333] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd: stopping tablet replica
I20260709 12:12:20.234103  2017 raft_consensus.cc:2243] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:20.234520  2017 raft_consensus.cc:2272] T 25ec792334174b458d4eee1729e73d54 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.236259  2017 tablet_replica.cc:333] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd: stopping tablet replica
I20260709 12:12:20.236733  2017 raft_consensus.cc:2243] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:20.237164  2017 raft_consensus.cc:2272] T 594880bc88c14b6b9783dbffaea89395 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.238768  2017 tablet_replica.cc:333] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd: stopping tablet replica
I20260709 12:12:20.239238  2017 raft_consensus.cc:2243] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:20.239722  2017 raft_consensus.cc:2272] T 3bdb6c5047f14ebe8d6758ce69a6a110 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.241739  2017 tablet_replica.cc:333] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd: stopping tablet replica
I20260709 12:12:20.242313  2017 raft_consensus.cc:2243] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:20.243029  2017 raft_consensus.cc:2272] T e3bf9e35e5334190b45626fbeb734353 P bd0f951bbfa84993912f6b0b555d35bd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.245025  2017 tablet_replica.cc:333] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd: stopping tablet replica
I20260709 12:12:20.245771  2017 raft_consensus.cc:2243] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:20.246222  2017 raft_consensus.cc:2272] T 4f1b96975bc044d481d87d7b5878c724 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:20.246258  2266 consensus_peers.cc:597] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd -> Peer 03f117f42d154ad1a4764eb50c377a35 (127.1.248.65:34987): Couldn't send request to peer 03f117f42d154ad1a4764eb50c377a35. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:20.248121  2017 tablet_replica.cc:333] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd: stopping tablet replica
I20260709 12:12:20.248612  2017 raft_consensus.cc:2243] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:20.249809  2017 raft_consensus.cc:2272] T ce7f2777e02e4a4da9ab5e1867f12147 P bd0f951bbfa84993912f6b0b555d35bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.251466  2017 tablet_replica.cc:333] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd: stopping tablet replica
I20260709 12:12:20.251977  2017 raft_consensus.cc:2243] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:20.252658  2017 raft_consensus.cc:2272] T 53e3a35f59e8482daa31ef06b865ad54 P bd0f951bbfa84993912f6b0b555d35bd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.254249  2017 tablet_replica.cc:333] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd: stopping tablet replica
I20260709 12:12:20.254686  2017 raft_consensus.cc:2243] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:20.255162  2017 raft_consensus.cc:2272] T 73ba54154cab456eb913ddb40a164f54 P bd0f951bbfa84993912f6b0b555d35bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.286551  2017 tablet_server.cc:196] TabletServer@127.1.248.67:0 shutdown complete.
I20260709 12:12:20.306645  2017 master.cc:562] Master@127.1.248.126:46437 shutting down...
I20260709 12:12:20.518375  2017 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:20.519093  2017 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:20.519510  2017 tablet_replica.cc:333] T 00000000000000000000000000000000 P fdc82fec187b4e12bdd1b12d2f5811f7: stopping tablet replica
I20260709 12:12:20.539903  2017 master.cc:584] Master@127.1.248.126:46437 shutdown complete.
0015a277ef40476e95fa121ca04b60a4  4
03f117f42d154ad1a4764eb50c377a35  4
bd0f951bbfa84993912f6b0b555d35bd  1
0015a277ef40476e95fa121ca04b60a4  3
03f117f42d154ad1a4764eb50c377a35  3
bd0f951bbfa84993912f6b0b555d35bd  3
0015a277ef40476e95fa121ca04b60a4  8
03f117f42d154ad1a4764eb50c377a35  0
bd0f951bbfa84993912f6b0b555d35bd  1
0015a277ef40476e95fa121ca04b60a4  3
03f117f42d154ad1a4764eb50c377a35  3
bd0f951bbfa84993912f6b0b555d35bd  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31738 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:12:20.581362  2017 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.248.126:36437
I20260709 12:12:20.582567  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:20.588155  2541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:20.588719  2542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:20.589912  2544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:20.590853  2017 server_base.cc:1061] running on GCE node
I20260709 12:12:20.592160  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:20.592336  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:20.592453  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599140592441 us; error 0 us; skew 500 ppm
I20260709 12:12:20.592926  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:20.595286  2017 webserver.cc:533] Webserver started at http://127.1.248.126:43633/ using document root <none> and password file <none>
I20260709 12:12:20.595767  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:20.595919  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:20.596133  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:20.597203  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/master-0-root/instance:
uuid: "5e5f9e83ab294aa4843dfb1dfd0f26d7"
format_stamp: "Formatted at 2026-07-09 12:12:20 on dist-test-slave-z9f9"
I20260709 12:12:20.601532  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 12:12:20.605058  2549 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:20.605899  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:12:20.606182  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/master-0-root
uuid: "5e5f9e83ab294aa4843dfb1dfd0f26d7"
format_stamp: "Formatted at 2026-07-09 12:12:20 on dist-test-slave-z9f9"
I20260709 12:12:20.606447  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:20.627044  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:20.628454  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:20.669452  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.126:36437
I20260709 12:12:20.669564  2600 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.126:36437 every 8 connection(s)
I20260709 12:12:20.673487  2601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:20.683977  2601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7: Bootstrap starting.
I20260709 12:12:20.689081  2601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:20.693714  2601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7: No bootstrap required, opened a new log
I20260709 12:12:20.696166  2601 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e5f9e83ab294aa4843dfb1dfd0f26d7" member_type: VOTER }
I20260709 12:12:20.696657  2601 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.696941  2601 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e5f9e83ab294aa4843dfb1dfd0f26d7, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.697644  2601 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e5f9e83ab294aa4843dfb1dfd0f26d7" member_type: VOTER }
I20260709 12:12:20.698158  2601 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:20.698405  2601 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:20.698700  2601 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.703078  2601 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e5f9e83ab294aa4843dfb1dfd0f26d7" member_type: VOTER }
I20260709 12:12:20.703701  2601 leader_election.cc:304] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e5f9e83ab294aa4843dfb1dfd0f26d7; no voters: 
I20260709 12:12:20.705199  2601 leader_election.cc:290] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:20.705602  2604 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:20.707125  2604 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [term 1 LEADER]: Becoming Leader. State: Replica: 5e5f9e83ab294aa4843dfb1dfd0f26d7, State: Running, Role: LEADER
I20260709 12:12:20.707857  2604 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e5f9e83ab294aa4843dfb1dfd0f26d7" member_type: VOTER }
I20260709 12:12:20.708958  2601 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:20.713838  2605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e5f9e83ab294aa4843dfb1dfd0f26d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e5f9e83ab294aa4843dfb1dfd0f26d7" member_type: VOTER } }
I20260709 12:12:20.713675  2606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e5f9e83ab294aa4843dfb1dfd0f26d7. Latest consensus state: current_term: 1 leader_uuid: "5e5f9e83ab294aa4843dfb1dfd0f26d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e5f9e83ab294aa4843dfb1dfd0f26d7" member_type: VOTER } }
I20260709 12:12:20.714406  2605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:20.714617  2606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:20.716900  2610 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:20.725936  2610 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:20.726956  2017 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:20.735193  2610 catalog_manager.cc:1383] Generated new cluster ID: 40136e2c9a044f299eb22aeace2164fb
I20260709 12:12:20.735481  2610 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:20.755385  2610 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:20.756722  2610 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:20.773881  2610 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7: Generated new TSK 0
I20260709 12:12:20.774559  2610 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:20.793227  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:20.800818  2622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:20.803098  2623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:20.806010  2625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:20.806505  2017 server_base.cc:1061] running on GCE node
I20260709 12:12:20.807392  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:20.807667  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:20.807876  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599140807856 us; error 0 us; skew 500 ppm
I20260709 12:12:20.808533  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:20.810870  2017 webserver.cc:533] Webserver started at http://127.1.248.65:44399/ using document root <none> and password file <none>
I20260709 12:12:20.811360  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:20.811599  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:20.811889  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:20.812956  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-0-root/instance:
uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
format_stamp: "Formatted at 2026-07-09 12:12:20 on dist-test-slave-z9f9"
I20260709 12:12:20.817323  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:20.820766  2630 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:20.821676  2017 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:12:20.821933  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-0-root
uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
format_stamp: "Formatted at 2026-07-09 12:12:20 on dist-test-slave-z9f9"
I20260709 12:12:20.822187  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:20.850178  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:20.851401  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:20.853037  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:20.855320  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:20.855523  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:20.855808  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:20.855966  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:20.896098  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.65:33143
I20260709 12:12:20.896198  2692 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.65:33143 every 8 connection(s)
I20260709 12:12:20.901051  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:20.908643  2697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:20.909696  2698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:20.912549  2700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:20.914994  2017 server_base.cc:1061] running on GCE node
I20260709 12:12:20.915241  2693 heartbeater.cc:344] Connected to a master server at 127.1.248.126:36437
I20260709 12:12:20.915714  2693 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:20.916522  2693 heartbeater.cc:507] Master 127.1.248.126:36437 requested a full tablet report, sending...
I20260709 12:12:20.916661  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:20.916944  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:20.917112  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599140917086 us; error 0 us; skew 500 ppm
I20260709 12:12:20.917675  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:20.919106  2566 ts_manager.cc:194] Registered new tserver with Master: 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143)
I20260709 12:12:20.920692  2017 webserver.cc:533] Webserver started at http://127.1.248.66:35063/ using document root <none> and password file <none>
I20260709 12:12:20.921317  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:20.921556  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:20.921613  2566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43018
I20260709 12:12:20.921952  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:20.923321  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-1-root/instance:
uuid: "5493f6a9c443455284b04b39cc617dd7"
format_stamp: "Formatted at 2026-07-09 12:12:20 on dist-test-slave-z9f9"
I20260709 12:12:20.927743  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:12:20.931079  2705 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:20.932006  2017 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:12:20.932298  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-1-root
uuid: "5493f6a9c443455284b04b39cc617dd7"
format_stamp: "Formatted at 2026-07-09 12:12:20 on dist-test-slave-z9f9"
I20260709 12:12:20.932588  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:20.949144  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:20.950357  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:20.951869  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:20.954073  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:20.954296  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:20.954530  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:20.954694  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:20.993697  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.66:35639
I20260709 12:12:20.993826  2767 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.66:35639 every 8 connection(s)
I20260709 12:12:20.998446  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:21.006618  2771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:21.007921  2772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:21.011795  2768 heartbeater.cc:344] Connected to a master server at 127.1.248.126:36437
W20260709 12:12:21.011677  2774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:21.012209  2017 server_base.cc:1061] running on GCE node
I20260709 12:12:21.012279  2768 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:21.013290  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:12:21.013314  2768 heartbeater.cc:507] Master 127.1.248.126:36437 requested a full tablet report, sending...
W20260709 12:12:21.013661  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:21.013875  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599141013854 us; error 0 us; skew 500 ppm
I20260709 12:12:21.014524  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:21.015781  2566 ts_manager.cc:194] Registered new tserver with Master: 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:21.017367  2566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43034
I20260709 12:12:21.017588  2017 webserver.cc:533] Webserver started at http://127.1.248.67:38607/ using document root <none> and password file <none>
I20260709 12:12:21.018178  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:21.018447  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:21.018777  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:21.020267  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-2-root/instance:
uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
format_stamp: "Formatted at 2026-07-09 12:12:21 on dist-test-slave-z9f9"
I20260709 12:12:21.025228  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:21.028734  2779 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:21.029568  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:21.029875  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-2-root
uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
format_stamp: "Formatted at 2026-07-09 12:12:21 on dist-test-slave-z9f9"
I20260709 12:12:21.030124  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599108657414-2017-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:21.067647  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:21.068974  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:21.070603  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:21.073009  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:21.073217  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:21.073525  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:21.073705  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:21.115190  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.67:43083
I20260709 12:12:21.115284  2841 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.67:43083 every 8 connection(s)
I20260709 12:12:21.129598  2842 heartbeater.cc:344] Connected to a master server at 127.1.248.126:36437
I20260709 12:12:21.129993  2842 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:21.130710  2842 heartbeater.cc:507] Master 127.1.248.126:36437 requested a full tablet report, sending...
I20260709 12:12:21.132895  2566 ts_manager.cc:194] Registered new tserver with Master: b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:21.133301  2017 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014646473s
I20260709 12:12:21.134315  2566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43048
I20260709 12:12:21.159829  2566 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43054:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:21.162755  2566 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:21.244626  2733 tablet_service.cc:1511] Processing CreateTablet for tablet 566b99119aa94c7bb444d163f417b831 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:21.245580  2658 tablet_service.cc:1511] Processing CreateTablet for tablet 566b99119aa94c7bb444d163f417b831 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:21.246140  2733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566b99119aa94c7bb444d163f417b831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.246892  2658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566b99119aa94c7bb444d163f417b831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.248659  2657 tablet_service.cc:1511] Processing CreateTablet for tablet eb9b3f46e2cd49679ad709634ac77a41 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:21.250053  2657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9b3f46e2cd49679ad709634ac77a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.249986  2731 tablet_service.cc:1511] Processing CreateTablet for tablet e9bcc63c80664ecf99de6fc5a115d80d (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:21.251824  2653 tablet_service.cc:1511] Processing CreateTablet for tablet 3765c69b4297441fbd0304c3dfdf6635 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:21.252264  2652 tablet_service.cc:1511] Processing CreateTablet for tablet 96bc1a24f8444cfb814aa8c10ef01dab (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:21.253244  2653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3765c69b4297441fbd0304c3dfdf6635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.255012  2651 tablet_service.cc:1511] Processing CreateTablet for tablet 60d3336ce82a4b1aa8eb217aaa4c7176 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:21.256489  2651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d3336ce82a4b1aa8eb217aaa4c7176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.256616  2654 tablet_service.cc:1511] Processing CreateTablet for tablet 32a793bd6df44220aaed160471a0198f (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:21.258445  2655 tablet_service.cc:1511] Processing CreateTablet for tablet 5005068313154497a22c8761927949e5 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:21.259732  2655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5005068313154497a22c8761927949e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.262048  2650 tablet_service.cc:1511] Processing CreateTablet for tablet 99e249a3c8c146fb86d0b1048e967844 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:21.263471  2650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e249a3c8c146fb86d0b1048e967844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.264622  2656 tablet_service.cc:1511] Processing CreateTablet for tablet e9bcc63c80664ecf99de6fc5a115d80d (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:21.265924  2656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9bcc63c80664ecf99de6fc5a115d80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.267807  2652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bc1a24f8444cfb814aa8c10ef01dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.265947  2649 tablet_service.cc:1511] Processing CreateTablet for tablet c6d906bc94b54bfda3a742a515c05699 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:21.268980  2654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a793bd6df44220aaed160471a0198f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.248562  2732 tablet_service.cc:1511] Processing CreateTablet for tablet eb9b3f46e2cd49679ad709634ac77a41 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:21.270643  2731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9bcc63c80664ecf99de6fc5a115d80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.271251  2730 tablet_service.cc:1511] Processing CreateTablet for tablet 5005068313154497a22c8761927949e5 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:21.272753  2730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5005068313154497a22c8761927949e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.272891  2649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d906bc94b54bfda3a742a515c05699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.272899  2729 tablet_service.cc:1511] Processing CreateTablet for tablet 32a793bd6df44220aaed160471a0198f (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:21.274385  2728 tablet_service.cc:1511] Processing CreateTablet for tablet 3765c69b4297441fbd0304c3dfdf6635 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:21.275962  2729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a793bd6df44220aaed160471a0198f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.276778  2732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9b3f46e2cd49679ad709634ac77a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.285022  2727 tablet_service.cc:1511] Processing CreateTablet for tablet 96bc1a24f8444cfb814aa8c10ef01dab (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:21.288223  2726 tablet_service.cc:1511] Processing CreateTablet for tablet 60d3336ce82a4b1aa8eb217aaa4c7176 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:21.283733  2728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3765c69b4297441fbd0304c3dfdf6635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.293005  2724 tablet_service.cc:1511] Processing CreateTablet for tablet c6d906bc94b54bfda3a742a515c05699 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:21.293675  2725 tablet_service.cc:1511] Processing CreateTablet for tablet 99e249a3c8c146fb86d0b1048e967844 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:21.295085  2725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e249a3c8c146fb86d0b1048e967844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.298151  2806 tablet_service.cc:1511] Processing CreateTablet for tablet eb9b3f46e2cd49679ad709634ac77a41 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:21.298605  2801 tablet_service.cc:1511] Processing CreateTablet for tablet 96bc1a24f8444cfb814aa8c10ef01dab (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:21.299901  2806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9b3f46e2cd49679ad709634ac77a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.302076  2802 tablet_service.cc:1511] Processing CreateTablet for tablet 3765c69b4297441fbd0304c3dfdf6635 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:21.309510  2807 tablet_service.cc:1511] Processing CreateTablet for tablet 566b99119aa94c7bb444d163f417b831 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:21.309827  2803 tablet_service.cc:1511] Processing CreateTablet for tablet 32a793bd6df44220aaed160471a0198f (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:21.308140  2802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3765c69b4297441fbd0304c3dfdf6635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.313097  2805 tablet_service.cc:1511] Processing CreateTablet for tablet e9bcc63c80664ecf99de6fc5a115d80d (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:21.314867  2804 tablet_service.cc:1511] Processing CreateTablet for tablet 5005068313154497a22c8761927949e5 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:21.311342  2803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a793bd6df44220aaed160471a0198f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.322571  2805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9bcc63c80664ecf99de6fc5a115d80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.323580  2804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5005068313154497a22c8761927949e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.327591  2800 tablet_service.cc:1511] Processing CreateTablet for tablet 60d3336ce82a4b1aa8eb217aaa4c7176 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:21.325380  2724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d906bc94b54bfda3a742a515c05699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.330669  2799 tablet_service.cc:1511] Processing CreateTablet for tablet 99e249a3c8c146fb86d0b1048e967844 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:21.334610  2727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bc1a24f8444cfb814aa8c10ef01dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.335752  2726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d3336ce82a4b1aa8eb217aaa4c7176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.325399  2807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566b99119aa94c7bb444d163f417b831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.340907  2798 tablet_service.cc:1511] Processing CreateTablet for tablet c6d906bc94b54bfda3a742a515c05699 (DEFAULT_TABLE table=test-workload [id=9caef320f0434168acfe3813c675b3f7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:21.342914  2800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d3336ce82a4b1aa8eb217aaa4c7176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.344587  2799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e249a3c8c146fb86d0b1048e967844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.346140  2798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d906bc94b54bfda3a742a515c05699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.368237  2857 tablet_bootstrap.cc:492] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8: Bootstrap starting.
I20260709 12:12:21.368856  2801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bc1a24f8444cfb814aa8c10ef01dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.428242  2859 tablet_bootstrap.cc:492] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7: Bootstrap starting.
I20260709 12:12:21.436256  2858 tablet_bootstrap.cc:492] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36: Bootstrap starting.
I20260709 12:12:21.458967  2857 tablet_bootstrap.cc:654] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.468895  2859 tablet_bootstrap.cc:654] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.477305  2857 tablet_bootstrap.cc:492] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8: No bootstrap required, opened a new log
I20260709 12:12:21.477888  2857 ts_tablet_manager.cc:1403] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent bootstrapping tablet: real 0.110s	user 0.009s	sys 0.011s
I20260709 12:12:21.480679  2857 raft_consensus.cc:359] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.481515  2857 raft_consensus.cc:385] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.481994  2858 tablet_bootstrap.cc:654] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.481943  2857 raft_consensus.cc:740] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.483135  2857 consensus_queue.cc:260] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.485816  2693 heartbeater.cc:499] Master 127.1.248.126:36437 was elected leader, sending a full tablet report...
I20260709 12:12:21.486372  2859 tablet_bootstrap.cc:492] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7: No bootstrap required, opened a new log
I20260709 12:12:21.486850  2857 ts_tablet_manager.cc:1434] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:12:21.488296  2857 tablet_bootstrap.cc:492] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8: Bootstrap starting.
I20260709 12:12:21.486917  2859 ts_tablet_manager.cc:1403] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.010s
I20260709 12:12:21.490187  2858 tablet_bootstrap.cc:492] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36: No bootstrap required, opened a new log
I20260709 12:12:21.490747  2858 ts_tablet_manager.cc:1403] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.011s
I20260709 12:12:21.491814  2859 raft_consensus.cc:359] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.492641  2859 raft_consensus.cc:385] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.492986  2859 raft_consensus.cc:740] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.493806  2859 consensus_queue.cc:260] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.494071  2858 raft_consensus.cc:359] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.494704  2857 tablet_bootstrap.cc:654] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.494993  2858 raft_consensus.cc:385] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.495364  2858 raft_consensus.cc:740] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.496372  2858 consensus_queue.cc:260] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.525205  2858 ts_tablet_manager.cc:1434] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.028s
I20260709 12:12:21.526238  2842 heartbeater.cc:499] Master 127.1.248.126:36437 was elected leader, sending a full tablet report...
I20260709 12:12:21.526626  2859 ts_tablet_manager.cc:1434] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.027s
I20260709 12:12:21.526829  2857 tablet_bootstrap.cc:492] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8: No bootstrap required, opened a new log
I20260709 12:12:21.527637  2859 tablet_bootstrap.cc:492] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7: Bootstrap starting.
I20260709 12:12:21.527415  2768 heartbeater.cc:499] Master 127.1.248.126:36437 was elected leader, sending a full tablet report...
I20260709 12:12:21.528156  2857 ts_tablet_manager.cc:1403] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.027s
I20260709 12:12:21.530764  2858 tablet_bootstrap.cc:492] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36: Bootstrap starting.
I20260709 12:12:21.530498  2857 raft_consensus.cc:359] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.531212  2857 raft_consensus.cc:385] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.531538  2857 raft_consensus.cc:740] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.536266  2857 consensus_queue.cc:260] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.538371  2858 tablet_bootstrap.cc:654] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.538371  2859 tablet_bootstrap.cc:654] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.540174  2857 ts_tablet_manager.cc:1434] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:12:21.541182  2857 tablet_bootstrap.cc:492] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8: Bootstrap starting.
I20260709 12:12:21.548869  2857 tablet_bootstrap.cc:654] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.561273  2857 tablet_bootstrap.cc:492] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8: No bootstrap required, opened a new log
I20260709 12:12:21.561870  2857 ts_tablet_manager.cc:1403] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.010s
I20260709 12:12:21.564770  2857 raft_consensus.cc:359] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.565492  2857 raft_consensus.cc:385] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.565804  2857 raft_consensus.cc:740] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.566687  2857 consensus_queue.cc:260] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.569434  2857 ts_tablet_manager.cc:1434] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:21.570417  2857 tablet_bootstrap.cc:492] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8: Bootstrap starting.
I20260709 12:12:21.578064  2857 tablet_bootstrap.cc:654] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.592242  2859 tablet_bootstrap.cc:492] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7: No bootstrap required, opened a new log
I20260709 12:12:21.593560  2859 ts_tablet_manager.cc:1403] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.035s
I20260709 12:12:21.594806  2858 tablet_bootstrap.cc:492] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36: No bootstrap required, opened a new log
I20260709 12:12:21.595350  2858 ts_tablet_manager.cc:1403] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent bootstrapping tablet: real 0.065s	user 0.023s	sys 0.031s
I20260709 12:12:21.596889  2857 tablet_bootstrap.cc:492] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8: No bootstrap required, opened a new log
I20260709 12:12:21.596801  2859 raft_consensus.cc:359] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.597419  2857 ts_tablet_manager.cc:1403] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.002s
I20260709 12:12:21.597636  2859 raft_consensus.cc:385] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.598007  2859 raft_consensus.cc:740] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.598243  2858 raft_consensus.cc:359] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.598951  2858 raft_consensus.cc:385] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.598760  2859 consensus_queue.cc:260] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.599254  2858 raft_consensus.cc:740] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.600111  2857 raft_consensus.cc:359] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.600159  2858 consensus_queue.cc:260] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.600941  2857 raft_consensus.cc:385] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.601159  2859 ts_tablet_manager.cc:1434] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:12:21.601294  2857 raft_consensus.cc:740] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.602355  2859 tablet_bootstrap.cc:492] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7: Bootstrap starting.
I20260709 12:12:21.602491  2858 ts_tablet_manager.cc:1434] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:12:21.602100  2857 consensus_queue.cc:260] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.604966  2857 ts_tablet_manager.cc:1434] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:21.606102  2858 tablet_bootstrap.cc:492] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36: Bootstrap starting.
I20260709 12:12:21.606462  2857 tablet_bootstrap.cc:492] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8: Bootstrap starting.
I20260709 12:12:21.610105  2859 tablet_bootstrap.cc:654] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.613767  2857 tablet_bootstrap.cc:654] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.614141  2858 tablet_bootstrap.cc:654] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.623268  2862 raft_consensus.cc:493] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.623834  2862 raft_consensus.cc:515] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.624513  2859 tablet_bootstrap.cc:492] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7: No bootstrap required, opened a new log
I20260709 12:12:21.625253  2859 ts_tablet_manager.cc:1403] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.002s
I20260709 12:12:21.628394  2859 raft_consensus.cc:359] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.629159  2859 raft_consensus.cc:385] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.629465  2859 raft_consensus.cc:740] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.630332  2859 consensus_queue.cc:260] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.632738  2859 ts_tablet_manager.cc:1434] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:21.632889  2862 leader_election.cc:290] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:21.633833  2859 tablet_bootstrap.cc:492] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7: Bootstrap starting.
I20260709 12:12:21.640975  2858 tablet_bootstrap.cc:492] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36: No bootstrap required, opened a new log
I20260709 12:12:21.641521  2858 ts_tablet_manager.cc:1403] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.006s
I20260709 12:12:21.644652  2858 raft_consensus.cc:359] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.645416  2858 raft_consensus.cc:385] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.645720  2858 raft_consensus.cc:740] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.645982  2859 tablet_bootstrap.cc:654] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.645916  2864 raft_consensus.cc:493] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.646770  2864 raft_consensus.cc:515] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.654143  2858 consensus_queue.cc:260] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.657648  2858 ts_tablet_manager.cc:1434] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 12:12:21.666987  2864 leader_election.cc:290] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:21.659277  2858 tablet_bootstrap.cc:492] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36: Bootstrap starting.
I20260709 12:12:21.680929  2859 tablet_bootstrap.cc:492] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7: No bootstrap required, opened a new log
I20260709 12:12:21.681555  2859 ts_tablet_manager.cc:1403] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.019s
I20260709 12:12:21.686194  2859 raft_consensus.cc:359] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.687084  2859 raft_consensus.cc:385] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.687420  2859 raft_consensus.cc:740] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.688359  2859 consensus_queue.cc:260] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.691212  2859 ts_tablet_manager.cc:1434] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 12:12:21.692741  2859 tablet_bootstrap.cc:492] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7: Bootstrap starting.
I20260709 12:12:21.700611  2859 tablet_bootstrap.cc:654] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.701663  2858 tablet_bootstrap.cc:654] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:21.721588  2614 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:21.733433  2864 raft_consensus.cc:493] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.734411  2864 raft_consensus.cc:515] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.737481  2858 tablet_bootstrap.cc:492] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36: No bootstrap required, opened a new log
I20260709 12:12:21.737573  2817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5005068313154497a22c8761927949e5" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" is_pre_election: true
I20260709 12:12:21.738374  2858 ts_tablet_manager.cc:1403] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.000s
I20260709 12:12:21.739190  2864 leader_election.cc:290] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:21.742281  2859 tablet_bootstrap.cc:492] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7: No bootstrap required, opened a new log
I20260709 12:12:21.742115  2866 raft_consensus.cc:493] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.742826  2859 ts_tablet_manager.cc:1403] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7: Time spent bootstrapping tablet: real 0.050s	user 0.024s	sys 0.015s
I20260709 12:12:21.743036  2866 raft_consensus.cc:515] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.743170  2858 raft_consensus.cc:359] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.744411  2858 raft_consensus.cc:385] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.744995  2858 raft_consensus.cc:740] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.746299  2858 consensus_queue.cc:260] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
W20260709 12:12:21.748322  2769 tablet.cc:2406] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:21.747406  2859 raft_consensus.cc:359] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.752063  2859 raft_consensus.cc:385] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.752475  2859 raft_consensus.cc:740] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.753712  2859 consensus_queue.cc:260] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.755755  2866 leader_election.cc:290] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:21.757053  2859 ts_tablet_manager.cc:1434] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:12:21.758980  2859 tablet_bootstrap.cc:492] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7: Bootstrap starting.
I20260709 12:12:21.768373  2859 tablet_bootstrap.cc:654] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.783089  2859 tablet_bootstrap.cc:492] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7: No bootstrap required, opened a new log
I20260709 12:12:21.783277  2743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5005068313154497a22c8761927949e5" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7" is_pre_election: true
I20260709 12:12:21.783893  2859 ts_tablet_manager.cc:1403] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 12:12:21.784269  2743 raft_consensus.cc:2468] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 0.
W20260709 12:12:21.783278  2634 leader_election.cc:343] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:21.786356  2634 leader_election.cc:304] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8; no voters: b30070db2c8d4c46a2aacc39bc51ab36
I20260709 12:12:21.787348  2862 raft_consensus.cc:2804] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:21.787823  2862 raft_consensus.cc:493] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.788192  2862 raft_consensus.cc:3060] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.788070  2859 raft_consensus.cc:359] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.789256  2859 raft_consensus.cc:385] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.789685  2859 raft_consensus.cc:740] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.790660  2859 consensus_queue.cc:260] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.793977  2859 ts_tablet_manager.cc:1434] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:12:21.794097  2866 raft_consensus.cc:493] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.794922  2866 raft_consensus.cc:515] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.795382  2859 tablet_bootstrap.cc:492] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7: Bootstrap starting.
I20260709 12:12:21.795852  2862 raft_consensus.cc:515] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.797324  2866 leader_election.cc:290] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:21.797796  2862 leader_election.cc:290] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 election: Requested vote from peers 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:21.798403  2862 raft_consensus.cc:493] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.801179  2743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5005068313154497a22c8761927949e5" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:21.801836  2743 raft_consensus.cc:3060] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.804809  2859 tablet_bootstrap.cc:654] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.798945  2862 raft_consensus.cc:515] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.807710  2862 leader_election.cc:290] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:21.810050  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7" is_pre_election: true
I20260709 12:12:21.812175  2743 raft_consensus.cc:2468] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 1.
W20260709 12:12:21.812685  2634 leader_election.cc:343] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:21.814291  2817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5005068313154497a22c8761927949e5" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:21.816689  2864 raft_consensus.cc:493] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.834522  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d906bc94b54bfda3a742a515c05699" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" is_pre_election: true
I20260709 12:12:21.834972  2864 raft_consensus.cc:515] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.835341  2668 raft_consensus.cc:2468] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 0.
I20260709 12:12:21.837426  2864 leader_election.cc:290] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:21.819720  2859 tablet_bootstrap.cc:492] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7: No bootstrap required, opened a new log
I20260709 12:12:21.838191  2859 ts_tablet_manager.cc:1403] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.014s
I20260709 12:12:21.832548  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" is_pre_election: true
I20260709 12:12:21.839063  2858 ts_tablet_manager.cc:1434] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent starting tablet: real 0.100s	user 0.033s	sys 0.045s
I20260709 12:12:21.839495  2706 leader_election.cc:304] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8; no voters: 
I20260709 12:12:21.840147  2858 tablet_bootstrap.cc:492] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36: Bootstrap starting.
I20260709 12:12:21.840435  2634 leader_election.cc:304] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8; no voters: 
I20260709 12:12:21.841588  2887 raft_consensus.cc:2804] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:21.841687  2667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5005068313154497a22c8761927949e5" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" is_pre_election: true
I20260709 12:12:21.842384  2887 raft_consensus.cc:697] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 LEADER]: Becoming Leader. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:21.842763  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bcc63c80664ecf99de6fc5a115d80d" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" is_pre_election: true
I20260709 12:12:21.843391  2887 consensus_queue.cc:237] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.846318  2857 tablet_bootstrap.cc:492] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8: No bootstrap required, opened a new log
I20260709 12:12:21.846877  2857 ts_tablet_manager.cc:1403] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent bootstrapping tablet: real 0.241s	user 0.091s	sys 0.103s
I20260709 12:12:21.847508  2858 tablet_bootstrap.cc:654] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:21.843616  2634 leader_election.cc:343] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:21.844482  2864 raft_consensus.cc:2804] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:21.850384  2634 leader_election.cc:343] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:21.850440  2864 raft_consensus.cc:493] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.851127  2864 raft_consensus.cc:3060] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.851080  2634 leader_election.cc:304] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82fd5d4063fd4870b05dfbf9a1407de8; no voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36
I20260709 12:12:21.851473  2882 raft_consensus.cc:493] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.852015  2862 raft_consensus.cc:2749] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:21.844323  2706 leader_election.cc:343] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:21.851972  2882 raft_consensus.cc:515] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.842407  2859 raft_consensus.cc:359] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.853518  2859 raft_consensus.cc:385] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.853837  2859 raft_consensus.cc:740] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.854852  2882 leader_election.cc:290] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:21.854764  2859 consensus_queue.cc:260] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.849988  2857 raft_consensus.cc:359] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.859236  2857 raft_consensus.cc:385] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.859575  2857 raft_consensus.cc:740] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.860299  2857 consensus_queue.cc:260] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.862861  2743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9b3f46e2cd49679ad709634ac77a41" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7" is_pre_election: true
I20260709 12:12:21.863507  2743 raft_consensus.cc:2468] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 0.
I20260709 12:12:21.864346  2864 raft_consensus.cc:515] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.865310  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d906bc94b54bfda3a742a515c05699" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7" is_pre_election: true
I20260709 12:12:21.866506  2783 leader_election.cc:304] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:21.866973  2857 ts_tablet_manager.cc:1434] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:12:21.867439  2882 raft_consensus.cc:2804] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:21.867971  2857 tablet_bootstrap.cc:492] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8: Bootstrap starting.
I20260709 12:12:21.867911  2743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b99119aa94c7bb444d163f417b831" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7" is_pre_election: true
I20260709 12:12:21.868618  2743 raft_consensus.cc:2468] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 0.
I20260709 12:12:21.867938  2882 raft_consensus.cc:493] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.869661  2882 raft_consensus.cc:3060] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.873181  2783 leader_election.cc:304] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:21.881088  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9b3f46e2cd49679ad709634ac77a41" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" is_pre_election: true
I20260709 12:12:21.882544  2666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b99119aa94c7bb444d163f417b831" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" is_pre_election: true
I20260709 12:12:21.875988  2866 raft_consensus.cc:493] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.883780  2742 raft_consensus.cc:2393] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b30070db2c8d4c46a2aacc39bc51ab36 in current term 1: Already voted for candidate 5493f6a9c443455284b04b39cc617dd7 in this term.
W20260709 12:12:21.888234  2780 leader_election.cc:343] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:21.888355  2817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5005068313154497a22c8761927949e5" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" is_pre_election: true
I20260709 12:12:21.892699  2815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bcc63c80664ecf99de6fc5a115d80d" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" is_pre_election: true
I20260709 12:12:21.888715  2866 raft_consensus.cc:515] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.883329  2665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d906bc94b54bfda3a742a515c05699" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" is_pre_election: true
I20260709 12:12:21.885274  2668 raft_consensus.cc:2468] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 0.
W20260709 12:12:21.897186  2709 leader_election.cc:343] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:21.897331  2665 raft_consensus.cc:2468] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 0.
I20260709 12:12:21.898514  2709 leader_election.cc:304] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7; no voters: 82fd5d4063fd4870b05dfbf9a1407de8, b30070db2c8d4c46a2aacc39bc51ab36
I20260709 12:12:21.887634  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d906bc94b54bfda3a742a515c05699" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" is_pre_election: true
I20260709 12:12:21.900321  2816 raft_consensus.cc:2468] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 0.
I20260709 12:12:21.901824  2866 leader_election.cc:290] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:21.902369  2665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d906bc94b54bfda3a742a515c05699" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:21.902935  2866 raft_consensus.cc:2804] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:21.903100  2665 raft_consensus.cc:3060] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.903366  2866 raft_consensus.cc:493] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.900008  2864 leader_election.cc:290] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:21.909041  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3765c69b4297441fbd0304c3dfdf6635" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" is_pre_election: true
I20260709 12:12:21.909623  2864 raft_consensus.cc:2749] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:21.909873  2668 raft_consensus.cc:2468] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 0.
I20260709 12:12:21.898340  2565 catalog_manager.cc:5697] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:21.908126  2780 leader_election.cc:304] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82fd5d4063fd4870b05dfbf9a1407de8, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 5493f6a9c443455284b04b39cc617dd7
I20260709 12:12:21.903931  2866 raft_consensus.cc:3060] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.914892  2780 leader_election.cc:304] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82fd5d4063fd4870b05dfbf9a1407de8, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
W20260709 12:12:21.917830  2709 leader_election.cc:343] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:21.918362  2859 ts_tablet_manager.cc:1434] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7: Time spent starting tablet: real 0.080s	user 0.012s	sys 0.015s
I20260709 12:12:21.918330  2709 leader_election.cc:304] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7; no voters: 82fd5d4063fd4870b05dfbf9a1407de8, b30070db2c8d4c46a2aacc39bc51ab36
I20260709 12:12:21.919134  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3765c69b4297441fbd0304c3dfdf6635" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7" is_pre_election: true
I20260709 12:12:21.920372  2742 raft_consensus.cc:2468] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 0.
I20260709 12:12:21.920666  2892 raft_consensus.cc:2804] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:21.921538  2892 raft_consensus.cc:493] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.921936  2892 raft_consensus.cc:3060] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.922101  2893 raft_consensus.cc:2749] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:21.922457  2882 raft_consensus.cc:515] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.937604  2859 tablet_bootstrap.cc:492] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7: Bootstrap starting.
I20260709 12:12:21.939146  2665 raft_consensus.cc:2468] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 1.
I20260709 12:12:21.940693  2706 leader_election.cc:304] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8; no voters: 
I20260709 12:12:21.941133  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d906bc94b54bfda3a742a515c05699" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:21.941429  2858 tablet_bootstrap.cc:492] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36: No bootstrap required, opened a new log
I20260709 12:12:21.942132  2857 tablet_bootstrap.cc:654] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.942184  2893 raft_consensus.cc:2804] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:21.942914  2893 raft_consensus.cc:697] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 1 LEADER]: Becoming Leader. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Running, Role: LEADER
I20260709 12:12:21.943382  2858 ts_tablet_manager.cc:1403] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36: Time spent bootstrapping tablet: real 0.102s	user 0.020s	sys 0.022s
I20260709 12:12:21.944582  2882 leader_election.cc:290] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:21.945785  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9b3f46e2cd49679ad709634ac77a41" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:21.946866  2742 raft_consensus.cc:3060] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.947602  2882 raft_consensus.cc:2804] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:21.947396  2866 raft_consensus.cc:515] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.948276  2882 raft_consensus.cc:493] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.950953  2866 leader_election.cc:290] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:21.952172  2665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9b3f46e2cd49679ad709634ac77a41" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:21.952162  2743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b99119aa94c7bb444d163f417b831" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:21.953437  2665 raft_consensus.cc:3060] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.956079  2743 raft_consensus.cc:3060] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.963637  2743 raft_consensus.cc:2468] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 1.
I20260709 12:12:21.949972  2882 raft_consensus.cc:3060] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.966363  2859 tablet_bootstrap.cc:654] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.945387  2893 consensus_queue.cc:237] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.969000  2742 raft_consensus.cc:2468] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 1.
I20260709 12:12:21.969630  2783 leader_election.cc:304] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:21.962832  2892 raft_consensus.cc:515] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.970047  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b99119aa94c7bb444d163f417b831" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:21.971819  2816 raft_consensus.cc:2393] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5493f6a9c443455284b04b39cc617dd7 in current term 1: Already voted for candidate b30070db2c8d4c46a2aacc39bc51ab36 in this term.
I20260709 12:12:21.970326  2665 raft_consensus.cc:2468] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 1.
W20260709 12:12:21.972995  2780 leader_election.cc:343] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:21.971837  2783 leader_election.cc:304] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:21.963675  2858 raft_consensus.cc:359] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.975013  2895 raft_consensus.cc:2804] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:21.975114  2858 raft_consensus.cc:385] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.975279  2866 raft_consensus.cc:2804] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:21.975754  2858 raft_consensus.cc:740] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.978092  2858 consensus_queue.cc:260] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:21.984560  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d906bc94b54bfda3a742a515c05699" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:21.985163  2892 leader_election.cc:290] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:21.989226  2665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d906bc94b54bfda3a742a515c05699" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:21.990128  2665 raft_consensus.cc:2393] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b30070db2c8d4c46a2aacc39bc51ab36 in current term 1: Already voted for candidate 5493f6a9c443455284b04b39cc617dd7 in this term.
I20260709 12:12:21.989997  2895 raft_consensus.cc:697] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Becoming Leader. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:21.992066  2780 leader_election.cc:304] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b30070db2c8d4c46a2aacc39bc51ab36; no voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8
I20260709 12:12:21.994778  2857 tablet_bootstrap.cc:492] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8: No bootstrap required, opened a new log
I20260709 12:12:21.994946  2892 raft_consensus.cc:2749] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:21.995290  2857 ts_tablet_manager.cc:1403] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent bootstrapping tablet: real 0.128s	user 0.017s	sys 0.005s
I20260709 12:12:21.998224  2882 raft_consensus.cc:515] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.000269  2858 ts_tablet_manager.cc:1434] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.006s
I20260709 12:12:22.001468  2858 tablet_bootstrap.cc:492] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36: Bootstrap starting.
I20260709 12:12:22.002291  2859 tablet_bootstrap.cc:492] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7: No bootstrap required, opened a new log
I20260709 12:12:22.002722  2859 ts_tablet_manager.cc:1403] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7: Time spent bootstrapping tablet: real 0.068s	user 0.008s	sys 0.008s
I20260709 12:12:22.005024  2859 raft_consensus.cc:359] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.005560  2859 raft_consensus.cc:385] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.005827  2859 raft_consensus.cc:740] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.006435  2859 consensus_queue.cc:260] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.022606  2859 ts_tablet_manager.cc:1434] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 12:12:22.023339  2857 raft_consensus.cc:359] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.024070  2857 raft_consensus.cc:385] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.024333  2859 tablet_bootstrap.cc:492] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7: Bootstrap starting.
I20260709 12:12:22.024335  2857 raft_consensus.cc:740] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.025624  2882 leader_election.cc:290] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:22.026409  2665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3765c69b4297441fbd0304c3dfdf6635" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:22.026989  2665 raft_consensus.cc:3060] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.027249  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3765c69b4297441fbd0304c3dfdf6635" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:22.027845  2742 raft_consensus.cc:3060] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.991175  2895 consensus_queue.cc:237] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.006603  2565 catalog_manager.cc:5697] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "5493f6a9c443455284b04b39cc617dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:22.032649  2858 tablet_bootstrap.cc:654] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.033744  2859 tablet_bootstrap.cc:654] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.042407  2857 consensus_queue.cc:260] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.045547  2857 ts_tablet_manager.cc:1434] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 12:12:22.046675  2857 tablet_bootstrap.cc:492] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8: Bootstrap starting.
I20260709 12:12:22.050820  2742 raft_consensus.cc:2468] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 1.
I20260709 12:12:22.030471  2866 raft_consensus.cc:697] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Becoming Leader. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:22.059319  2783 leader_election.cc:304] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:22.061239  2899 raft_consensus.cc:2804] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.062032  2899 raft_consensus.cc:697] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Becoming Leader. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:22.061620  2866 consensus_queue.cc:237] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.078979  2857 tablet_bootstrap.cc:654] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.066272  2665 raft_consensus.cc:2468] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 1.
I20260709 12:12:22.063340  2899 consensus_queue.cc:237] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
W20260709 12:12:22.085733  2903 log.cc:927] Time spent T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:12:22.091984  2858 tablet_bootstrap.cc:492] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36: No bootstrap required, opened a new log
I20260709 12:12:22.092551  2858 ts_tablet_manager.cc:1403] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.007s
I20260709 12:12:22.092593  2859 tablet_bootstrap.cc:492] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7: No bootstrap required, opened a new log
I20260709 12:12:22.093192  2859 ts_tablet_manager.cc:1403] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7: Time spent bootstrapping tablet: real 0.069s	user 0.031s	sys 0.013s
I20260709 12:12:22.094354  2893 raft_consensus.cc:493] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.095002  2893 raft_consensus.cc:515] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.096246  2859 raft_consensus.cc:359] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.096455  2858 raft_consensus.cc:359] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.096992  2859 raft_consensus.cc:385] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.097173  2858 raft_consensus.cc:385] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.097321  2859 raft_consensus.cc:740] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.097544  2858 raft_consensus.cc:740] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.097988  2895 raft_consensus.cc:493] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.098133  2859 consensus_queue.cc:260] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.098645  2895 raft_consensus.cc:515] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.100531  2859 ts_tablet_manager.cc:1434] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:22.101512  2859 tablet_bootstrap.cc:492] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7: Bootstrap starting.
I20260709 12:12:22.102840  2665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e249a3c8c146fb86d0b1048e967844" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" is_pre_election: true
I20260709 12:12:22.103269  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" is_pre_election: true
I20260709 12:12:22.104128  2668 raft_consensus.cc:2468] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 0.
I20260709 12:12:22.105997  2780 leader_election.cc:304] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82fd5d4063fd4870b05dfbf9a1407de8, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:22.108435  2901 raft_consensus.cc:2804] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:22.098474  2858 consensus_queue.cc:260] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.109543  2859 tablet_bootstrap.cc:654] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:22.109086  2706 leader_election.cc:343] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:22.108881  2901 raft_consensus.cc:493] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.112403  2901 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.124078  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7" is_pre_election: true
I20260709 12:12:22.124740  2742 raft_consensus.cc:2468] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 0.
I20260709 12:12:22.125468  2857 tablet_bootstrap.cc:492] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8: No bootstrap required, opened a new log
I20260709 12:12:22.125979  2857 ts_tablet_manager.cc:1403] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent bootstrapping tablet: real 0.080s	user 0.020s	sys 0.000s
I20260709 12:12:22.126910  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e249a3c8c146fb86d0b1048e967844" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" is_pre_election: true
I20260709 12:12:22.127591  2816 raft_consensus.cc:2468] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 0.
I20260709 12:12:22.125350  2565 catalog_manager.cc:5697] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 reported cstate change: term changed from 0 to 1, leader changed from <none> to b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.122407  2893 leader_election.cc:290] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:22.128866  2709 leader_election.cc:304] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 82fd5d4063fd4870b05dfbf9a1407de8
I20260709 12:12:22.121924  2895 leader_election.cc:290] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:22.130008  2901 raft_consensus.cc:515] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.130383  2893 raft_consensus.cc:2804] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:22.128895  2857 raft_consensus.cc:359] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.129937  2565 catalog_manager.cc:5697] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 reported cstate change: term changed from 0 to 1, leader changed from <none> to b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.131378  2893 raft_consensus.cc:493] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.131632  2857 raft_consensus.cc:385] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.132669  2858 ts_tablet_manager.cc:1434] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 12:12:22.132570  2857 raft_consensus.cc:740] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.133270  2901 leader_election.cc:290] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:22.133708  2858 tablet_bootstrap.cc:492] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36: Bootstrap starting.
I20260709 12:12:22.133404  2857 consensus_queue.cc:260] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.134802  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:22.135068  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:22.135461  2668 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.135656  2742 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.132227  2893 raft_consensus.cc:3060] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.141665  2857 ts_tablet_manager.cc:1434] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:12:22.142701  2857 tablet_bootstrap.cc:492] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8: Bootstrap starting.
I20260709 12:12:22.144665  2891 raft_consensus.cc:493] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.145190  2891 raft_consensus.cc:515] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.145186  2742 raft_consensus.cc:2468] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 1.
I20260709 12:12:22.149592  2783 leader_election.cc:304] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:22.150503  2901 raft_consensus.cc:2804] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.151028  2858 tablet_bootstrap.cc:654] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.150995  2901 raft_consensus.cc:697] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Becoming Leader. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:22.152046  2901 consensus_queue.cc:237] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.153051  2668 raft_consensus.cc:2468] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 1.
I20260709 12:12:22.157827  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" is_pre_election: true
W20260709 12:12:22.159812  2706 leader_election.cc:343] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:22.164312  2857 tablet_bootstrap.cc:654] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.165422  2891 leader_election.cc:290] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:22.165601  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" is_pre_election: true
W20260709 12:12:22.167541  2709 leader_election.cc:343] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:22.168041  2709 leader_election.cc:304] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7; no voters: 82fd5d4063fd4870b05dfbf9a1407de8, b30070db2c8d4c46a2aacc39bc51ab36
I20260709 12:12:22.171043  2891 raft_consensus.cc:2749] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:22.173056  2858 tablet_bootstrap.cc:492] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36: No bootstrap required, opened a new log
I20260709 12:12:22.173175  2857 tablet_bootstrap.cc:492] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8: No bootstrap required, opened a new log
I20260709 12:12:22.173652  2857 ts_tablet_manager.cc:1403] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.000s
I20260709 12:12:22.173652  2858 ts_tablet_manager.cc:1403] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.009s
I20260709 12:12:22.176594  2857 raft_consensus.cc:359] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.176879  2858 raft_consensus.cc:359] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.177289  2857 raft_consensus.cc:385] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.177516  2858 raft_consensus.cc:385] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.177563  2857 raft_consensus.cc:740] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.177872  2858 raft_consensus.cc:740] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.178316  2859 tablet_bootstrap.cc:492] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7: No bootstrap required, opened a new log
I20260709 12:12:22.178785  2859 ts_tablet_manager.cc:1403] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.018s
I20260709 12:12:22.178675  2858 consensus_queue.cc:260] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.178438  2857 consensus_queue.cc:260] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.181541  2858 ts_tablet_manager.cc:1434] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:22.182051  2857 ts_tablet_manager.cc:1434] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:22.181715  2859 raft_consensus.cc:359] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.182525  2859 raft_consensus.cc:385] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.182680  2858 tablet_bootstrap.cc:492] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36: Bootstrap starting.
I20260709 12:12:22.182816  2859 raft_consensus.cc:740] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.182978  2857 tablet_bootstrap.cc:492] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8: Bootstrap starting.
I20260709 12:12:22.183957  2893 raft_consensus.cc:515] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.186851  2859 consensus_queue.cc:260] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.187840  2893 leader_election.cc:290] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:22.189378  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e249a3c8c146fb86d0b1048e967844" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:22.190122  2668 raft_consensus.cc:3060] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.191584  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e249a3c8c146fb86d0b1048e967844" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:22.192168  2816 raft_consensus.cc:3060] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.192364  2859 ts_tablet_manager.cc:1434] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:12:22.197330  2668 raft_consensus.cc:2468] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 1.
I20260709 12:12:22.198609  2706 leader_election.cc:304] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8; no voters: 
I20260709 12:12:22.199496  2893 raft_consensus.cc:2804] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.199983  2893 raft_consensus.cc:697] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [term 1 LEADER]: Becoming Leader. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Running, Role: LEADER
I20260709 12:12:22.200788  2893 consensus_queue.cc:237] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.201421  2857 tablet_bootstrap.cc:654] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.202607  2816 raft_consensus.cc:2468] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 1.
I20260709 12:12:22.207718  2566 catalog_manager.cc:5697] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 reported cstate change: term changed from 0 to 1, leader changed from <none> to b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.208853  2857 tablet_bootstrap.cc:492] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8: No bootstrap required, opened a new log
I20260709 12:12:22.210171  2857 ts_tablet_manager.cc:1403] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.006s
I20260709 12:12:22.210362  2858 tablet_bootstrap.cc:654] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.209754  2566 catalog_manager.cc:5697] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 reported cstate change: term changed from 0 to 1, leader changed from <none> to b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.213692  2857 raft_consensus.cc:359] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.214679  2857 raft_consensus.cc:385] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.215047  2857 raft_consensus.cc:740] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.216099  2857 consensus_queue.cc:260] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.219331  2857 ts_tablet_manager.cc:1434] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:22.221088  2857 tablet_bootstrap.cc:492] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8: Bootstrap starting.
I20260709 12:12:22.220235  2562 catalog_manager.cc:5697] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "5493f6a9c443455284b04b39cc617dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:22.226792  2893 raft_consensus.cc:493] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.227584  2893 raft_consensus.cc:515] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.232302  2857 tablet_bootstrap.cc:654] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.232161  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3336ce82a4b1aa8eb217aaa4c7176" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" is_pre_election: true
I20260709 12:12:22.234311  2668 raft_consensus.cc:2468] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 0.
I20260709 12:12:22.236603  2706 leader_election.cc:304] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8; no voters: 
I20260709 12:12:22.237468  2891 raft_consensus.cc:2804] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:22.237864  2891 raft_consensus.cc:493] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.238196  2891 raft_consensus.cc:3060] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.249015  2857 tablet_bootstrap.cc:492] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8: No bootstrap required, opened a new log
I20260709 12:12:22.249698  2857 ts_tablet_manager.cc:1403] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.001s
I20260709 12:12:22.251488  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3336ce82a4b1aa8eb217aaa4c7176" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" is_pre_election: true
I20260709 12:12:22.252177  2816 raft_consensus.cc:2468] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 0.
I20260709 12:12:22.253268  2857 raft_consensus.cc:359] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.254177  2857 raft_consensus.cc:385] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.254436  2857 raft_consensus.cc:740] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.255071  2857 consensus_queue.cc:260] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.255579  2893 leader_election.cc:290] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:22.247363  2891 raft_consensus.cc:515] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.257409  2857 ts_tablet_manager.cc:1434] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:22.259547  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3336ce82a4b1aa8eb217aaa4c7176" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:22.260277  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3336ce82a4b1aa8eb217aaa4c7176" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:22.260331  2668 raft_consensus.cc:3060] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.260947  2816 raft_consensus.cc:3060] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.266891  2816 raft_consensus.cc:2468] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 1.
I20260709 12:12:22.268146  2709 leader_election.cc:304] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:22.269075  2893 raft_consensus.cc:2804] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.269582  2893 raft_consensus.cc:697] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 1 LEADER]: Becoming Leader. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Running, Role: LEADER
I20260709 12:12:22.270586  2893 consensus_queue.cc:237] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.271709  2668 raft_consensus.cc:2468] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 1.
I20260709 12:12:22.266908  2891 leader_election.cc:290] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 1 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:22.277563  2858 tablet_bootstrap.cc:492] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36: No bootstrap required, opened a new log
I20260709 12:12:22.277998  2858 ts_tablet_manager.cc:1403] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36: Time spent bootstrapping tablet: real 0.096s	user 0.036s	sys 0.031s
I20260709 12:12:22.280859  2858 raft_consensus.cc:359] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.281392  2858 raft_consensus.cc:385] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.281606  2858 raft_consensus.cc:740] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.282239  2858 consensus_queue.cc:260] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.282979  2566 catalog_manager.cc:5697] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "5493f6a9c443455284b04b39cc617dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:22.283964  2858 ts_tablet_manager.cc:1434] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:12:22.284974  2858 tablet_bootstrap.cc:492] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36: Bootstrap starting.
I20260709 12:12:22.290738  2858 tablet_bootstrap.cc:654] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.295507  2858 tablet_bootstrap.cc:492] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36: No bootstrap required, opened a new log
I20260709 12:12:22.296007  2858 ts_tablet_manager.cc:1403] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.001s
I20260709 12:12:22.298583  2858 raft_consensus.cc:359] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.299130  2858 raft_consensus.cc:385] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.299319  2858 raft_consensus.cc:740] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.299916  2858 consensus_queue.cc:260] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.301656  2858 ts_tablet_manager.cc:1434] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:22.302829  2858 tablet_bootstrap.cc:492] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36: Bootstrap starting.
I20260709 12:12:22.308542  2858 tablet_bootstrap.cc:654] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.313481  2858 tablet_bootstrap.cc:492] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36: No bootstrap required, opened a new log
I20260709 12:12:22.314134  2858 ts_tablet_manager.cc:1403] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 12:12:22.316517  2858 raft_consensus.cc:359] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.317132  2858 raft_consensus.cc:385] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.317389  2858 raft_consensus.cc:740] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.317991  2858 consensus_queue.cc:260] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.320503  2858 ts_tablet_manager.cc:1434] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:12:22.334293  2887 consensus_queue.cc:1048] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:22.345342  2816 raft_consensus.cc:3060] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.352591  2887 consensus_queue.cc:1048] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:22.492309  2893 consensus_queue.cc:1048] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:22.494343  2895 consensus_queue.cc:1048] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:22.495050  2901 consensus_queue.cc:1048] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:22.496728  2901 raft_consensus.cc:493] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.497282  2901 raft_consensus.cc:515] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.502964  2743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7" is_pre_election: true
I20260709 12:12:22.506464  2743 raft_consensus.cc:2468] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 0.
I20260709 12:12:22.506541  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" is_pre_election: true
I20260709 12:12:22.509195  2901 leader_election.cc:290] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:22.513273  2668 raft_consensus.cc:2468] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 0.
I20260709 12:12:22.514880  2783 leader_election.cc:304] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:22.516674  2901 raft_consensus.cc:2804] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:22.517071  2901 raft_consensus.cc:493] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.517441  2901 raft_consensus.cc:3060] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.520732  2893 consensus_queue.cc:1048] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:22.525733  2901 raft_consensus.cc:515] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.528616  2901 leader_election.cc:290] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:22.534117  2665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:22.534680  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:22.534941  2665 raft_consensus.cc:3060] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.535480  2742 raft_consensus.cc:3060] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.534873  2895 consensus_queue.cc:1048] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:22.542615  2665 raft_consensus.cc:2468] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 1.
I20260709 12:12:22.545187  2742 raft_consensus.cc:2468] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 1.
I20260709 12:12:22.546352  2780 leader_election.cc:304] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82fd5d4063fd4870b05dfbf9a1407de8, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:22.547590  2895 raft_consensus.cc:2804] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.548077  2895 raft_consensus.cc:697] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Becoming Leader. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:22.548902  2895 consensus_queue.cc:237] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.551518  2882 consensus_queue.cc:1048] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:22.563912  2899 consensus_queue.cc:1048] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:22.568789  2668 raft_consensus.cc:3060] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.573846  2562 catalog_manager.cc:5697] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 reported cstate change: term changed from 0 to 1, leader changed from <none> to b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.578807  2899 consensus_queue.cc:1048] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:22.611019  2887 raft_consensus.cc:493] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.611545  2887 raft_consensus.cc:515] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.613248  2887 leader_election.cc:290] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:22.614176  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bcc63c80664ecf99de6fc5a115d80d" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7" is_pre_election: true
I20260709 12:12:22.614437  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bcc63c80664ecf99de6fc5a115d80d" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" is_pre_election: true
I20260709 12:12:22.614749  2742 raft_consensus.cc:2468] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 0.
I20260709 12:12:22.615038  2816 raft_consensus.cc:2468] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 0.
I20260709 12:12:22.615918  2634 leader_election.cc:304] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8; no voters: 
I20260709 12:12:22.616629  2887 raft_consensus.cc:2804] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:22.616925  2887 raft_consensus.cc:493] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.617170  2887 raft_consensus.cc:3060] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.622435  2887 raft_consensus.cc:515] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.624226  2887 leader_election.cc:290] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 election: Requested vote from peers 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:22.625216  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bcc63c80664ecf99de6fc5a115d80d" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:22.625587  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9bcc63c80664ecf99de6fc5a115d80d" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:22.625875  2742 raft_consensus.cc:3060] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.626133  2816 raft_consensus.cc:3060] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.634086  2742 raft_consensus.cc:2468] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 1.
I20260709 12:12:22.634087  2816 raft_consensus.cc:2468] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 1.
I20260709 12:12:22.635671  2634 leader_election.cc:304] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82fd5d4063fd4870b05dfbf9a1407de8, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:22.636368  2887 raft_consensus.cc:2804] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.636848  2887 raft_consensus.cc:697] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 LEADER]: Becoming Leader. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:22.637647  2887 consensus_queue.cc:237] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.645361  2565 catalog_manager.cc:5697] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:22.661427  2893 consensus_queue.cc:1048] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:22.674001  2891 consensus_queue.cc:1048] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:22.702096  2899 consensus_queue.cc:1048] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:22.713713  2895 consensus_queue.cc:1048] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:22.740674  2938 consensus_queue.cc:1048] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:22.750959  2864 consensus_queue.cc:1048] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:22.863903  2816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "566b99119aa94c7bb444d163f417b831"
dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
mode: GRACEFUL
new_leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:46190
I20260709 12:12:22.864584  2816 raft_consensus.cc:606] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Received request to transfer leadership to TS 82fd5d4063fd4870b05dfbf9a1407de8
I20260709 12:12:22.869603  2816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb9b3f46e2cd49679ad709634ac77a41"
dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
mode: GRACEFUL
new_leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:46190
I20260709 12:12:22.870123  2816 raft_consensus.cc:606] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Received request to transfer leadership to TS 82fd5d4063fd4870b05dfbf9a1407de8
I20260709 12:12:22.880179  2816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32a793bd6df44220aaed160471a0198f"
dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
mode: GRACEFUL
new_leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:46190
I20260709 12:12:22.880702  2816 raft_consensus.cc:606] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Received request to transfer leadership to TS 82fd5d4063fd4870b05dfbf9a1407de8
I20260709 12:12:22.885728  2816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3765c69b4297441fbd0304c3dfdf6635"
dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
mode: GRACEFUL
new_leader_uuid: "5493f6a9c443455284b04b39cc617dd7"
 from {username='slave'} at 127.0.0.1:46190
I20260709 12:12:22.886279  2816 raft_consensus.cc:606] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Received request to transfer leadership to TS 5493f6a9c443455284b04b39cc617dd7
I20260709 12:12:22.891094  2816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab"
dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
mode: GRACEFUL
new_leader_uuid: "5493f6a9c443455284b04b39cc617dd7"
 from {username='slave'} at 127.0.0.1:46190
I20260709 12:12:22.891655  2816 raft_consensus.cc:606] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Received request to transfer leadership to TS 5493f6a9c443455284b04b39cc617dd7
I20260709 12:12:22.910854  2742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6d906bc94b54bfda3a742a515c05699"
dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
mode: GRACEFUL
new_leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
 from {username='slave'} at 127.0.0.1:58196
I20260709 12:12:22.911394  2742 raft_consensus.cc:606] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 1 LEADER]: Received request to transfer leadership to TS b30070db2c8d4c46a2aacc39bc51ab36
I20260709 12:12:22.952812  2893 raft_consensus.cc:993] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7: : Instructing follower b30070db2c8d4c46a2aacc39bc51ab36 to start an election
I20260709 12:12:22.953361  2864 raft_consensus.cc:1081] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 1 LEADER]: Signalling peer b30070db2c8d4c46a2aacc39bc51ab36 to start an election
I20260709 12:12:22.954878  2816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6d906bc94b54bfda3a742a515c05699"
dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
 from {username='slave'} at 127.0.0.1:59466
I20260709 12:12:22.955418  2816 raft_consensus.cc:493] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:22.955746  2816 raft_consensus.cc:3060] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:22.960417  2816 raft_consensus.cc:515] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.962214  2816 leader_election.cc:290] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 2 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:22.962997  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d906bc94b54bfda3a742a515c05699" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:22.963271  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d906bc94b54bfda3a742a515c05699" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:22.963651  2668 raft_consensus.cc:3060] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:22.963866  2742 raft_consensus.cc:3055] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:22.964241  2742 raft_consensus.cc:740] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Running, Role: LEADER
I20260709 12:12:22.965072  2742 consensus_queue.cc:260] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.966220  2742 raft_consensus.cc:3060] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:22.969456  2668 raft_consensus.cc:2468] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 2.
I20260709 12:12:22.970669  2780 leader_election.cc:304] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82fd5d4063fd4870b05dfbf9a1407de8, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:22.971216  2742 raft_consensus.cc:2468] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 2.
I20260709 12:12:22.971343  2899 raft_consensus.cc:2804] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:22.971902  2899 raft_consensus.cc:697] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 LEADER]: Becoming Leader. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:22.972733  2899 consensus_queue.cc:237] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:22.978529  2566 catalog_manager.cc:5697] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 reported cstate change: term changed from 1 to 2, leader changed from 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66) to b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:23.001953  2899 consensus_queue.cc:1048] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:23.008636  2895 raft_consensus.cc:993] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36: : Instructing follower 5493f6a9c443455284b04b39cc617dd7 to start an election
I20260709 12:12:23.009126  2866 raft_consensus.cc:1081] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Signalling peer 5493f6a9c443455284b04b39cc617dd7 to start an election
I20260709 12:12:23.010764  2743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab"
dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
 from {username='slave'} at 127.0.0.1:36028
I20260709 12:12:23.011329  2743 raft_consensus.cc:493] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:23.011739  2743 raft_consensus.cc:3060] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.013909  2866 consensus_queue.cc:1048] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:23.017705  2866 raft_consensus.cc:993] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36: : Instructing follower 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:23.018312  2895 raft_consensus.cc:1081] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Signalling peer 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:23.020248  2668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "566b99119aa94c7bb444d163f417b831"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:55194
I20260709 12:12:23.020812  2668 raft_consensus.cc:493] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:23.021188  2668 raft_consensus.cc:3060] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.022943  2743 raft_consensus.cc:515] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.024524  2742 raft_consensus.cc:1240] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Rejecting Update request from peer b30070db2c8d4c46a2aacc39bc51ab36 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:23.026356  2743 leader_election.cc:290] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 2 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:23.027952  2665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:23.028442  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:23.028616  2668 raft_consensus.cc:515] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.028561  2895 consensus_queue.cc:1059] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.028553  2665 raft_consensus.cc:3060] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.030742  2668 leader_election.cc:290] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 2 election: Requested vote from peers 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:23.031915  2815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b99119aa94c7bb444d163f417b831" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:23.032473  2815 raft_consensus.cc:3055] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:23.032790  2815 raft_consensus.cc:740] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:23.033623  2815 consensus_queue.cc:260] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.034898  2815 raft_consensus.cc:3060] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.034982  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b99119aa94c7bb444d163f417b831" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:23.035226  2899 raft_consensus.cc:993] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36: : Instructing follower 5493f6a9c443455284b04b39cc617dd7 to start an election
I20260709 12:12:23.035595  2742 raft_consensus.cc:3060] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.035764  2895 raft_consensus.cc:1081] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Signalling peer 5493f6a9c443455284b04b39cc617dd7 to start an election
I20260709 12:12:23.037559  2743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3765c69b4297441fbd0304c3dfdf6635"
dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
 from {username='slave'} at 127.0.0.1:36028
I20260709 12:12:23.038066  2743 raft_consensus.cc:493] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:23.038388  2743 raft_consensus.cc:3060] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.040714  2816 raft_consensus.cc:3055] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:23.042266  2815 raft_consensus.cc:2468] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 2.
I20260709 12:12:23.042858  2816 raft_consensus.cc:740] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:23.042268  2742 raft_consensus.cc:2468] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 2.
I20260709 12:12:23.043860  2634 leader_election.cc:304] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82fd5d4063fd4870b05dfbf9a1407de8, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:23.043874  2816 consensus_queue.cc:260] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.045298  2887 raft_consensus.cc:2804] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:23.045094  2743 raft_consensus.cc:515] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.045933  2887 raft_consensus.cc:697] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Becoming Leader. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:23.046465  2665 raft_consensus.cc:2468] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 2.
I20260709 12:12:23.046667  2887 consensus_queue.cc:237] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.047816  2743 leader_election.cc:290] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 2 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:23.048034  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3765c69b4297441fbd0304c3dfdf6635" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:23.048722  2668 raft_consensus.cc:3060] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.050770  2817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3765c69b4297441fbd0304c3dfdf6635" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:23.050981  2816 raft_consensus.cc:3060] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.051370  2817 raft_consensus.cc:3055] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:23.051717  2817 raft_consensus.cc:740] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:23.051753  2706 leader_election.cc:304] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8; no voters: 
I20260709 12:12:23.052594  2817 consensus_queue.cc:260] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.053807  2817 raft_consensus.cc:3060] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.055728  2864 raft_consensus.cc:2804] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:23.056224  2864 raft_consensus.cc:697] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 2 LEADER]: Becoming Leader. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Running, Role: LEADER
I20260709 12:12:23.057013  2864 consensus_queue.cc:237] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.057257  2566 catalog_manager.cc:5697] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 reported cstate change: term changed from 1 to 2, leader changed from b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67) to 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.058041  2816 raft_consensus.cc:2468] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 2.
W20260709 12:12:23.058622  2866 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:12:23.064131  2817 raft_consensus.cc:2468] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 2.
I20260709 12:12:23.065450  2709 leader_election.cc:304] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:23.066239  2893 raft_consensus.cc:2804] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:23.066715  2893 raft_consensus.cc:697] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 2 LEADER]: Becoming Leader. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Running, Role: LEADER
I20260709 12:12:23.067602  2893 consensus_queue.cc:237] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.068291  2668 raft_consensus.cc:2468] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 2.
I20260709 12:12:23.069015  2565 catalog_manager.cc:5697] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 reported cstate change: term changed from 1 to 2, leader changed from b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67) to 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "5493f6a9c443455284b04b39cc617dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.081132  2565 catalog_manager.cc:5697] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 reported cstate change: term changed from 1 to 2, leader changed from b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67) to 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "5493f6a9c443455284b04b39cc617dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.103137  2866 raft_consensus.cc:993] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36: : Instructing follower 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:23.103659  2899 raft_consensus.cc:1081] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Signalling peer 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:23.105248  2668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb9b3f46e2cd49679ad709634ac77a41"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:55194
I20260709 12:12:23.105852  2668 raft_consensus.cc:493] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:23.106226  2668 raft_consensus.cc:3060] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.111089  2668 raft_consensus.cc:515] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.112874  2668 leader_election.cc:290] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 2 election: Requested vote from peers 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:23.113802  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9b3f46e2cd49679ad709634ac77a41" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:23.113878  2817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9b3f46e2cd49679ad709634ac77a41" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:23.114522  2742 raft_consensus.cc:3060] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.114560  2817 raft_consensus.cc:3055] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:23.114969  2817 raft_consensus.cc:740] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:23.115672  2817 consensus_queue.cc:260] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.116743  2817 raft_consensus.cc:3060] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.120302  2742 raft_consensus.cc:2468] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 2.
I20260709 12:12:23.121544  2634 leader_election.cc:304] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8; no voters: 
I20260709 12:12:23.122463  2887 raft_consensus.cc:2804] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:23.122910  2887 raft_consensus.cc:697] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Becoming Leader. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:23.123760  2887 consensus_queue.cc:237] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.125841  2817 raft_consensus.cc:2468] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 2.
I20260709 12:12:23.131619  2866 raft_consensus.cc:993] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36: : Instructing follower 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:23.132102  2899 raft_consensus.cc:1081] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Signalling peer 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:23.131345  2565 catalog_manager.cc:5697] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 reported cstate change: term changed from 1 to 2, leader changed from b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67) to 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.133598  2668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32a793bd6df44220aaed160471a0198f"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:55194
I20260709 12:12:23.134227  2668 raft_consensus.cc:493] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:23.134574  2668 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.140947  2668 raft_consensus.cc:515] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.142745  2668 leader_election.cc:290] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 2 election: Requested vote from peers 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:23.143396  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:23.143761  2817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:23.144084  2742 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.144263  2817 raft_consensus.cc:3055] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:23.144614  2817 raft_consensus.cc:740] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:23.145316  2817 consensus_queue.cc:260] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.146211  2817 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.149070  2742 raft_consensus.cc:2468] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 2.
I20260709 12:12:23.150090  2634 leader_election.cc:304] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8; no voters: 
I20260709 12:12:23.150805  2862 raft_consensus.cc:2804] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:23.151204  2862 raft_consensus.cc:697] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Becoming Leader. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:23.151487  2817 raft_consensus.cc:2468] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 2.
I20260709 12:12:23.152019  2862 consensus_queue.cc:237] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:23.158203  2565 catalog_manager.cc:5697] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 reported cstate change: term changed from 1 to 2, leader changed from b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67) to 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.164676  2862 consensus_queue.cc:1048] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:23.177219  2950 consensus_queue.cc:1048] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:23.403252  2668 raft_consensus.cc:1275] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Refusing update from remote peer b30070db2c8d4c46a2aacc39bc51ab36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:23.404611  2899 consensus_queue.cc:1048] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:23.412349  2742 raft_consensus.cc:1275] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Refusing update from remote peer b30070db2c8d4c46a2aacc39bc51ab36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:23.414813  2899 consensus_queue.cc:1048] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:23.437633  2817 raft_consensus.cc:1275] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:23.439132  2950 consensus_queue.cc:1048] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:23.447268  2742 raft_consensus.cc:1275] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:23.448910  2950 consensus_queue.cc:1048] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:23.473001  2668 raft_consensus.cc:1275] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Refusing update from remote peer 5493f6a9c443455284b04b39cc617dd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:23.474354  2893 consensus_queue.cc:1048] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:23.482007  2817 raft_consensus.cc:1275] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Refusing update from remote peer 5493f6a9c443455284b04b39cc617dd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:23.483664  2891 consensus_queue.cc:1048] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:23.485093  2668 raft_consensus.cc:1275] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Refusing update from remote peer 5493f6a9c443455284b04b39cc617dd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:23.486518  2891 consensus_queue.cc:1048] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:23.499229  2817 raft_consensus.cc:1275] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Refusing update from remote peer 5493f6a9c443455284b04b39cc617dd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:23.500771  2891 consensus_queue.cc:1048] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:23.564270  2742 raft_consensus.cc:1275] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:23.565771  2862 consensus_queue.cc:1048] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:23.574290  2817 raft_consensus.cc:1275] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:23.576009  2862 consensus_queue.cc:1048] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:23.625799  2817 raft_consensus.cc:1275] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:23.627271  2862 consensus_queue.cc:1048] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:23.636082  2742 raft_consensus.cc:1275] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:23.637658  2862 consensus_queue.cc:1048] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:25.947978  2017 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:12:25.948632  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:25.968995  2668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32a793bd6df44220aaed160471a0198f"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
mode: GRACEFUL
new_leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
 from {username='slave'} at 127.0.0.1:35676
I20260709 12:12:25.969555  2668 raft_consensus.cc:606] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Received request to transfer leadership to TS b30070db2c8d4c46a2aacc39bc51ab36
I20260709 12:12:25.972352  2668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5005068313154497a22c8761927949e5"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
mode: GRACEFUL
new_leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
 from {username='slave'} at 127.0.0.1:35676
I20260709 12:12:25.972945  2668 raft_consensus.cc:606] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 LEADER]: Received request to transfer leadership to TS b30070db2c8d4c46a2aacc39bc51ab36
I20260709 12:12:25.974260  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:25.974715  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:26.105634  2923 raft_consensus.cc:993] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8: : Instructing follower b30070db2c8d4c46a2aacc39bc51ab36 to start an election
I20260709 12:12:26.106180  2923 raft_consensus.cc:1081] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Signalling peer b30070db2c8d4c46a2aacc39bc51ab36 to start an election
I20260709 12:12:26.107627  2816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32a793bd6df44220aaed160471a0198f"
dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
 from {username='slave'} at 127.0.0.1:59454
I20260709 12:12:26.108085  2816 raft_consensus.cc:493] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:26.108376  2816 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:26.113183  2816 raft_consensus.cc:515] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:26.115088  2816 leader_election.cc:290] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 3 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:26.115700  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:26.116103  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:26.116266  2668 raft_consensus.cc:3055] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:26.116683  2742 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:26.116639  2668 raft_consensus.cc:740] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:26.117537  2668 consensus_queue.cc:260] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:26.118976  2668 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:26.123461  2742 raft_consensus.cc:2468] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 3.
I20260709 12:12:26.124994  2668 raft_consensus.cc:2468] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 3.
I20260709 12:12:26.124850  2783 leader_election.cc:304] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:26.125921  2957 raft_consensus.cc:2804] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:26.127113  2957 raft_consensus.cc:697] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 LEADER]: Becoming Leader. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:26.127815  2957 consensus_queue.cc:237] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:26.136929  2562 catalog_manager.cc:5697] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 reported cstate change: term changed from 2 to 3, leader changed from 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65) to b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.184754  2923 raft_consensus.cc:993] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8: : Instructing follower b30070db2c8d4c46a2aacc39bc51ab36 to start an election
I20260709 12:12:26.185285  2961 raft_consensus.cc:1081] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 LEADER]: Signalling peer b30070db2c8d4c46a2aacc39bc51ab36 to start an election
I20260709 12:12:26.186923  2816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5005068313154497a22c8761927949e5"
dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
 from {username='slave'} at 127.0.0.1:59454
I20260709 12:12:26.187491  2816 raft_consensus.cc:493] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:26.187811  2816 raft_consensus.cc:3060] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:26.192487  2816 raft_consensus.cc:515] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:26.194061  2816 leader_election.cc:290] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 2 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:26.195061  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5005068313154497a22c8761927949e5" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:26.195102  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5005068313154497a22c8761927949e5" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:26.195614  2668 raft_consensus.cc:3055] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:26.195696  2742 raft_consensus.cc:3060] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:26.195904  2668 raft_consensus.cc:740] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:26.196568  2668 consensus_queue.cc:260] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:26.197523  2668 raft_consensus.cc:3060] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:26.201803  2742 raft_consensus.cc:2468] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 2.
I20260709 12:12:26.202987  2783 leader_election.cc:304] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:26.203176  2668 raft_consensus.cc:2468] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 2.
I20260709 12:12:26.203908  2957 raft_consensus.cc:2804] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:26.204360  2957 raft_consensus.cc:697] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 LEADER]: Becoming Leader. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:26.205092  2957 consensus_queue.cc:237] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:26.212229  2562 catalog_manager.cc:5697] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 reported cstate change: term changed from 1 to 2, leader changed from 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65) to b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.590869  2742 raft_consensus.cc:1275] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Refusing update from remote peer b30070db2c8d4c46a2aacc39bc51ab36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:26.592208  2957 consensus_queue.cc:1048] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:26.604035  2668 raft_consensus.cc:1275] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Refusing update from remote peer b30070db2c8d4c46a2aacc39bc51ab36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:26.605659  2971 consensus_queue.cc:1048] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:26.613333  2742 raft_consensus.cc:1275] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Refusing update from remote peer b30070db2c8d4c46a2aacc39bc51ab36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:26.614464  2957 consensus_queue.cc:1048] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:26.623190  2668 raft_consensus.cc:1275] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Refusing update from remote peer b30070db2c8d4c46a2aacc39bc51ab36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:26.624735  2971 consensus_queue.cc:1048] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:26.975740  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:26.982148  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:26.982630  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:27.983618  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:27.989044  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:27.989529  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:29.016201  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:29.031257  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:29.031963  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:30.032941  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:30.038798  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:30.039207  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:31.040180  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:31.045490  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:31.045917  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:32.046898  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:32.053076  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:32.053515  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:33.054463  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:33.059857  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:33.060319  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:34.061417  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:34.067557  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:34.068073  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:35.069010  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:35.074323  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:35.074810  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:36.107362  2017 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:12:36.120419  2816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5005068313154497a22c8761927949e5"
dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
mode: GRACEFUL
new_leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:46190
I20260709 12:12:36.121075  2816 raft_consensus.cc:606] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 LEADER]: Received request to transfer leadership to TS 82fd5d4063fd4870b05dfbf9a1407de8
I20260709 12:12:36.126044  2816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32a793bd6df44220aaed160471a0198f"
dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
mode: GRACEFUL
new_leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:46190
I20260709 12:12:36.126546  2816 raft_consensus.cc:606] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 LEADER]: Received request to transfer leadership to TS 82fd5d4063fd4870b05dfbf9a1407de8
I20260709 12:12:36.131625  2742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3765c69b4297441fbd0304c3dfdf6635"
dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
mode: GRACEFUL
new_leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:58196
I20260709 12:12:36.132107  2742 raft_consensus.cc:606] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 2 LEADER]: Received request to transfer leadership to TS 82fd5d4063fd4870b05dfbf9a1407de8
I20260709 12:12:36.137629  2742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab"
dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
mode: GRACEFUL
new_leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:58196
I20260709 12:12:36.138141  2742 raft_consensus.cc:606] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 2 LEADER]: Received request to transfer leadership to TS 82fd5d4063fd4870b05dfbf9a1407de8
I20260709 12:12:36.142853  2742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60d3336ce82a4b1aa8eb217aaa4c7176"
dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
mode: GRACEFUL
new_leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:58196
I20260709 12:12:36.143371  2742 raft_consensus.cc:606] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 1 LEADER]: Received request to transfer leadership to TS 82fd5d4063fd4870b05dfbf9a1407de8
I20260709 12:12:36.325421  2985 raft_consensus.cc:993] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36: : Instructing follower 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:36.325971  2990 raft_consensus.cc:1081] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 LEADER]: Signalling peer 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:36.327760  2665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32a793bd6df44220aaed160471a0198f"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:55194
I20260709 12:12:36.328375  2665 raft_consensus.cc:493] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:36.328684  2665 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:36.336328  2665 raft_consensus.cc:515] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.338264  2665 leader_election.cc:290] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 4 election: Requested vote from peers 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:36.339282  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:36.339524  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:36.340036  2742 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:36.340092  2816 raft_consensus.cc:3055] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:36.340437  2816 raft_consensus.cc:740] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:36.341179  2816 consensus_queue.cc:260] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.342136  2816 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:36.345503  2742 raft_consensus.cc:2468] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 4.
I20260709 12:12:36.346782  2816 raft_consensus.cc:2468] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 4.
I20260709 12:12:36.346877  2634 leader_election.cc:304] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8; no voters: 
I20260709 12:12:36.347826  2989 raft_consensus.cc:2804] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:36.348276  2989 raft_consensus.cc:697] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 LEADER]: Becoming Leader. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:36.349076  2989 consensus_queue.cc:237] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.356453  2565 catalog_manager.cc:5697] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 reported cstate change: term changed from 3 to 4, leader changed from b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67) to 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65). New cstate: current_term: 4 leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:36.439785  2891 raft_consensus.cc:993] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7: : Instructing follower 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:36.440299  2891 raft_consensus.cc:1081] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 1 LEADER]: Signalling peer 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:36.442997  2665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60d3336ce82a4b1aa8eb217aaa4c7176"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:55182
I20260709 12:12:36.443818  2665 raft_consensus.cc:493] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:36.444307  2665 raft_consensus.cc:3060] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:36.455302  2665 raft_consensus.cc:515] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.458065  2665 leader_election.cc:290] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 2 election: Requested vote from peers 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:36.458768  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3336ce82a4b1aa8eb217aaa4c7176" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:36.459256  2742 raft_consensus.cc:3055] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:36.459287  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d3336ce82a4b1aa8eb217aaa4c7176" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:36.459631  2742 raft_consensus.cc:740] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Running, Role: LEADER
I20260709 12:12:36.459908  2816 raft_consensus.cc:3060] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:36.460450  2742 consensus_queue.cc:260] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.461386  2742 raft_consensus.cc:3060] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:36.464494  2816 raft_consensus.cc:2468] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 2.
I20260709 12:12:36.465478  2634 leader_election.cc:304] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82fd5d4063fd4870b05dfbf9a1407de8, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:36.466156  2989 raft_consensus.cc:2804] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:36.466411  2742 raft_consensus.cc:2468] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 2.
I20260709 12:12:36.466657  2989 raft_consensus.cc:697] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Becoming Leader. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:36.467562  2989 consensus_queue.cc:237] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.474800  2565 catalog_manager.cc:5697] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 reported cstate change: term changed from 1 to 2, leader changed from 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66) to 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:36.622007  2985 raft_consensus.cc:993] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36: : Instructing follower 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:36.622470  2985 raft_consensus.cc:1081] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 LEADER]: Signalling peer 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:36.624054  2665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5005068313154497a22c8761927949e5"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:55194
I20260709 12:12:36.624565  2665 raft_consensus.cc:493] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:36.624905  2665 raft_consensus.cc:3060] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.629771  2665 raft_consensus.cc:515] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.632004  2665 leader_election.cc:290] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 3 election: Requested vote from peers 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:36.632685  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5005068313154497a22c8761927949e5" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:36.633021  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5005068313154497a22c8761927949e5" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:36.633265  2742 raft_consensus.cc:3060] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.633503  2816 raft_consensus.cc:3055] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:36.633847  2816 raft_consensus.cc:740] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:36.634567  2816 consensus_queue.cc:260] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.635453  2816 raft_consensus.cc:3060] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.638166  2742 raft_consensus.cc:2468] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 3.
I20260709 12:12:36.639109  2634 leader_election.cc:304] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8; no voters: 
I20260709 12:12:36.639834  2816 raft_consensus.cc:2468] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 3.
I20260709 12:12:36.639848  2989 raft_consensus.cc:2804] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:36.640488  2989 raft_consensus.cc:697] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 LEADER]: Becoming Leader. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:36.641644  2989 consensus_queue.cc:237] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.648623  2565 catalog_manager.cc:5697] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 reported cstate change: term changed from 2 to 3, leader changed from b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67) to 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:36.703198  2891 raft_consensus.cc:993] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7: : Instructing follower 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:36.703755  2996 raft_consensus.cc:1081] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 2 LEADER]: Signalling peer 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:36.705310  2665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3765c69b4297441fbd0304c3dfdf6635"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:55182
I20260709 12:12:36.705760  2665 raft_consensus.cc:493] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:36.705994  2665 raft_consensus.cc:3060] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.710312  2665 raft_consensus.cc:515] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.711949  2665 leader_election.cc:290] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 3 election: Requested vote from peers 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:36.712754  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3765c69b4297441fbd0304c3dfdf6635" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:36.712935  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3765c69b4297441fbd0304c3dfdf6635" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:36.713354  2816 raft_consensus.cc:3060] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.713330  2742 raft_consensus.cc:3055] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:36.713841  2742 raft_consensus.cc:740] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Running, Role: LEADER
I20260709 12:12:36.714622  2742 consensus_queue.cc:260] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.715780  2742 raft_consensus.cc:3060] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.719950  2816 raft_consensus.cc:2468] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 3.
I20260709 12:12:36.720952  2634 leader_election.cc:304] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82fd5d4063fd4870b05dfbf9a1407de8, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:36.721776  2989 raft_consensus.cc:2804] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:36.721853  2742 raft_consensus.cc:2468] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 3.
I20260709 12:12:36.722268  2989 raft_consensus.cc:697] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 LEADER]: Becoming Leader. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:36.723662  2989 consensus_queue.cc:237] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.731202  2565 catalog_manager.cc:5697] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 reported cstate change: term changed from 2 to 3, leader changed from 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66) to 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:36.753890  2891 raft_consensus.cc:993] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7: : Instructing follower 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:36.754468  2996 raft_consensus.cc:1081] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 2 LEADER]: Signalling peer 82fd5d4063fd4870b05dfbf9a1407de8 to start an election
I20260709 12:12:36.756085  2665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
 from {username='slave'} at 127.0.0.1:55182
I20260709 12:12:36.756493  2665 raft_consensus.cc:493] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:36.756793  2665 raft_consensus.cc:3060] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.761065  2665 raft_consensus.cc:515] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.762492  2665 leader_election.cc:290] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 3 election: Requested vote from peers 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:36.763412  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:36.763651  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab" candidate_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:36.764020  2742 raft_consensus.cc:3055] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:36.764170  2816 raft_consensus.cc:3060] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.764313  2742 raft_consensus.cc:740] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Running, Role: LEADER
I20260709 12:12:36.765097  2742 consensus_queue.cc:260] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.766125  2742 raft_consensus.cc:3060] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.769644  2816 raft_consensus.cc:2468] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 3.
I20260709 12:12:36.770650  2634 leader_election.cc:304] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82fd5d4063fd4870b05dfbf9a1407de8, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:36.771135  2742 raft_consensus.cc:2468] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82fd5d4063fd4870b05dfbf9a1407de8 in term 3.
I20260709 12:12:36.771485  2989 raft_consensus.cc:2804] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:36.772079  2989 raft_consensus.cc:697] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 LEADER]: Becoming Leader. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:36.772989  2989 consensus_queue.cc:237] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:36.781072  2565 catalog_manager.cc:5697] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 reported cstate change: term changed from 2 to 3, leader changed from 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66) to 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:36.859418  2742 raft_consensus.cc:1275] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:36.860872  2989 consensus_queue.cc:1048] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:36.872074  2816 raft_consensus.cc:1275] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:36.873431  2989 consensus_queue.cc:1048] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:36.938050  2742 raft_consensus.cc:1275] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 4 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:36.939679  2989 consensus_queue.cc:1048] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:36.951581  2816 raft_consensus.cc:1275] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 4 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:36.953497  2979 consensus_queue.cc:1048] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:37.030126  2742 raft_consensus.cc:1275] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:37.031575  3008 consensus_queue.cc:1048] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:37.040746  2817 raft_consensus.cc:1275] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:37.042409  3008 consensus_queue.cc:1048] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:37.158769  2817 raft_consensus.cc:1275] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:37.160631  3008 consensus_queue.cc:1048] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:37.165436  2742 raft_consensus.cc:1275] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:37.167260  3008 consensus_queue.cc:1048] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:37.280484  2742 raft_consensus.cc:1275] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:37.281927  2989 consensus_queue.cc:1048] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:37.288511  2817 raft_consensus.cc:1275] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Refusing update from remote peer 82fd5d4063fd4870b05dfbf9a1407de8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:37.290104  2989 consensus_queue.cc:1048] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:39.187254  2017 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:12:39.188140  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:39.196967  2665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32a793bd6df44220aaed160471a0198f"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
mode: GRACEFUL
new_leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
 from {username='slave'} at 127.0.0.1:35676
I20260709 12:12:39.198004  2665 raft_consensus.cc:606] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 LEADER]: Received request to transfer leadership to TS b30070db2c8d4c46a2aacc39bc51ab36
I20260709 12:12:39.201758  2665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5005068313154497a22c8761927949e5"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
mode: GRACEFUL
new_leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
 from {username='slave'} at 127.0.0.1:35676
I20260709 12:12:39.202239  2665 raft_consensus.cc:606] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 LEADER]: Received request to transfer leadership to TS b30070db2c8d4c46a2aacc39bc51ab36
I20260709 12:12:39.204895  2665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "566b99119aa94c7bb444d163f417b831"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
mode: GRACEFUL
new_leader_uuid: "5493f6a9c443455284b04b39cc617dd7"
 from {username='slave'} at 127.0.0.1:35676
I20260709 12:12:39.205335  2665 raft_consensus.cc:606] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Received request to transfer leadership to TS 5493f6a9c443455284b04b39cc617dd7
I20260709 12:12:39.207974  2665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab"
dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
mode: GRACEFUL
new_leader_uuid: "5493f6a9c443455284b04b39cc617dd7"
 from {username='slave'} at 127.0.0.1:35676
I20260709 12:12:39.208611  2665 raft_consensus.cc:606] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 LEADER]: Received request to transfer leadership to TS 5493f6a9c443455284b04b39cc617dd7
I20260709 12:12:39.210057  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:12:39.210799  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:39.212443  3007 raft_consensus.cc:993] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8: : Instructing follower b30070db2c8d4c46a2aacc39bc51ab36 to start an election
I20260709 12:12:39.213009  3008 raft_consensus.cc:1081] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 LEADER]: Signalling peer b30070db2c8d4c46a2aacc39bc51ab36 to start an election
I20260709 12:12:39.214617  2817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32a793bd6df44220aaed160471a0198f"
dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
 from {username='slave'} at 127.0.0.1:59454
I20260709 12:12:39.215059  2817 raft_consensus.cc:493] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:39.215317  2817 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:39.221071  2817 raft_consensus.cc:515] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:39.223865  2817 leader_election.cc:290] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 5 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:39.224555  2665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:39.224715  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a793bd6df44220aaed160471a0198f" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:39.225441  2665 raft_consensus.cc:3055] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:39.225600  2742 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:39.225730  2665 raft_consensus.cc:740] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:39.226683  2665 consensus_queue.cc:260] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:39.227963  2665 raft_consensus.cc:3060] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:39.231065  2742 raft_consensus.cc:2468] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 5.
I20260709 12:12:39.232538  2783 leader_election.cc:304] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:39.233006  2665 raft_consensus.cc:2468] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 5.
I20260709 12:12:39.233557  2985 raft_consensus.cc:2804] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:39.234891  2985 raft_consensus.cc:697] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 5 LEADER]: Becoming Leader. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:39.236164  2985 consensus_queue.cc:237] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:39.238431  3007 raft_consensus.cc:993] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8: : Instructing follower 5493f6a9c443455284b04b39cc617dd7 to start an election
I20260709 12:12:39.238960  3007 raft_consensus.cc:1081] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 LEADER]: Signalling peer 5493f6a9c443455284b04b39cc617dd7 to start an election
I20260709 12:12:39.240897  2742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab"
dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
 from {username='slave'} at 127.0.0.1:36012
I20260709 12:12:39.241780  2742 raft_consensus.cc:493] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:39.242306  2742 raft_consensus.cc:3060] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:39.245839  3007 raft_consensus.cc:993] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8: : Instructing follower b30070db2c8d4c46a2aacc39bc51ab36 to start an election
I20260709 12:12:39.246516  3008 raft_consensus.cc:1081] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 LEADER]: Signalling peer b30070db2c8d4c46a2aacc39bc51ab36 to start an election
I20260709 12:12:39.247138  2562 catalog_manager.cc:5697] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 reported cstate change: term changed from 4 to 5, leader changed from 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65) to b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67). New cstate: current_term: 5 leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:39.249591  2817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5005068313154497a22c8761927949e5"
dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
 from {username='slave'} at 127.0.0.1:59454
I20260709 12:12:39.250267  2817 raft_consensus.cc:493] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:39.250705  2817 raft_consensus.cc:3060] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:39.249503  2742 raft_consensus.cc:515] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:39.253955  2742 leader_election.cc:290] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 4 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:39.254904  2665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:39.256000  2665 raft_consensus.cc:3055] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:39.256314  2665 raft_consensus.cc:740] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:39.256430  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc1a24f8444cfb814aa8c10ef01dab" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:39.257086  2816 raft_consensus.cc:3060] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:39.257179  2665 consensus_queue.cc:260] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:39.258634  2665 raft_consensus.cc:3060] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:39.258540  2817 raft_consensus.cc:515] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:39.261969  2817 leader_election.cc:290] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 4 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639)
I20260709 12:12:39.263005  2742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5005068313154497a22c8761927949e5" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
I20260709 12:12:39.263617  2742 raft_consensus.cc:3060] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:39.264676  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5005068313154497a22c8761927949e5" candidate_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:39.265481  2668 raft_consensus.cc:3055] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:39.266048  2665 raft_consensus.cc:2468] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 4.
I20260709 12:12:39.265877  2668 raft_consensus.cc:740] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:39.267634  2706 leader_election.cc:304] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, 82fd5d4063fd4870b05dfbf9a1407de8; no voters: 
I20260709 12:12:39.267370  2668 consensus_queue.cc:260] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:39.268604  2996 raft_consensus.cc:2804] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:39.269148  2668 raft_consensus.cc:3060] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:39.270157  2742 raft_consensus.cc:2468] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 4.
I20260709 12:12:39.271245  2783 leader_election.cc:304] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:39.272332  2985 raft_consensus.cc:2804] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:39.272797  2985 raft_consensus.cc:697] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 4 LEADER]: Becoming Leader. State: Replica: b30070db2c8d4c46a2aacc39bc51ab36, State: Running, Role: LEADER
I20260709 12:12:39.273532  2816 raft_consensus.cc:2468] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 4.
I20260709 12:12:39.273765  2985 consensus_queue.cc:237] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:39.278582  2996 raft_consensus.cc:697] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 4 LEADER]: Becoming Leader. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Running, Role: LEADER
I20260709 12:12:39.279995  2996 consensus_queue.cc:237] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:39.281749  2668 raft_consensus.cc:2468] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30070db2c8d4c46a2aacc39bc51ab36 in term 4.
I20260709 12:12:39.290701  2565 catalog_manager.cc:5697] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 reported cstate change: term changed from 3 to 4, leader changed from 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65) to 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66). New cstate: current_term: 4 leader_uuid: "5493f6a9c443455284b04b39cc617dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:39.293776  2562 catalog_manager.cc:5697] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 reported cstate change: term changed from 3 to 4, leader changed from 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65) to b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67). New cstate: current_term: 4 leader_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:39.532104  3008 raft_consensus.cc:993] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8: : Instructing follower 5493f6a9c443455284b04b39cc617dd7 to start an election
I20260709 12:12:39.532678  3007 raft_consensus.cc:1081] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Signalling peer 5493f6a9c443455284b04b39cc617dd7 to start an election
I20260709 12:12:39.534199  2742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "566b99119aa94c7bb444d163f417b831"
dest_uuid: "5493f6a9c443455284b04b39cc617dd7"
 from {username='slave'} at 127.0.0.1:36012
I20260709 12:12:39.534827  2742 raft_consensus.cc:493] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:39.535094  2742 raft_consensus.cc:3060] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.540189  2742 raft_consensus.cc:515] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:39.541832  2742 leader_election.cc:290] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 3 election: Requested vote from peers 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143), b30070db2c8d4c46a2aacc39bc51ab36 (127.1.248.67:43083)
I20260709 12:12:39.542646  2668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b99119aa94c7bb444d163f417b831" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82fd5d4063fd4870b05dfbf9a1407de8"
I20260709 12:12:39.542867  2816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b99119aa94c7bb444d163f417b831" candidate_uuid: "5493f6a9c443455284b04b39cc617dd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b30070db2c8d4c46a2aacc39bc51ab36"
I20260709 12:12:39.543293  2668 raft_consensus.cc:3055] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:39.543412  2816 raft_consensus.cc:3060] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.543712  2668 raft_consensus.cc:740] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82fd5d4063fd4870b05dfbf9a1407de8, State: Running, Role: LEADER
I20260709 12:12:39.544546  2668 consensus_queue.cc:260] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:39.545500  2668 raft_consensus.cc:3060] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.548271  2816 raft_consensus.cc:2468] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 3.
I20260709 12:12:39.549492  2709 leader_election.cc:304] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5493f6a9c443455284b04b39cc617dd7, b30070db2c8d4c46a2aacc39bc51ab36; no voters: 
I20260709 12:12:39.550230  2996 raft_consensus.cc:2804] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:39.550402  2668 raft_consensus.cc:2468] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5493f6a9c443455284b04b39cc617dd7 in term 3.
I20260709 12:12:39.550673  2996 raft_consensus.cc:697] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 3 LEADER]: Becoming Leader. State: Replica: 5493f6a9c443455284b04b39cc617dd7, State: Running, Role: LEADER
I20260709 12:12:39.551632  2996 consensus_queue.cc:237] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } }
I20260709 12:12:39.558970  2562 catalog_manager.cc:5697] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 reported cstate change: term changed from 2 to 3, leader changed from 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65) to 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66). New cstate: current_term: 3 leader_uuid: "5493f6a9c443455284b04b39cc617dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:39.676192  2668 raft_consensus.cc:1275] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 5 FOLLOWER]: Refusing update from remote peer b30070db2c8d4c46a2aacc39bc51ab36: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:39.677455  2985 consensus_queue.cc:1048] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:39.680471  2742 raft_consensus.cc:1275] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 5 FOLLOWER]: Refusing update from remote peer b30070db2c8d4c46a2aacc39bc51ab36: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:39.681910  2985 consensus_queue.cc:1048] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:39.711130  2668 raft_consensus.cc:1275] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 FOLLOWER]: Refusing update from remote peer 5493f6a9c443455284b04b39cc617dd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:39.712400  2996 consensus_queue.cc:1048] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:39.721817  2816 raft_consensus.cc:1275] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 4 FOLLOWER]: Refusing update from remote peer 5493f6a9c443455284b04b39cc617dd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:39.723806  2996 consensus_queue.cc:1048] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:39.807933  2742 raft_consensus.cc:1275] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 4 FOLLOWER]: Refusing update from remote peer b30070db2c8d4c46a2aacc39bc51ab36: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:39.809352  3017 consensus_queue.cc:1048] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5493f6a9c443455284b04b39cc617dd7" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 35639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:39.818624  2668 raft_consensus.cc:1275] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 FOLLOWER]: Refusing update from remote peer b30070db2c8d4c46a2aacc39bc51ab36: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:39.820322  3037 consensus_queue.cc:1048] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:39.995709  2816 raft_consensus.cc:1275] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Refusing update from remote peer 5493f6a9c443455284b04b39cc617dd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:39.997041  2996 consensus_queue.cc:1048] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b30070db2c8d4c46a2aacc39bc51ab36" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 43083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:40.006441  2668 raft_consensus.cc:1275] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Refusing update from remote peer 5493f6a9c443455284b04b39cc617dd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:40.008378  3034 consensus_queue.cc:1048] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fd5d4063fd4870b05dfbf9a1407de8" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:40.211999  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:40.218035  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:40.218631  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:41.219810  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:41.225486  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:41.225943  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:42.226938  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:42.233114  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:42.233619  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:43.234673  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:43.240980  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:43.241377  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:44.242461  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:44.248606  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:44.249076  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:45.835345  2764 debug-util.cc:398] Leaking SignalData structure 0x7b08001126c0 after lost signal to thread 2020
W20260709 12:12:45.836383  2764 debug-util.cc:398] Leaking SignalData structure 0x7b0800112da0 after lost signal to thread 2600
W20260709 12:12:45.837275  2764 debug-util.cc:398] Leaking SignalData structure 0x7b080019ec20 after lost signal to thread 2692
W20260709 12:12:45.838024  2764 debug-util.cc:398] Leaking SignalData structure 0x7b08001a5340 after lost signal to thread 2767
W20260709 12:12:45.838757  2764 debug-util.cc:398] Leaking SignalData structure 0x7b0800199480 after lost signal to thread 2841
I20260709 12:12:45.910542  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:45.916549  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:45.916996  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:46.918119  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:46.928929  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:46.929461  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:47.930567  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:47.938166  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:47.938673  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:48.939829  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:48.946192  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:48.946718  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:49.978616  2017 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:12:49.979257  2017 tablet_server.cc:179] TabletServer@127.1.248.65:0 shutting down...
I20260709 12:12:50.010501  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:50.011518  2017 tablet_replica.cc:333] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8: stopping tablet replica
I20260709 12:12:50.012260  2017 raft_consensus.cc:2243] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.012866  2017 raft_consensus.cc:2272] T 96bc1a24f8444cfb814aa8c10ef01dab P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.015162  2017 tablet_replica.cc:333] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8: stopping tablet replica
I20260709 12:12:50.015777  2017 raft_consensus.cc:2243] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.016242  2017 raft_consensus.cc:2272] T 99e249a3c8c146fb86d0b1048e967844 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.018366  2017 tablet_replica.cc:333] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8: stopping tablet replica
I20260709 12:12:50.019109  2017 raft_consensus.cc:2243] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.020097  2017 raft_consensus.cc:2272] T 3765c69b4297441fbd0304c3dfdf6635 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.022089  2017 tablet_replica.cc:333] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8: stopping tablet replica
I20260709 12:12:50.022648  2017 raft_consensus.cc:2243] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.023165  2017 raft_consensus.cc:2272] T 566b99119aa94c7bb444d163f417b831 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.025102  2017 tablet_replica.cc:333] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8: stopping tablet replica
I20260709 12:12:50.025671  2017 raft_consensus.cc:2243] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.026110  2017 raft_consensus.cc:2272] T 5005068313154497a22c8761927949e5 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.028358  2017 tablet_replica.cc:333] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8: stopping tablet replica
I20260709 12:12:50.028885  2017 raft_consensus.cc:2243] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.029697  2017 raft_consensus.cc:2272] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.031571  2017 tablet_replica.cc:333] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8: stopping tablet replica
I20260709 12:12:50.032112  2017 raft_consensus.cc:2243] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.032544  2017 raft_consensus.cc:2272] T 32a793bd6df44220aaed160471a0198f P 82fd5d4063fd4870b05dfbf9a1407de8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.034356  2017 tablet_replica.cc:333] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8: stopping tablet replica
I20260709 12:12:50.034864  2017 raft_consensus.cc:2243] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.035375  2017 raft_consensus.cc:2272] T c6d906bc94b54bfda3a742a515c05699 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.037195  2017 tablet_replica.cc:333] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8: stopping tablet replica
I20260709 12:12:50.037664  2017 raft_consensus.cc:2243] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.038497  2017 raft_consensus.cc:2272] T e9bcc63c80664ecf99de6fc5a115d80d P 82fd5d4063fd4870b05dfbf9a1407de8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.040412  2017 tablet_replica.cc:333] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8: stopping tablet replica
I20260709 12:12:50.040860  2017 raft_consensus.cc:2243] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.041723  2017 raft_consensus.cc:2272] T eb9b3f46e2cd49679ad709634ac77a41 P 82fd5d4063fd4870b05dfbf9a1407de8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.076188  2017 tablet_server.cc:196] TabletServer@127.1.248.65:0 shutdown complete.
I20260709 12:12:50.097747  2017 tablet_server.cc:179] TabletServer@127.1.248.66:0 shutting down...
W20260709 12:12:50.113186  2783 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:12:50.119669  2783 consensus_peers.cc:597] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 -> Peer 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639): Couldn't send request to peer 5493f6a9c443455284b04b39cc617dd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:50.129422  2783 consensus_peers.cc:597] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 -> Peer 5493f6a9c443455284b04b39cc617dd7 (127.1.248.66:35639): Couldn't send request to peer 5493f6a9c443455284b04b39cc617dd7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:50.135336  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:50.136286  2017 tablet_replica.cc:333] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7: stopping tablet replica
I20260709 12:12:50.137033  2017 raft_consensus.cc:2243] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.137893  2017 raft_consensus.cc:2272] T 96bc1a24f8444cfb814aa8c10ef01dab P 5493f6a9c443455284b04b39cc617dd7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.140044  2017 tablet_replica.cc:333] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7: stopping tablet replica
I20260709 12:12:50.140571  2017 raft_consensus.cc:2243] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.141012  2017 raft_consensus.cc:2272] T 60d3336ce82a4b1aa8eb217aaa4c7176 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.142956  2017 tablet_replica.cc:333] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7: stopping tablet replica
I20260709 12:12:50.143608  2017 raft_consensus.cc:2243] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.144095  2017 raft_consensus.cc:2272] T 32a793bd6df44220aaed160471a0198f P 5493f6a9c443455284b04b39cc617dd7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.145826  2017 tablet_replica.cc:333] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7: stopping tablet replica
I20260709 12:12:50.146356  2017 raft_consensus.cc:2243] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.147239  2017 raft_consensus.cc:2272] T 99e249a3c8c146fb86d0b1048e967844 P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.149550  2017 tablet_replica.cc:333] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7: stopping tablet replica
I20260709 12:12:50.150354  2017 raft_consensus.cc:2243] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.151010  2017 raft_consensus.cc:2272] T 5005068313154497a22c8761927949e5 P 5493f6a9c443455284b04b39cc617dd7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.153079  2017 tablet_replica.cc:333] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7: stopping tablet replica
I20260709 12:12:50.153694  2017 raft_consensus.cc:2243] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.154615  2017 raft_consensus.cc:2272] T 566b99119aa94c7bb444d163f417b831 P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.156893  2017 tablet_replica.cc:333] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7: stopping tablet replica
I20260709 12:12:50.157485  2017 raft_consensus.cc:2243] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.158102  2017 raft_consensus.cc:2272] T 3765c69b4297441fbd0304c3dfdf6635 P 5493f6a9c443455284b04b39cc617dd7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.160972  2017 tablet_replica.cc:333] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7: stopping tablet replica
I20260709 12:12:50.161959  2017 raft_consensus.cc:2243] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.162463  2017 raft_consensus.cc:2272] T c6d906bc94b54bfda3a742a515c05699 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:50.162923  2780 consensus_peers.cc:597] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 -> Peer 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143): Couldn't send request to peer 82fd5d4063fd4870b05dfbf9a1407de8. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:33143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:50.164548  2017 tablet_replica.cc:333] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7: stopping tablet replica
I20260709 12:12:50.165051  2017 raft_consensus.cc:2243] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.165448  2017 raft_consensus.cc:2272] T e9bcc63c80664ecf99de6fc5a115d80d P 5493f6a9c443455284b04b39cc617dd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.167238  2017 tablet_replica.cc:333] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7: stopping tablet replica
I20260709 12:12:50.167774  2017 raft_consensus.cc:2243] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.168176  2017 raft_consensus.cc:2272] T eb9b3f46e2cd49679ad709634ac77a41 P 5493f6a9c443455284b04b39cc617dd7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:50.174716  2780 consensus_peers.cc:597] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 -> Peer 82fd5d4063fd4870b05dfbf9a1407de8 (127.1.248.65:33143): Couldn't send request to peer 82fd5d4063fd4870b05dfbf9a1407de8. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:33143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:50.217319  2017 tablet_server.cc:196] TabletServer@127.1.248.66:0 shutdown complete.
I20260709 12:12:50.237708  2017 tablet_server.cc:179] TabletServer@127.1.248.67:0 shutting down...
I20260709 12:12:50.266641  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:50.267285  2017 tablet_replica.cc:333] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36: stopping tablet replica
I20260709 12:12:50.267990  2017 raft_consensus.cc:2243] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.268534  2017 raft_consensus.cc:2272] T 96bc1a24f8444cfb814aa8c10ef01dab P b30070db2c8d4c46a2aacc39bc51ab36 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.270578  2017 tablet_replica.cc:333] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36: stopping tablet replica
I20260709 12:12:50.271114  2017 raft_consensus.cc:2243] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.271595  2017 raft_consensus.cc:2272] T 99e249a3c8c146fb86d0b1048e967844 P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.273346  2017 tablet_replica.cc:333] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36: stopping tablet replica
I20260709 12:12:50.273871  2017 raft_consensus.cc:2243] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.274292  2017 raft_consensus.cc:2272] T 60d3336ce82a4b1aa8eb217aaa4c7176 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.275991  2017 tablet_replica.cc:333] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36: stopping tablet replica
I20260709 12:12:50.276610  2017 raft_consensus.cc:2243] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.277415  2017 raft_consensus.cc:2272] T 32a793bd6df44220aaed160471a0198f P b30070db2c8d4c46a2aacc39bc51ab36 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.279397  2017 tablet_replica.cc:333] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36: stopping tablet replica
I20260709 12:12:50.280000  2017 raft_consensus.cc:2243] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.280755  2017 raft_consensus.cc:2272] T c6d906bc94b54bfda3a742a515c05699 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.282393  2017 tablet_replica.cc:333] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36: stopping tablet replica
I20260709 12:12:50.282879  2017 raft_consensus.cc:2243] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.283290  2017 raft_consensus.cc:2272] T e9bcc63c80664ecf99de6fc5a115d80d P b30070db2c8d4c46a2aacc39bc51ab36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.285060  2017 tablet_replica.cc:333] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36: stopping tablet replica
I20260709 12:12:50.285569  2017 raft_consensus.cc:2243] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.286010  2017 raft_consensus.cc:2272] T eb9b3f46e2cd49679ad709634ac77a41 P b30070db2c8d4c46a2aacc39bc51ab36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.287756  2017 tablet_replica.cc:333] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36: stopping tablet replica
I20260709 12:12:50.288229  2017 raft_consensus.cc:2243] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.288964  2017 raft_consensus.cc:2272] T 5005068313154497a22c8761927949e5 P b30070db2c8d4c46a2aacc39bc51ab36 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.290889  2017 tablet_replica.cc:333] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36: stopping tablet replica
I20260709 12:12:50.291368  2017 raft_consensus.cc:2243] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.291878  2017 raft_consensus.cc:2272] T 566b99119aa94c7bb444d163f417b831 P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.293527  2017 tablet_replica.cc:333] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36: stopping tablet replica
I20260709 12:12:50.293983  2017 raft_consensus.cc:2243] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.294416  2017 raft_consensus.cc:2272] T 3765c69b4297441fbd0304c3dfdf6635 P b30070db2c8d4c46a2aacc39bc51ab36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.325500  2017 tablet_server.cc:196] TabletServer@127.1.248.67:0 shutdown complete.
I20260709 12:12:50.349458  2017 master.cc:562] Master@127.1.248.126:36437 shutting down...
I20260709 12:12:50.378360  2017 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.378991  2017 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.379347  2017 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5e5f9e83ab294aa4843dfb1dfd0f26d7: stopping tablet replica
I20260709 12:12:50.398412  2017 master.cc:584] Master@127.1.248.126:36437 shutdown complete.
5493f6a9c443455284b04b39cc617dd7  4
82fd5d4063fd4870b05dfbf9a1407de8  5
b30070db2c8d4c46a2aacc39bc51ab36  1
5493f6a9c443455284b04b39cc617dd7  4
82fd5d4063fd4870b05dfbf9a1407de8  3
b30070db2c8d4c46a2aacc39bc51ab36  3
5493f6a9c443455284b04b39cc617dd7  1
82fd5d4063fd4870b05dfbf9a1407de8  8
b30070db2c8d4c46a2aacc39bc51ab36  1
5493f6a9c443455284b04b39cc617dd7  3
82fd5d4063fd4870b05dfbf9a1407de8  4
b30070db2c8d4c46a2aacc39bc51ab36  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29859 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:12:50.441411  2017 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.248.126:35191
I20260709 12:12:50.442570  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:50.448378  3066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:50.448714  3067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:50.449908  2017 server_base.cc:1061] running on GCE node
W20260709 12:12:50.449950  3069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:50.451225  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:50.451481  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:50.451653  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599170451637 us; error 0 us; skew 500 ppm
I20260709 12:12:50.452319  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:50.454988  2017 webserver.cc:533] Webserver started at http://127.1.248.126:44071/ using document root <none> and password file <none>
I20260709 12:12:50.455562  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:50.455756  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:50.456056  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:50.457214  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/master-0-root/instance:
uuid: "a718949aeb634dbb80222dbb0804b0c4"
format_stamp: "Formatted at 2026-07-09 12:12:50 on dist-test-slave-z9f9"
I20260709 12:12:50.462097  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:50.466188  3074 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.467036  2017 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:12:50.467352  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/master-0-root
uuid: "a718949aeb634dbb80222dbb0804b0c4"
format_stamp: "Formatted at 2026-07-09 12:12:50 on dist-test-slave-z9f9"
I20260709 12:12:50.467738  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:50.497773  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:50.499042  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:50.539733  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.126:35191
I20260709 12:12:50.539898  3125 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.126:35191 every 8 connection(s)
I20260709 12:12:50.545441  3126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.555941  3126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4: Bootstrap starting.
I20260709 12:12:50.560868  3126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.565430  3126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4: No bootstrap required, opened a new log
I20260709 12:12:50.567991  3126 raft_consensus.cc:359] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a718949aeb634dbb80222dbb0804b0c4" member_type: VOTER }
I20260709 12:12:50.568437  3126 raft_consensus.cc:385] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.568714  3126 raft_consensus.cc:740] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a718949aeb634dbb80222dbb0804b0c4, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.569342  3126 consensus_queue.cc:260] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a718949aeb634dbb80222dbb0804b0c4" member_type: VOTER }
I20260709 12:12:50.569892  3126 raft_consensus.cc:399] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:50.570109  3126 raft_consensus.cc:493] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:50.570420  3126 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.575043  3126 raft_consensus.cc:515] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a718949aeb634dbb80222dbb0804b0c4" member_type: VOTER }
I20260709 12:12:50.575592  3126 leader_election.cc:304] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a718949aeb634dbb80222dbb0804b0c4; no voters: 
I20260709 12:12:50.576766  3126 leader_election.cc:290] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:50.577278  3129 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.578883  3129 raft_consensus.cc:697] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [term 1 LEADER]: Becoming Leader. State: Replica: a718949aeb634dbb80222dbb0804b0c4, State: Running, Role: LEADER
I20260709 12:12:50.579734  3126 sys_catalog.cc:565] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:50.579732  3129 consensus_queue.cc:237] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a718949aeb634dbb80222dbb0804b0c4" member_type: VOTER }
I20260709 12:12:50.585860  3130 sys_catalog.cc:455] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a718949aeb634dbb80222dbb0804b0c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a718949aeb634dbb80222dbb0804b0c4" member_type: VOTER } }
I20260709 12:12:50.586020  3131 sys_catalog.cc:455] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a718949aeb634dbb80222dbb0804b0c4. Latest consensus state: current_term: 1 leader_uuid: "a718949aeb634dbb80222dbb0804b0c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a718949aeb634dbb80222dbb0804b0c4" member_type: VOTER } }
I20260709 12:12:50.586793  3131 sys_catalog.cc:458] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:50.586736  3130 sys_catalog.cc:458] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:50.589197  3138 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:50.594197  3138 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:50.596653  2017 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:50.603783  3138 catalog_manager.cc:1383] Generated new cluster ID: 3a8d79e998d14f3b9c85d779aef4fc40
I20260709 12:12:50.604133  3138 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:50.618727  3138 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:50.620069  3138 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:50.631062  3138 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4: Generated new TSK 0
I20260709 12:12:50.631706  3138 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:50.663105  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:50.670256  3147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:50.671978  3148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:50.674232  2017 server_base.cc:1061] running on GCE node
W20260709 12:12:50.674655  3150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:50.675710  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:50.675953  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:50.676129  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599170676109 us; error 0 us; skew 500 ppm
I20260709 12:12:50.676764  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:50.679368  2017 webserver.cc:533] Webserver started at http://127.1.248.65:40077/ using document root <none> and password file <none>
I20260709 12:12:50.679939  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:50.680153  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:50.680431  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:50.681668  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/instance:
uuid: "7ac63b674f204bc4805ab989f8c965d3"
format_stamp: "Formatted at 2026-07-09 12:12:50 on dist-test-slave-z9f9"
I20260709 12:12:50.686399  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:12:50.690263  3155 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.691335  2017 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:12:50.691756  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root
uuid: "7ac63b674f204bc4805ab989f8c965d3"
format_stamp: "Formatted at 2026-07-09 12:12:50 on dist-test-slave-z9f9"
I20260709 12:12:50.692121  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:50.707705  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:50.709084  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:50.710768  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:50.713418  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:50.713696  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.713967  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:50.714190  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.760056  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.65:44889
I20260709 12:12:50.760192  3217 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.65:44889 every 8 connection(s)
I20260709 12:12:50.764843  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:50.773003  3222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:50.774864  3223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:50.777366  2017 server_base.cc:1061] running on GCE node
W20260709 12:12:50.778831  3225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:50.780210  3218 heartbeater.cc:344] Connected to a master server at 127.1.248.126:35191
I20260709 12:12:50.780248  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:50.780855  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:50.780881  3218 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:50.781404  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599170781375 us; error 0 us; skew 500 ppm
I20260709 12:12:50.782251  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:50.782207  3218 heartbeater.cc:507] Master 127.1.248.126:35191 requested a full tablet report, sending...
I20260709 12:12:50.785003  3091 ts_manager.cc:194] Registered new tserver with Master: 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:12:50.785496  2017 webserver.cc:533] Webserver started at http://127.1.248.66:37971/ using document root <none> and password file <none>
I20260709 12:12:50.786074  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:50.786320  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:50.786617  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:50.787056  3091 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48764
I20260709 12:12:50.788118  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/instance:
uuid: "1ef05c9d901046dca7fe0e638cc693b9"
format_stamp: "Formatted at 2026-07-09 12:12:50 on dist-test-slave-z9f9"
I20260709 12:12:50.793395  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:12:50.804527  3230 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.805627  2017 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.002s	sys 0.000s
I20260709 12:12:50.806011  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root
uuid: "1ef05c9d901046dca7fe0e638cc693b9"
format_stamp: "Formatted at 2026-07-09 12:12:50 on dist-test-slave-z9f9"
I20260709 12:12:50.806409  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:50.824664  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:50.826115  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:50.827694  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:50.830183  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:50.830430  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.830681  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:50.830857  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.871824  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.66:38853
I20260709 12:12:50.871942  3292 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.66:38853 every 8 connection(s)
I20260709 12:12:50.876648  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:50.885358  3297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:50.885424  3296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:50.889433  2017 server_base.cc:1061] running on GCE node
W20260709 12:12:50.889376  3299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:50.890046  3293 heartbeater.cc:344] Connected to a master server at 127.1.248.126:35191
I20260709 12:12:50.890545  3293 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:50.890828  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:50.891098  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:50.891297  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599170891279 us; error 0 us; skew 500 ppm
I20260709 12:12:50.891453  3293 heartbeater.cc:507] Master 127.1.248.126:35191 requested a full tablet report, sending...
I20260709 12:12:50.892131  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:50.894129  3091 ts_manager.cc:194] Registered new tserver with Master: 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:50.895100  2017 webserver.cc:533] Webserver started at http://127.1.248.67:34955/ using document root <none> and password file <none>
I20260709 12:12:50.895787  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:50.896025  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:50.896073  3091 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48778
I20260709 12:12:50.896418  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:50.897836  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/instance:
uuid: "eb49d92feeb14382b3baa49d696b6141"
format_stamp: "Formatted at 2026-07-09 12:12:50 on dist-test-slave-z9f9"
I20260709 12:12:50.902700  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:50.906103  3304 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.907008  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:50.907321  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root
uuid: "eb49d92feeb14382b3baa49d696b6141"
format_stamp: "Formatted at 2026-07-09 12:12:50 on dist-test-slave-z9f9"
I20260709 12:12:50.907680  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:50.939088  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:50.940390  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:50.941808  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:50.944267  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:50.944574  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.944898  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:50.945108  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.988482  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.67:35301
I20260709 12:12:50.988607  3366 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.67:35301 every 8 connection(s)
I20260709 12:12:51.004976  3367 heartbeater.cc:344] Connected to a master server at 127.1.248.126:35191
I20260709 12:12:51.005609  3367 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:51.006561  3367 heartbeater.cc:507] Master 127.1.248.126:35191 requested a full tablet report, sending...
I20260709 12:12:51.009341  3091 ts_manager.cc:194] Registered new tserver with Master: eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:51.009647  2017 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017962244s
I20260709 12:12:51.011524  3091 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48786
I20260709 12:12:51.039783  3091 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48794:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:51.046633  3091 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:51.272691  3258 tablet_service.cc:1511] Processing CreateTablet for tablet 72176593f52b48c28602984ef9c8ee6b (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:51.274205  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72176593f52b48c28602984ef9c8ee6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.274718  3332 tablet_service.cc:1511] Processing CreateTablet for tablet 72176593f52b48c28602984ef9c8ee6b (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:51.276059  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72176593f52b48c28602984ef9c8ee6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.276872  3328 tablet_service.cc:1511] Processing CreateTablet for tablet 51ff9b5ea5944e51914ded65407b153b (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:51.278276  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ff9b5ea5944e51914ded65407b153b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.280601  3331 tablet_service.cc:1511] Processing CreateTablet for tablet 34a1a5138f6d495dbacdde8c4b4dd898 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:51.281950  3331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a1a5138f6d495dbacdde8c4b4dd898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.284643  3330 tablet_service.cc:1511] Processing CreateTablet for tablet 37160a9f5c0a4847b38b9c87a80891de (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:51.286054  3330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37160a9f5c0a4847b38b9c87a80891de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.288806  3329 tablet_service.cc:1511] Processing CreateTablet for tablet f0fc559f70f94ad8b2da50624147942a (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:51.290354  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0fc559f70f94ad8b2da50624147942a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.291531  3327 tablet_service.cc:1511] Processing CreateTablet for tablet b9471f19ecb64571bc899936c896d99f (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:51.293128  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9471f19ecb64571bc899936c896d99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.293954  3324 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee459e79aec45909d356d039c69e72c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:51.294888  3326 tablet_service.cc:1511] Processing CreateTablet for tablet afca51be89bf4a7681690f9913aa6f82 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:51.295748  3324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee459e79aec45909d356d039c69e72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.299158  3325 tablet_service.cc:1511] Processing CreateTablet for tablet c34244f67d5045c49554e8a2ce27891d (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:51.300033  3257 tablet_service.cc:1511] Processing CreateTablet for tablet 34a1a5138f6d495dbacdde8c4b4dd898 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:51.301139  3326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afca51be89bf4a7681690f9913aa6f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.301546  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a1a5138f6d495dbacdde8c4b4dd898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.303889  3325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34244f67d5045c49554e8a2ce27891d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.304647  3323 tablet_service.cc:1511] Processing CreateTablet for tablet c79ed88d91bd49d4a95c3eb59fb97a63 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:51.305971  3323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79ed88d91bd49d4a95c3eb59fb97a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.312819  3256 tablet_service.cc:1511] Processing CreateTablet for tablet 37160a9f5c0a4847b38b9c87a80891de (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:51.314924  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37160a9f5c0a4847b38b9c87a80891de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.316936  3255 tablet_service.cc:1511] Processing CreateTablet for tablet f0fc559f70f94ad8b2da50624147942a (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:51.318392  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0fc559f70f94ad8b2da50624147942a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.320717  3254 tablet_service.cc:1511] Processing CreateTablet for tablet 51ff9b5ea5944e51914ded65407b153b (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:51.322218  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ff9b5ea5944e51914ded65407b153b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.324867  3253 tablet_service.cc:1511] Processing CreateTablet for tablet b9471f19ecb64571bc899936c896d99f (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:51.326339  3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9471f19ecb64571bc899936c896d99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.326023  3325 tablet_service.cc:1511] Processing CreateTablet for tablet a85351bf981e43bea61620452a2c7b3a (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:51.327286  3325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85351bf981e43bea61620452a2c7b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.328632  3252 tablet_service.cc:1511] Processing CreateTablet for tablet afca51be89bf4a7681690f9913aa6f82 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:51.330049  3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afca51be89bf4a7681690f9913aa6f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.331494  3183 tablet_service.cc:1511] Processing CreateTablet for tablet 72176593f52b48c28602984ef9c8ee6b (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:51.332844  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72176593f52b48c28602984ef9c8ee6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.332662  3251 tablet_service.cc:1511] Processing CreateTablet for tablet c34244f67d5045c49554e8a2ce27891d (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:51.333995  3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34244f67d5045c49554e8a2ce27891d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.335023  3182 tablet_service.cc:1511] Processing CreateTablet for tablet 34a1a5138f6d495dbacdde8c4b4dd898 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:51.335930  3326 tablet_service.cc:1511] Processing CreateTablet for tablet 7a515efb7c674e9997a33098bc2d7002 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:51.336196  3180 tablet_service.cc:1511] Processing CreateTablet for tablet f0fc559f70f94ad8b2da50624147942a (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:51.336652  3250 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee459e79aec45909d356d039c69e72c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:51.337435  3326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a515efb7c674e9997a33098bc2d7002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.337325  3181 tablet_service.cc:1511] Processing CreateTablet for tablet 37160a9f5c0a4847b38b9c87a80891de (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:51.337951  3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee459e79aec45909d356d039c69e72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.339092  3179 tablet_service.cc:1511] Processing CreateTablet for tablet 51ff9b5ea5944e51914ded65407b153b (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:51.340693  3249 tablet_service.cc:1511] Processing CreateTablet for tablet c79ed88d91bd49d4a95c3eb59fb97a63 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:51.342058  3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79ed88d91bd49d4a95c3eb59fb97a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.343791  3177 tablet_service.cc:1511] Processing CreateTablet for tablet afca51be89bf4a7681690f9913aa6f82 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:51.342052  3178 tablet_service.cc:1511] Processing CreateTablet for tablet b9471f19ecb64571bc899936c896d99f (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:51.345806  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a1a5138f6d495dbacdde8c4b4dd898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.347796  3179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ff9b5ea5944e51914ded65407b153b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.352025  3180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0fc559f70f94ad8b2da50624147942a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.355841  3178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9471f19ecb64571bc899936c896d99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.359879  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37160a9f5c0a4847b38b9c87a80891de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.363839  3177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afca51be89bf4a7681690f9913aa6f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.416738  3175 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee459e79aec45909d356d039c69e72c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:51.418186  3175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee459e79aec45909d356d039c69e72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.449878  3176 tablet_service.cc:1511] Processing CreateTablet for tablet c34244f67d5045c49554e8a2ce27891d (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:51.462247  3176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34244f67d5045c49554e8a2ce27891d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.491189  3383 tablet_bootstrap.cc:492] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:51.495692  3326 tablet_service.cc:1511] Processing CreateTablet for tablet a10fd7fda53e4a8ea272336588c66980 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:51.497265  3326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10fd7fda53e4a8ea272336588c66980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.509542  3174 tablet_service.cc:1511] Processing CreateTablet for tablet c79ed88d91bd49d4a95c3eb59fb97a63 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:51.502439  3251 tablet_service.cc:1511] Processing CreateTablet for tablet a85351bf981e43bea61620452a2c7b3a (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:51.509586  3382 tablet_bootstrap.cc:492] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:51.511353  3328 tablet_service.cc:1511] Processing CreateTablet for tablet 57d85bc226d34560b470d2d44e89c8cc (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:51.521107  3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85351bf981e43bea61620452a2c7b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.532727  3174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79ed88d91bd49d4a95c3eb59fb97a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.537096  3330 tablet_service.cc:1511] Processing CreateTablet for tablet 57c6fad3865d45a1b0c364058f3550b4 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:51.552196  3252 tablet_service.cc:1511] Processing CreateTablet for tablet 7a515efb7c674e9997a33098bc2d7002 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:51.553324  3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a515efb7c674e9997a33098bc2d7002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.555415  3324 tablet_service.cc:1511] Processing CreateTablet for tablet f904cee1d1e04a36bc93a9dcf405d9a8 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:51.560529  3183 tablet_service.cc:1511] Processing CreateTablet for tablet a85351bf981e43bea61620452a2c7b3a (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:51.562096  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85351bf981e43bea61620452a2c7b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.564489  3178 tablet_service.cc:1511] Processing CreateTablet for tablet 7a515efb7c674e9997a33098bc2d7002 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:51.565860  3178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a515efb7c674e9997a33098bc2d7002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.527109  3329 tablet_service.cc:1511] Processing CreateTablet for tablet e227a6b3f36540848b2525ba007e6a35 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:51.526614  3325 tablet_service.cc:1511] Processing CreateTablet for tablet ea1a64c911894ce08c1622f9307ed513 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:51.577936  3384 tablet_bootstrap.cc:492] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:51.571419  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d85bc226d34560b470d2d44e89c8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.581638  3258 tablet_service.cc:1511] Processing CreateTablet for tablet a10fd7fda53e4a8ea272336588c66980 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:51.583292  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10fd7fda53e4a8ea272336588c66980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.591105  3384 tablet_bootstrap.cc:654] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.585268  3249 tablet_service.cc:1511] Processing CreateTablet for tablet 57d85bc226d34560b470d2d44e89c8cc (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:51.592373  3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d85bc226d34560b470d2d44e89c8cc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:51.592581  3139 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:51.586946  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e227a6b3f36540848b2525ba007e6a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.596143  3180 tablet_service.cc:1511] Processing CreateTablet for tablet a10fd7fda53e4a8ea272336588c66980 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:51.597456  3180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10fd7fda53e4a8ea272336588c66980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.599778  3325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea1a64c911894ce08c1622f9307ed513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.603787  3324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f904cee1d1e04a36bc93a9dcf405d9a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.604243  3327 tablet_service.cc:1511] Processing CreateTablet for tablet c7482671d98f47899c1d11f810abadb7 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:51.606452  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7482671d98f47899c1d11f810abadb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.608603  3330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c6fad3865d45a1b0c364058f3550b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.608125  3383 tablet_bootstrap.cc:654] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.617576  3254 tablet_service.cc:1511] Processing CreateTablet for tablet ea1a64c911894ce08c1622f9307ed513 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:51.618973  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea1a64c911894ce08c1622f9307ed513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.608078  3182 tablet_service.cc:1511] Processing CreateTablet for tablet 57d85bc226d34560b470d2d44e89c8cc (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:51.624825  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d85bc226d34560b470d2d44e89c8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.625092  3382 tablet_bootstrap.cc:654] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.633579  3179 tablet_service.cc:1511] Processing CreateTablet for tablet ea1a64c911894ce08c1622f9307ed513 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:51.634945  3179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea1a64c911894ce08c1622f9307ed513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.636008  3331 tablet_service.cc:1511] Processing CreateTablet for tablet 49089e729c0f4f37b66d40abf2e3cfe6 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:51.637311  3331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49089e729c0f4f37b66d40abf2e3cfe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.637887  3253 tablet_service.cc:1511] Processing CreateTablet for tablet e227a6b3f36540848b2525ba007e6a35 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:51.639158  3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e227a6b3f36540848b2525ba007e6a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.654176  3252 tablet_service.cc:1511] Processing CreateTablet for tablet 57c6fad3865d45a1b0c364058f3550b4 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:51.660312  3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c6fad3865d45a1b0c364058f3550b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.677858  3329 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4e9fd123b2418a86c69f2894fd2f4f (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:51.679625  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4e9fd123b2418a86c69f2894fd2f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.689926  3383 tablet_bootstrap.cc:492] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:51.690454  3383 ts_tablet_manager.cc:1403] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.200s	user 0.016s	sys 0.000s
I20260709 12:12:51.693557  3383 raft_consensus.cc:359] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } }
I20260709 12:12:51.694391  3383 raft_consensus.cc:385] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.694835  3383 raft_consensus.cc:740] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.702613  3256 tablet_service.cc:1511] Processing CreateTablet for tablet 49089e729c0f4f37b66d40abf2e3cfe6 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:51.703394  3383 consensus_queue.cc:260] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } }
I20260709 12:12:51.696306  3257 tablet_service.cc:1511] Processing CreateTablet for tablet f904cee1d1e04a36bc93a9dcf405d9a8 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:51.711599  3249 tablet_service.cc:1511] Processing CreateTablet for tablet c7482671d98f47899c1d11f810abadb7 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:51.714457  3176 tablet_service.cc:1511] Processing CreateTablet for tablet e227a6b3f36540848b2525ba007e6a35 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:51.716039  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49089e729c0f4f37b66d40abf2e3cfe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.716354  3176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e227a6b3f36540848b2525ba007e6a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.724027  3332 tablet_service.cc:1511] Processing CreateTablet for tablet 94318f741f4143469cf9140cb1be3c4c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:51.725468  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94318f741f4143469cf9140cb1be3c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.731366  3323 tablet_service.cc:1511] Processing CreateTablet for tablet 0d98324eb9764f8e9470a5c111b82bb1 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:51.740931  3384 tablet_bootstrap.cc:492] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:51.755537  3384 ts_tablet_manager.cc:1403] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.178s	user 0.014s	sys 0.019s
I20260709 12:12:51.758507  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f904cee1d1e04a36bc93a9dcf405d9a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.755594  3323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d98324eb9764f8e9470a5c111b82bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.761595  3251 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd9302593554fbabfffed2fd5ca4443 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:51.755786  3250 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4e9fd123b2418a86c69f2894fd2f4f (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:51.755864  3252 tablet_service.cc:1511] Processing CreateTablet for tablet 94318f741f4143469cf9140cb1be3c4c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:51.756853  3382 tablet_bootstrap.cc:492] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:51.757277  3258 tablet_service.cc:1511] Processing CreateTablet for tablet 0d98324eb9764f8e9470a5c111b82bb1 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:51.745728  3180 tablet_service.cc:1511] Processing CreateTablet for tablet 49089e729c0f4f37b66d40abf2e3cfe6 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:51.764746  3382 ts_tablet_manager.cc:1403] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.256s	user 0.018s	sys 0.024s
I20260709 12:12:51.765246  3181 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd9302593554fbabfffed2fd5ca4443 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:51.766335  3180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49089e729c0f4f37b66d40abf2e3cfe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.748441  3179 tablet_service.cc:1511] Processing CreateTablet for tablet c7482671d98f47899c1d11f810abadb7 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:51.770721  3382 raft_consensus.cc:359] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:51.771492  3382 raft_consensus.cc:385] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.750676  3177 tablet_service.cc:1511] Processing CreateTablet for tablet f904cee1d1e04a36bc93a9dcf405d9a8 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:51.746775  3328 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd9302593554fbabfffed2fd5ca4443 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:51.772622  3177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f904cee1d1e04a36bc93a9dcf405d9a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.772890  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd9302593554fbabfffed2fd5ca4443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.754175  3174 tablet_service.cc:1511] Processing CreateTablet for tablet 5a33bf1d7b914771971f31da16c86c31 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:51.775629  3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd9302593554fbabfffed2fd5ca4443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.776199  3174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a33bf1d7b914771971f31da16c86c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.733997  3175 tablet_service.cc:1511] Processing CreateTablet for tablet 57c6fad3865d45a1b0c364058f3550b4 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:51.775087  3384 raft_consensus.cc:359] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:51.779202  3255 tablet_service.cc:1511] Processing CreateTablet for tablet b974e8909e0b47e2bd4e0d28fbafe975 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:51.779764  3384 raft_consensus.cc:385] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.780196  3175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c6fad3865d45a1b0c364058f3550b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.780205  3384 raft_consensus.cc:740] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.780520  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b974e8909e0b47e2bd4e0d28fbafe975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.781486  3384 consensus_queue.cc:260] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:51.767408  3324 tablet_service.cc:1511] Processing CreateTablet for tablet b974e8909e0b47e2bd4e0d28fbafe975 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:51.788952  3324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b974e8909e0b47e2bd4e0d28fbafe975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.789857  3218 heartbeater.cc:499] Master 127.1.248.126:35191 was elected leader, sending a full tablet report...
I20260709 12:12:51.792150  3183 tablet_service.cc:1511] Processing CreateTablet for tablet 94318f741f4143469cf9140cb1be3c4c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:51.785108  3329 tablet_service.cc:1511] Processing CreateTablet for tablet eb7809b208b14a549539330993804c34 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:51.793447  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94318f741f4143469cf9140cb1be3c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.793599  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7809b208b14a549539330993804c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.780535  3326 tablet_service.cc:1511] Processing CreateTablet for tablet 5a33bf1d7b914771971f31da16c86c31 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:51.796309  3382 raft_consensus.cc:740] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.806411  3179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7482671d98f47899c1d11f810abadb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.806865  3382 consensus_queue.cc:260] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:51.811710  3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94318f741f4143469cf9140cb1be3c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.815621  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d98324eb9764f8e9470a5c111b82bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.828527  3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7482671d98f47899c1d11f810abadb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.846850  3327 tablet_service.cc:1511] Processing CreateTablet for tablet f72e701fa9c047c59371e2759c4303ab (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:51.855928  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd9302593554fbabfffed2fd5ca4443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.866482  3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4e9fd123b2418a86c69f2894fd2f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.884264  3390 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.884387  3367 heartbeater.cc:499] Master 127.1.248.126:35191 was elected leader, sending a full tablet report...
I20260709 12:12:51.884861  3390 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:51.895941  3390 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:51.899047  3293 heartbeater.cc:499] Master 127.1.248.126:35191 was elected leader, sending a full tablet report...
I20260709 12:12:51.900238  3384 ts_tablet_manager.cc:1434] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.142s	user 0.031s	sys 0.020s
I20260709 12:12:51.901234  3384 tablet_bootstrap.cc:492] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:51.874987  3326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a33bf1d7b914771971f31da16c86c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.911819  3177 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4e9fd123b2418a86c69f2894fd2f4f (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:51.913578  3177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4e9fd123b2418a86c69f2894fd2f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.916121  3251 tablet_service.cc:1511] Processing CreateTablet for tablet eb7809b208b14a549539330993804c34 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:51.917497  3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7809b208b14a549539330993804c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.923123  3384 tablet_bootstrap.cc:654] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.926327  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72e701fa9c047c59371e2759c4303ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.932056  3331 tablet_service.cc:1511] Processing CreateTablet for tablet 5e285af011d44cfc91bcd6499aa4c9f8 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:51.934114  3331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e285af011d44cfc91bcd6499aa4c9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.942353  3182 tablet_service.cc:1511] Processing CreateTablet for tablet 0d98324eb9764f8e9470a5c111b82bb1 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:51.899055  3254 tablet_service.cc:1511] Processing CreateTablet for tablet 5a33bf1d7b914771971f31da16c86c31 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:51.957139  3383 ts_tablet_manager.cc:1434] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.266s	user 0.004s	sys 0.037s
I20260709 12:12:51.958637  3382 ts_tablet_manager.cc:1434] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.193s	user 0.020s	sys 0.003s
W20260709 12:12:51.993086  3368 tablet.cc:2406] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:51.997022  3330 tablet_service.cc:1511] Processing CreateTablet for tablet 8c298faf2e6b4619a5c83569e86043e8 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:51.998790  3330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c298faf2e6b4619a5c83569e86043e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.007964  3383 tablet_bootstrap.cc:492] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:52.010926  3181 tablet_service.cc:1511] Processing CreateTablet for tablet b974e8909e0b47e2bd4e0d28fbafe975 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:52.015270  3323 tablet_service.cc:1511] Processing CreateTablet for tablet 9796736c241b42c283a7f6a433742bed (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:52.016759  3323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9796736c241b42c283a7f6a433742bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.019841  3325 tablet_service.cc:1511] Processing CreateTablet for tablet cab3ecc4f0b34068a804b174b02b9a16 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:52.020907  3253 tablet_service.cc:1511] Processing CreateTablet for tablet 5e285af011d44cfc91bcd6499aa4c9f8 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:52.021749  3325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab3ecc4f0b34068a804b174b02b9a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.022563  3332 tablet_service.cc:1511] Processing CreateTablet for tablet c85f3b72388e43eb9b3f81e8f5ba7385 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:52.023973  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85f3b72388e43eb9b3f81e8f5ba7385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.035567  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a33bf1d7b914771971f31da16c86c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.046162  3180 tablet_service.cc:1511] Processing CreateTablet for tablet eb7809b208b14a549539330993804c34 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:51.979322  3329 tablet_service.cc:1511] Processing CreateTablet for tablet 17a639dfba9c4cd98fcc0e73a3de49f9 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:52.048780  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a639dfba9c4cd98fcc0e73a3de49f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.049642  3176 tablet_service.cc:1511] Processing CreateTablet for tablet 5e285af011d44cfc91bcd6499aa4c9f8 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:52.056950  3178 tablet_service.cc:1511] Processing CreateTablet for tablet 17a639dfba9c4cd98fcc0e73a3de49f9 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:52.059669  3255 tablet_service.cc:1511] Processing CreateTablet for tablet f72e701fa9c047c59371e2759c4303ab (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:52.060364  3174 tablet_service.cc:1511] Processing CreateTablet for tablet f72e701fa9c047c59371e2759c4303ab (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:52.062110  3252 tablet_service.cc:1511] Processing CreateTablet for tablet 17a639dfba9c4cd98fcc0e73a3de49f9 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:52.064025  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72e701fa9c047c59371e2759c4303ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.064674  3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a639dfba9c4cd98fcc0e73a3de49f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.065539  3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e285af011d44cfc91bcd6499aa4c9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.076800  3388 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.077421  3388 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } }
I20260709 12:12:52.077670  3179 tablet_service.cc:1511] Processing CreateTablet for tablet c85f3b72388e43eb9b3f81e8f5ba7385 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:52.085036  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d98324eb9764f8e9470a5c111b82bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.059900  3175 tablet_service.cc:1511] Processing CreateTablet for tablet cab3ecc4f0b34068a804b174b02b9a16 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:52.113903  3388 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:52.114606  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:52.095544  3249 tablet_service.cc:1511] Processing CreateTablet for tablet 9796736c241b42c283a7f6a433742bed (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:52.096164  3256 tablet_service.cc:1511] Processing CreateTablet for tablet cab3ecc4f0b34068a804b174b02b9a16 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:52.099078  3384 tablet_bootstrap.cc:492] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:52.101648  3257 tablet_service.cc:1511] Processing CreateTablet for tablet 8c298faf2e6b4619a5c83569e86043e8 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:52.087145  3328 tablet_service.cc:1511] Processing CreateTablet for tablet 4338ede94a794c41ba16cba6ac585f9a (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:52.123027  3382 tablet_bootstrap.cc:492] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
W20260709 12:12:52.123581  3305 leader_election.cc:343] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.136013  3384 ts_tablet_manager.cc:1403] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.235s	user 0.021s	sys 0.024s
I20260709 12:12:52.125339  3324 tablet_service.cc:1511] Processing CreateTablet for tablet fb103e3ac0ca481bace4eb01f0725ae8 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:52.137580  3175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab3ecc4f0b34068a804b174b02b9a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.138124  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4338ede94a794c41ba16cba6ac585f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.140426  3178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a639dfba9c4cd98fcc0e73a3de49f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.141593  3323 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7c3fc93e9d456eb83867c8095af00c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:52.142917  3323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7c3fc93e9d456eb83867c8095af00c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.080806  3258 tablet_service.cc:1511] Processing CreateTablet for tablet c85f3b72388e43eb9b3f81e8f5ba7385 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:52.145545  3326 tablet_service.cc:1511] Processing CreateTablet for tablet 8939008df61a42b5ab6d01a5cc782e16 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:52.146667  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b974e8909e0b47e2bd4e0d28fbafe975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.146934  3326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8939008df61a42b5ab6d01a5cc782e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.139104  3384 raft_consensus.cc:359] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.151314  3384 raft_consensus.cc:385] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.151942  3324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb103e3ac0ca481bace4eb01f0725ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.153640  3327 tablet_service.cc:1511] Processing CreateTablet for tablet 90c20968bf7e4f29893d6df711ca41d1 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:52.154490  3330 tablet_service.cc:1511] Processing CreateTablet for tablet 132b388f4bf24fd482334847aadc601a (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:52.155117  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c20968bf7e4f29893d6df711ca41d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.152007  3384 raft_consensus.cc:740] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.161183  3332 tablet_service.cc:1511] Processing CreateTablet for tablet ebb8348062364c7c878da1d2999c325b (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:52.168272  3382 tablet_bootstrap.cc:654] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.151825  3174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72e701fa9c047c59371e2759c4303ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.170059  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab3ecc4f0b34068a804b174b02b9a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.191453  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb8348062364c7c878da1d2999c325b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.195983  3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9796736c241b42c283a7f6a433742bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.170609  3253 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7c3fc93e9d456eb83867c8095af00c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:52.171902  3389 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.173120  3251 tablet_service.cc:1511] Processing CreateTablet for tablet 4338ede94a794c41ba16cba6ac585f9a (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:52.175494  3254 tablet_service.cc:1511] Processing CreateTablet for tablet 8939008df61a42b5ab6d01a5cc782e16 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:52.175880  3250 tablet_service.cc:1511] Processing CreateTablet for tablet fb103e3ac0ca481bace4eb01f0725ae8 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:52.178362  3384 consensus_queue.cc:260] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.179800  3331 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7af9c2d6334c6f84aed4586a66d701 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:52.182942  3383 tablet_bootstrap.cc:654] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.183789  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:52.206296  3389 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.211486  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85f3b72388e43eb9b3f81e8f5ba7385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.213366  3176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e285af011d44cfc91bcd6499aa4c9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.211853  3330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132b388f4bf24fd482334847aadc601a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.224067  3389 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:52.179430  3183 tablet_service.cc:1511] Processing CreateTablet for tablet 9796736c241b42c283a7f6a433742bed (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:52.237088  3252 tablet_service.cc:1511] Processing CreateTablet for tablet 90c20968bf7e4f29893d6df711ca41d1 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 12:12:52.226215  3305 leader_election.cc:343] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.281865  3305 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:52.283743  3391 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:52.282953  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 63330.5us
I20260709 12:12:52.239652  3179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85f3b72388e43eb9b3f81e8f5ba7385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.248255  3329 tablet_service.cc:1511] Processing CreateTablet for tablet ac73674a60ce47a481b9d61f7e78e5f3 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:52.235137  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c298faf2e6b4619a5c83569e86043e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.262382  3331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7af9c2d6334c6f84aed4586a66d701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.274536  3324 tablet_service.cc:1511] Processing CreateTablet for tablet aa54c541b3454731ad51d4012eb0ad72 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:52.299722  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8939008df61a42b5ab6d01a5cc782e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.301201  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:52.303647  3157 leader_election.cc:343] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.307852  3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c20968bf7e4f29893d6df711ca41d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.309870  3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7c3fc93e9d456eb83867c8095af00c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.309707  3324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa54c541b3454731ad51d4012eb0ad72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.318504  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac73674a60ce47a481b9d61f7e78e5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.321110  3182 tablet_service.cc:1511] Processing CreateTablet for tablet 8c298faf2e6b4619a5c83569e86043e8 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:52.332719  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:52.333652  3255 tablet_service.cc:1511] Processing CreateTablet for tablet 132b388f4bf24fd482334847aadc601a (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:52.337899  3382 tablet_bootstrap.cc:492] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:52.337759  3178 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7c3fc93e9d456eb83867c8095af00c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:52.338491  3382 ts_tablet_manager.cc:1403] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.219s	user 0.010s	sys 0.006s
I20260709 12:12:52.338922  3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4338ede94a794c41ba16cba6ac585f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.339635  3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb103e3ac0ca481bace4eb01f0725ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.342119  3382 raft_consensus.cc:359] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.342953  3382 raft_consensus.cc:385] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.343087  3256 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7af9c2d6334c6f84aed4586a66d701 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:52.344699  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7af9c2d6334c6f84aed4586a66d701. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:52.352468  3156 leader_election.cc:343] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.353019  3156 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:52.354365  3388 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.352218  3175 tablet_service.cc:1511] Processing CreateTablet for tablet 4338ede94a794c41ba16cba6ac585f9a (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:52.356633  3326 tablet_service.cc:1511] Processing CreateTablet for tablet 5bb25fe7122b4568ac690e16b514ee7d (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:52.357895  3326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bb25fe7122b4568ac690e16b514ee7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.326361  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9796736c241b42c283a7f6a433742bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.359756  3325 tablet_service.cc:1511] Processing CreateTablet for tablet 68838261f2ca456f9b5583e60f9f3d2c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:52.359009  3180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7809b208b14a549539330993804c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.364537  3384 ts_tablet_manager.cc:1434] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.228s	user 0.011s	sys 0.007s
I20260709 12:12:52.347332  3174 tablet_service.cc:1511] Processing CreateTablet for tablet fb103e3ac0ca481bace4eb01f0725ae8 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:52.361038  3325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68838261f2ca456f9b5583e60f9f3d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.374295  3384 tablet_bootstrap.cc:492] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:52.379392  3400 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.380056  3400 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.382736  3400 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:52.388216  3249 tablet_service.cc:1511] Processing CreateTablet for tablet ebb8348062364c7c878da1d2999c325b (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:52.389671  3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb8348062364c7c878da1d2999c325b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.343300  3382 raft_consensus.cc:740] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.394791  3382 consensus_queue.cc:260] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.403203  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132b388f4bf24fd482334847aadc601a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.397342  3382 ts_tablet_manager.cc:1434] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.003s
I20260709 12:12:52.410073  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:52.411309  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:52.399295  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c298faf2e6b4619a5c83569e86043e8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:52.413106  3231 leader_election.cc:343] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:52.413764  3231 leader_election.cc:343] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.414497  3174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb103e3ac0ca481bace4eb01f0725ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.417732  3181 tablet_service.cc:1511] Processing CreateTablet for tablet 8939008df61a42b5ab6d01a5cc782e16 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:52.419067  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8939008df61a42b5ab6d01a5cc782e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.420420  3175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4338ede94a794c41ba16cba6ac585f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.426363  3177 tablet_service.cc:1511] Processing CreateTablet for tablet 90c20968bf7e4f29893d6df711ca41d1 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:52.427524  3178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7c3fc93e9d456eb83867c8095af00c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.440791  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:52.441565  3341 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:52.442618  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:52.443539  3383 tablet_bootstrap.cc:492] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:52.444424  3327 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa66ee25a6347bf8c52ec788a373117 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:52.444710  3232 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:52.445154  3383 ts_tablet_manager.cc:1403] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.438s	user 0.023s	sys 0.001s
I20260709 12:12:52.445905  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa66ee25a6347bf8c52ec788a373117. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:52.446030  3232 leader_election.cc:343] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.446532  3232 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:52.447317  3389 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.447633  3400 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.447702  3389 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.448259  3389 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.442833  3382 tablet_bootstrap.cc:492] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:52.441862  3257 tablet_service.cc:1511] Processing CreateTablet for tablet aa54c541b3454731ad51d4012eb0ad72 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:52.452692  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa54c541b3454731ad51d4012eb0ad72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.453785  3384 tablet_bootstrap.cc:654] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.455793  3177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c20968bf7e4f29893d6df711ca41d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.455602  3389 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.467783  3330 tablet_service.cc:1511] Processing CreateTablet for tablet 214d209d2c0940c1a4c43e368fff9e23 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:52.469419  3324 tablet_service.cc:1511] Processing CreateTablet for tablet c333bd40d0a34c96bb74838b3ea8986c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:52.469920  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:52.470396  3389 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:52.467084  3328 tablet_service.cc:1511] Processing CreateTablet for tablet 09cb299c977a476ab873860cf7e2a44c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:52.472502  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:12:52.471274  3231 leader_election.cc:343] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.473398  3382 tablet_bootstrap.cc:654] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.496449  3342 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.478739  3331 tablet_service.cc:1511] Processing CreateTablet for tablet 960fd01223d4443593561ba739ba7ec9 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:52.466763  3383 raft_consensus.cc:359] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.499600  3383 raft_consensus.cc:385] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.499928  3383 raft_consensus.cc:740] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.500705  3383 consensus_queue.cc:260] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.502912  3383 ts_tablet_manager.cc:1434] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.057s	user 0.000s	sys 0.004s
I20260709 12:12:52.487720  3250 tablet_service.cc:1511] Processing CreateTablet for tablet ac73674a60ce47a481b9d61f7e78e5f3 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:52.504247  3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac73674a60ce47a481b9d61f7e78e5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.505012  3342 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:52.506310  3232 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:52.507213  3400 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.512063  3383 tablet_bootstrap.cc:492] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:52.488557  3254 tablet_service.cc:1511] Processing CreateTablet for tablet 68838261f2ca456f9b5583e60f9f3d2c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:52.518925  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68838261f2ca456f9b5583e60f9f3d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.443475  3332 tablet_service.cc:1511] Processing CreateTablet for tablet 21a56ad7de6f43239e103edd8e2b159f (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:52.523545  3400 raft_consensus.cc:697] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:52.524562  3400 consensus_queue.cc:237] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.525667  3330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214d209d2c0940c1a4c43e368fff9e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.526531  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cb299c977a476ab873860cf7e2a44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.527102  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a56ad7de6f43239e103edd8e2b159f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.527726  3331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 960fd01223d4443593561ba739ba7ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.531606  3324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c333bd40d0a34c96bb74838b3ea8986c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.544998  3256 tablet_service.cc:1511] Processing CreateTablet for tablet 21a56ad7de6f43239e103edd8e2b159f (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:52.559224  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a56ad7de6f43239e103edd8e2b159f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.566655  3257 tablet_service.cc:1511] Processing CreateTablet for tablet 09cb299c977a476ab873860cf7e2a44c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:52.546329  3183 tablet_service.cc:1511] Processing CreateTablet for tablet 132b388f4bf24fd482334847aadc601a (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:52.568142  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cb299c977a476ab873860cf7e2a44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.568486  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132b388f4bf24fd482334847aadc601a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.495700  3253 tablet_service.cc:1511] Processing CreateTablet for tablet 5bb25fe7122b4568ac690e16b514ee7d (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:52.552636  3174 tablet_service.cc:1511] Processing CreateTablet for tablet ac73674a60ce47a481b9d61f7e78e5f3 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:52.550858  3178 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7af9c2d6334c6f84aed4586a66d701 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:52.554391  3181 tablet_service.cc:1511] Processing CreateTablet for tablet aa54c541b3454731ad51d4012eb0ad72 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:52.557843  3327 tablet_service.cc:1511] Processing CreateTablet for tablet 53307990662b42ecae5100eb9bdb80b6 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:52.572914  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53307990662b42ecae5100eb9bdb80b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.573192  3384 tablet_bootstrap.cc:492] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:52.573707  3384 ts_tablet_manager.cc:1403] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.200s	user 0.008s	sys 0.003s
I20260709 12:12:52.552402  3089 catalog_manager.cc:5697] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.564733  3255 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa66ee25a6347bf8c52ec788a373117 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:52.570711  3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bb25fe7122b4568ac690e16b514ee7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.580538  3382 tablet_bootstrap.cc:492] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:52.581130  3382 ts_tablet_manager.cc:1403] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.139s	user 0.012s	sys 0.001s
I20260709 12:12:52.583855  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa66ee25a6347bf8c52ec788a373117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.584259  3382 raft_consensus.cc:359] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.585024  3382 raft_consensus.cc:385] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.585328  3382 raft_consensus.cc:740] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.586256  3382 consensus_queue.cc:260] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.589138  3382 ts_tablet_manager.cc:1434] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:52.590315  3382 tablet_bootstrap.cc:492] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:52.579003  3323 tablet_service.cc:1511] Processing CreateTablet for tablet 5f390a5a17da4b61aa47d48ea74bae91 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:52.580246  3249 tablet_service.cc:1511] Processing CreateTablet for tablet 214d209d2c0940c1a4c43e368fff9e23 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:52.593088  3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214d209d2c0940c1a4c43e368fff9e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.550132  3180 tablet_service.cc:1511] Processing CreateTablet for tablet ebb8348062364c7c878da1d2999c325b (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:52.594061  3384 raft_consensus.cc:359] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.594961  3384 raft_consensus.cc:385] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.570443  3174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac73674a60ce47a481b9d61f7e78e5f3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:52.596975  3139 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:52.598950  3180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb8348062364c7c878da1d2999c325b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.605001  3383 tablet_bootstrap.cc:654] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.608084  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa54c541b3454731ad51d4012eb0ad72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.608952  3323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f390a5a17da4b61aa47d48ea74bae91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.608875  3177 tablet_service.cc:1511] Processing CreateTablet for tablet 68838261f2ca456f9b5583e60f9f3d2c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:52.611574  3178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7af9c2d6334c6f84aed4586a66d701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.611660  3176 tablet_service.cc:1511] Processing CreateTablet for tablet 5bb25fe7122b4568ac690e16b514ee7d (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:52.612962  3177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68838261f2ca456f9b5583e60f9f3d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.617223  3179 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa66ee25a6347bf8c52ec788a373117 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:52.624647  3175 tablet_service.cc:1511] Processing CreateTablet for tablet 21a56ad7de6f43239e103edd8e2b159f (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:52.595309  3384 raft_consensus.cc:740] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.626065  3175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a56ad7de6f43239e103edd8e2b159f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.626842  3384 consensus_queue.cc:260] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.629707  3384 ts_tablet_manager.cc:1434] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 12:12:52.630844  3384 tablet_bootstrap.cc:492] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:52.640475  3176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bb25fe7122b4568ac690e16b514ee7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.642379  3179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa66ee25a6347bf8c52ec788a373117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.642652  3328 tablet_service.cc:1511] Processing CreateTablet for tablet e974711b37af4153b756b212bffc5915 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:52.644138  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e974711b37af4153b756b212bffc5915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.649633  3251 tablet_service.cc:1511] Processing CreateTablet for tablet c333bd40d0a34c96bb74838b3ea8986c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:52.651132  3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c333bd40d0a34c96bb74838b3ea8986c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.654067  3250 tablet_service.cc:1511] Processing CreateTablet for tablet 960fd01223d4443593561ba739ba7ec9 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:52.654912  3252 tablet_service.cc:1511] Processing CreateTablet for tablet 53307990662b42ecae5100eb9bdb80b6 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:52.661656  3383 tablet_bootstrap.cc:492] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:52.662391  3383 ts_tablet_manager.cc:1403] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.151s	user 0.011s	sys 0.001s
I20260709 12:12:52.666373  3258 tablet_service.cc:1511] Processing CreateTablet for tablet 5f390a5a17da4b61aa47d48ea74bae91 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:52.666960  3384 tablet_bootstrap.cc:654] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.669430  3382 tablet_bootstrap.cc:654] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.673460  3383 raft_consensus.cc:359] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.674201  3383 raft_consensus.cc:385] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.674476  3383 raft_consensus.cc:740] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.675303  3383 consensus_queue.cc:260] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.685950  3182 tablet_service.cc:1511] Processing CreateTablet for tablet 09cb299c977a476ab873860cf7e2a44c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:52.691629  3383 ts_tablet_manager.cc:1434] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 12:12:52.692714  3383 tablet_bootstrap.cc:492] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:52.676331  3324 tablet_service.cc:1511] Processing CreateTablet for tablet acb4310417b348518d7accdf0538e249 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:52.697801  3324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb4310417b348518d7accdf0538e249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.687326  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cb299c977a476ab873860cf7e2a44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.704975  3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 960fd01223d4443593561ba739ba7ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.704720  3249 tablet_service.cc:1511] Processing CreateTablet for tablet acb4310417b348518d7accdf0538e249 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:52.706252  3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb4310417b348518d7accdf0538e249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.713447  3255 tablet_service.cc:1511] Processing CreateTablet for tablet 21406a1677884f049da5c65f8f2ed5ff (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:52.718698  3327 tablet_service.cc:1511] Processing CreateTablet for tablet 21406a1677884f049da5c65f8f2ed5ff (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:52.720086  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21406a1677884f049da5c65f8f2ed5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.721205  3180 tablet_service.cc:1511] Processing CreateTablet for tablet 214d209d2c0940c1a4c43e368fff9e23 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:52.729362  3383 tablet_bootstrap.cc:654] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.731532  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f390a5a17da4b61aa47d48ea74bae91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.738535  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21406a1677884f049da5c65f8f2ed5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.744767  3183 tablet_service.cc:1511] Processing CreateTablet for tablet c333bd40d0a34c96bb74838b3ea8986c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:52.756312  3256 tablet_service.cc:1511] Processing CreateTablet for tablet e974711b37af4153b756b212bffc5915 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:52.757804  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e974711b37af4153b756b212bffc5915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.756338  3180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214d209d2c0940c1a4c43e368fff9e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.759666  3177 tablet_service.cc:1511] Processing CreateTablet for tablet 960fd01223d4443593561ba739ba7ec9 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:52.759955  3175 tablet_service.cc:1511] Processing CreateTablet for tablet 53307990662b42ecae5100eb9bdb80b6 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:52.761523  3175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53307990662b42ecae5100eb9bdb80b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.762944  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c333bd40d0a34c96bb74838b3ea8986c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.767968  3177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 960fd01223d4443593561ba739ba7ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.775682  3176 tablet_service.cc:1511] Processing CreateTablet for tablet 5f390a5a17da4b61aa47d48ea74bae91 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:52.777568  3176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f390a5a17da4b61aa47d48ea74bae91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.781730  3174 tablet_service.cc:1511] Processing CreateTablet for tablet e974711b37af4153b756b212bffc5915 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:52.757453  3254 tablet_service.cc:1511] Processing CreateTablet for tablet 8e46c8b6a4494f6d8742bb7ef609d94c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:52.791934  3182 tablet_service.cc:1511] Processing CreateTablet for tablet acb4310417b348518d7accdf0538e249 (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:52.802305  3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53307990662b42ecae5100eb9bdb80b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.808243  3328 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec2274893aa4cc087f9d4af8119b1ea (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:52.810182  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec2274893aa4cc087f9d4af8119b1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.812204  3332 tablet_service.cc:1511] Processing CreateTablet for tablet 8e46c8b6a4494f6d8742bb7ef609d94c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:52.813416  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e46c8b6a4494f6d8742bb7ef609d94c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.816322  3179 tablet_service.cc:1511] Processing CreateTablet for tablet 21406a1677884f049da5c65f8f2ed5ff (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:52.824275  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e46c8b6a4494f6d8742bb7ef609d94c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.805083  3174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e974711b37af4153b756b212bffc5915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.828332  3391 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.863917  3391 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.867070  3391 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:52.832422  3250 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec2274893aa4cc087f9d4af8119b1ea (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:52.842960  3181 tablet_service.cc:1511] Processing CreateTablet for tablet 8e46c8b6a4494f6d8742bb7ef609d94c (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:52.846864  3180 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec2274893aa4cc087f9d4af8119b1ea (DEFAULT_TABLE table=test-workload [id=a6badc6d9f0443c1be0688884bd03216]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:52.869256  3179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21406a1677884f049da5c65f8f2ed5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.871534  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:52.872063  3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec2274893aa4cc087f9d4af8119b1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.871534  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:52.885094  3382 tablet_bootstrap.cc:492] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:52.885664  3382 ts_tablet_manager.cc:1403] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.296s	user 0.053s	sys 0.069s
I20260709 12:12:52.887919  3268 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
W20260709 12:12:52.888402  3305 leader_election.cc:343] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.889170  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:52.890031  3391 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.890429  3391 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.890846  3391 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.902729  3384 tablet_bootstrap.cc:492] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:52.903275  3384 ts_tablet_manager.cc:1403] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.273s	user 0.031s	sys 0.040s
I20260709 12:12:52.889199  3382 raft_consensus.cc:359] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.903849  3382 raft_consensus.cc:385] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.905117  3382 raft_consensus.cc:740] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.906186  3384 raft_consensus.cc:359] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.907586  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e46c8b6a4494f6d8742bb7ef609d94c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.910233  3384 raft_consensus.cc:385] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.911085  3384 raft_consensus.cc:740] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.909977  3391 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.912078  3384 consensus_queue.cc:260] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.914405  3384 ts_tablet_manager.cc:1434] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 12:12:52.911074  3382 consensus_queue.cc:260] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.915577  3180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec2274893aa4cc087f9d4af8119b1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.919682  3388 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.919837  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb4310417b348518d7accdf0538e249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.922083  3391 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:52.926554  3384 tablet_bootstrap.cc:492] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:52.926854  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:52.927541  3268 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.931324  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:52.935446  3384 tablet_bootstrap.cc:654] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.920223  3388 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.939954  3388 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:52.940172  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:52.943674  3157 leader_election.cc:343] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.940037  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:12:52.945732  3156 leader_election.cc:343] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.946271  3156 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:52.949947  3382 ts_tablet_manager.cc:1434] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.064s	user 0.013s	sys 0.012s
I20260709 12:12:52.951165  3382 tablet_bootstrap.cc:492] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:52.958060  3382 tablet_bootstrap.cc:654] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.940608  3388 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.958928  3388 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.963011  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:12:52.964975  3156 leader_election.cc:343] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.970323  3383 tablet_bootstrap.cc:492] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:52.970954  3383 ts_tablet_manager.cc:1403] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.278s	user 0.012s	sys 0.006s
I20260709 12:12:52.974659  3383 raft_consensus.cc:359] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:52.981766  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:52.984483  3305 leader_election.cc:343] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.984555  3418 raft_consensus.cc:2749] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.985250  3383 raft_consensus.cc:385] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.982468  3388 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:52.988897  3384 tablet_bootstrap.cc:492] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
W20260709 12:12:52.988617  3157 leader_election.cc:343] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.997253  3384 ts_tablet_manager.cc:1403] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.000s
I20260709 12:12:52.997134  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:52.990531  3268 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:53.001293  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:53.002032  3384 raft_consensus.cc:359] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } }
I20260709 12:12:53.002707  3388 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.002884  3384 raft_consensus.cc:385] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.003310  3384 raft_consensus.cc:740] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.003060  3400 consensus_queue.cc:1048] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:52.997743  3383 raft_consensus.cc:740] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.006369  3383 consensus_queue.cc:260] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.010809  3383 ts_tablet_manager.cc:1434] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.004s
I20260709 12:12:53.011504  3417 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.011413  3384 consensus_queue.cc:260] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } }
I20260709 12:12:53.012570  3417 raft_consensus.cc:697] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:12:53.013520  3417 consensus_queue.cc:237] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.014104  3384 ts_tablet_manager.cc:1434] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:12:53.016834  3383 tablet_bootstrap.cc:492] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:53.017827  3384 tablet_bootstrap.cc:492] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:53.027311  3384 tablet_bootstrap.cc:654] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.033026  3383 tablet_bootstrap.cc:654] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.036372  3382 tablet_bootstrap.cc:492] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:53.040057  3382 ts_tablet_manager.cc:1403] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.089s	user 0.027s	sys 0.012s
I20260709 12:12:53.044341  3382 raft_consensus.cc:359] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.045325  3382 raft_consensus.cc:385] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.045671  3382 raft_consensus.cc:740] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.046767  3382 consensus_queue.cc:260] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.054044  3382 ts_tablet_manager.cc:1434] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:12:53.055907  3382 tablet_bootstrap.cc:492] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:53.057922  3091 catalog_manager.cc:5697] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:53.067247  3383 tablet_bootstrap.cc:492] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:53.067795  3383 ts_tablet_manager.cc:1403] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.005s
I20260709 12:12:53.069619  3382 tablet_bootstrap.cc:654] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.070353  3384 tablet_bootstrap.cc:492] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:53.070847  3384 ts_tablet_manager.cc:1403] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.013s
I20260709 12:12:53.074761  3417 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.075243  3417 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.078861  3417 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:53.079538  3383 raft_consensus.cc:359] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.080852  3383 raft_consensus.cc:385] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.081104  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:53.081420  3383 raft_consensus.cc:740] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.081110  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:53.076570  3384 raft_consensus.cc:359] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.083220  3384 raft_consensus.cc:385] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.083056  3192 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:53.087333  3305 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:53.089032  3417 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:53.089242  3305 leader_election.cc:343] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.085611  3384 raft_consensus.cc:740] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.083016  3383 consensus_queue.cc:260] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:12:53.090682  3231 consensus_peers.cc:597] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.089421  3417 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.092516  3417 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.094487  3383 ts_tablet_manager.cc:1434] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 12:12:53.095686  3383 tablet_bootstrap.cc:492] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:53.097976  3382 tablet_bootstrap.cc:492] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:53.090272  3384 consensus_queue.cc:260] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.098454  3382 ts_tablet_manager.cc:1403] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.003s
I20260709 12:12:53.100301  3384 ts_tablet_manager.cc:1434] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 12:12:53.103160  3383 tablet_bootstrap.cc:654] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.103917  3384 tablet_bootstrap.cc:492] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:53.101446  3382 raft_consensus.cc:359] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.109479  3382 raft_consensus.cc:385] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.109925  3382 raft_consensus.cc:740] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.111117  3388 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.110797  3382 consensus_queue.cc:260] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.111666  3388 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.113962  3384 tablet_bootstrap.cc:654] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.116120  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:53.111707  3417 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.116797  3268 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:53.117208  3382 ts_tablet_manager.cc:1434] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:12:53.118256  3156 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:53.119133  3418 raft_consensus.cc:2804] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.119174  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:53.119696  3418 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.119863  3192 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.120113  3418 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.120152  3388 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.118253  3382 tablet_bootstrap.cc:492] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:53.121073  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:12:53.122579  3305 leader_election.cc:343] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.123140  3417 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:53.125478  3383 tablet_bootstrap.cc:492] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:53.131795  3425 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.131953  3383 ts_tablet_manager.cc:1403] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.009s
I20260709 12:12:53.132326  3425 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.134737  3425 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.135643  3383 raft_consensus.cc:359] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.131379  3382 tablet_bootstrap.cc:654] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.135943  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:53.136556  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:53.129153  3192 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:53.138211  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:53.139465  3384 tablet_bootstrap.cc:492] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
W20260709 12:12:53.139662  3231 leader_election.cc:343] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.142280  3341 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:53.142526  3384 ts_tablet_manager.cc:1403] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.010s
I20260709 12:12:53.140892  3305 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:12:53.137807  3383 raft_consensus.cc:385] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.143482  3383 raft_consensus.cc:740] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.144115  3232 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:53.144421  3383 consensus_queue.cc:260] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.145076  3425 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.144140  3417 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.145605  3425 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.145889  3417 raft_consensus.cc:697] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:12:53.146070  3425 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.145857  3384 raft_consensus.cc:359] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.147403  3384 raft_consensus.cc:385] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.147106  3417 consensus_queue.cc:237] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.147797  3384 raft_consensus.cc:740] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.148779  3384 consensus_queue.cc:260] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.153901  3384 ts_tablet_manager.cc:1434] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 12:12:53.139828  3342 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:53.150631  3383 ts_tablet_manager.cc:1434] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:12:53.156291  3383 tablet_bootstrap.cc:492] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:53.156463  3382 tablet_bootstrap.cc:492] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:53.157044  3382 ts_tablet_manager.cc:1403] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.000s
I20260709 12:12:53.156538  3425 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.157804  3384 tablet_bootstrap.cc:492] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:53.159883  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:12:53.164799  3231 leader_election.cc:343] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.160380  3382 raft_consensus.cc:359] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.161561  3425 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.162279  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:53.165489  3382 raft_consensus.cc:385] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.165941  3382 raft_consensus.cc:740] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.166015  3342 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.138487  3418 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.166977  3382 consensus_queue.cc:260] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.169607  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:53.170115  3382 ts_tablet_manager.cc:1434] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 12:12:53.170269  3268 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.170149  3418 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.171304  3382 tablet_bootstrap.cc:492] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:53.171381  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:53.171835  3383 tablet_bootstrap.cc:654] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.172164  3341 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.179114  3268 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:53.182363  3156 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:53.180353  3341 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:53.183280  3418 raft_consensus.cc:2804] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.183910  3418 raft_consensus.cc:697] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:53.184908  3384 tablet_bootstrap.cc:654] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.184845  3418 consensus_queue.cc:237] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.185395  3089 catalog_manager.cc:5697] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:53.191028  3382 tablet_bootstrap.cc:654] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.198712  3383 tablet_bootstrap.cc:492] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:53.199451  3383 ts_tablet_manager.cc:1403] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.007s
I20260709 12:12:53.202795  3382 tablet_bootstrap.cc:492] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:53.203524  3382 ts_tablet_manager.cc:1403] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.002s
I20260709 12:12:53.208005  3382 raft_consensus.cc:359] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.202826  3383 raft_consensus.cc:359] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.208886  3382 raft_consensus.cc:385] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.209286  3383 raft_consensus.cc:385] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.209323  3382 raft_consensus.cc:740] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.209743  3383 raft_consensus.cc:740] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.210335  3382 consensus_queue.cc:260] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.212435  3383 consensus_queue.cc:260] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.213327  3382 ts_tablet_manager.cc:1434] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:12:53.214579  3382 tablet_bootstrap.cc:492] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:53.218616  3342 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:53.220238  3232 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:53.220634  3382 tablet_bootstrap.cc:654] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.221802  3425 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.222438  3425 raft_consensus.cc:697] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:53.223958  3425 consensus_queue.cc:237] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.225574  3383 ts_tablet_manager.cc:1434] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:12:53.226899  3383 tablet_bootstrap.cc:492] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:53.231554  3091 catalog_manager.cc:5697] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.233193  3384 tablet_bootstrap.cc:492] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:53.233763  3383 tablet_bootstrap.cc:654] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.233822  3384 ts_tablet_manager.cc:1403] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.076s	user 0.036s	sys 0.017s
I20260709 12:12:53.237360  3384 raft_consensus.cc:359] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.238306  3384 raft_consensus.cc:385] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.238713  3384 raft_consensus.cc:740] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.239796  3384 consensus_queue.cc:260] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.243042  3384 ts_tablet_manager.cc:1434] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:12:53.244294  3384 tablet_bootstrap.cc:492] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:53.251762  3384 tablet_bootstrap.cc:654] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.263715  3384 tablet_bootstrap.cc:492] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:53.264782  3384 ts_tablet_manager.cc:1403] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 12:12:53.266050  3382 tablet_bootstrap.cc:492] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:53.266500  3382 ts_tablet_manager.cc:1403] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.007s
I20260709 12:12:53.268224  3384 raft_consensus.cc:359] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.267601  3089 catalog_manager.cc:5697] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.269037  3384 raft_consensus.cc:385] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.268975  3382 raft_consensus.cc:359] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.269513  3384 raft_consensus.cc:740] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.269812  3382 raft_consensus.cc:385] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.270139  3382 raft_consensus.cc:740] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.270781  3384 consensus_queue.cc:260] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.270780  3382 consensus_queue.cc:260] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.273102  3382 ts_tablet_manager.cc:1434] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:12:53.273102  3384 ts_tablet_manager.cc:1434] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:12:53.274214  3384 tablet_bootstrap.cc:492] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:53.275285  3382 tablet_bootstrap.cc:492] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:53.280869  3382 tablet_bootstrap.cc:654] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.280902  3384 tablet_bootstrap.cc:654] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.288494  3383 tablet_bootstrap.cc:492] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:53.288995  3383 ts_tablet_manager.cc:1403] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.062s	user 0.030s	sys 0.026s
I20260709 12:12:53.291791  3383 raft_consensus.cc:359] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.292443  3383 raft_consensus.cc:385] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.292724  3383 raft_consensus.cc:740] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.293545  3383 consensus_queue.cc:260] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.295897  3383 ts_tablet_manager.cc:1434] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:53.297045  3383 tablet_bootstrap.cc:492] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:53.301929  3383 tablet_bootstrap.cc:654] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.303212  3417 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.304173  3417 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.307111  3417 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:53.308024  3384 tablet_bootstrap.cc:492] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:53.308718  3384 ts_tablet_manager.cc:1403] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.004s
I20260709 12:12:53.309499  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:53.309779  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:53.311913  3384 raft_consensus.cc:359] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:12:53.312090  3305 leader_election.cc:343] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.312848  3384 raft_consensus.cc:385] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.313248  3384 raft_consensus.cc:740] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
W20260709 12:12:53.313462  3305 leader_election.cc:343] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.314172  3384 consensus_queue.cc:260] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.314175  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:53.316529  3417 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.316804  3384 ts_tablet_manager.cc:1434] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:53.318161  3384 tablet_bootstrap.cc:492] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:53.319254  3382 tablet_bootstrap.cc:492] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:53.319805  3382 ts_tablet_manager.cc:1403] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.010s
I20260709 12:12:53.320250  3383 tablet_bootstrap.cc:492] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:53.320674  3383 ts_tablet_manager.cc:1403] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.009s
I20260709 12:12:53.322419  3382 raft_consensus.cc:359] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.323102  3382 raft_consensus.cc:385] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.323359  3382 raft_consensus.cc:740] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.323565  3384 tablet_bootstrap.cc:654] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.323603  3383 raft_consensus.cc:359] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.324427  3383 raft_consensus.cc:385] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.324770  3383 raft_consensus.cc:740] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.324594  3382 consensus_queue.cc:260] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.325701  3383 consensus_queue.cc:260] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.327462  3382 ts_tablet_manager.cc:1434] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:53.331389  3383 ts_tablet_manager.cc:1434] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:12:53.332370  3383 tablet_bootstrap.cc:492] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:53.337898  3383 tablet_bootstrap.cc:654] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.342012  3384 tablet_bootstrap.cc:492] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:53.342818  3384 ts_tablet_manager.cc:1403] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.012s
I20260709 12:12:53.345798  3382 tablet_bootstrap.cc:492] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:53.346268  3384 raft_consensus.cc:359] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.347179  3384 raft_consensus.cc:385] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.347550  3384 raft_consensus.cc:740] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.348567  3384 consensus_queue.cc:260] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.350260  3382 tablet_bootstrap.cc:654] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.351061  3418 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.351593  3418 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.353679  3418 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.354481  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:53.355100  3268 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:53.355715  3384 ts_tablet_manager.cc:1434] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 12:12:53.355679  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:53.356400  3342 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:53.356734  3384 tablet_bootstrap.cc:492] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:53.357024  3418 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.357429  3418 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.356490  3156 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:53.362739  3388 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.363119  3388 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.363511  3388 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.364778  3384 tablet_bootstrap.cc:654] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.368238  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:53.368948  3268 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:53.370095  3425 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.370644  3156 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:53.370719  3425 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } }
I20260709 12:12:53.373507  3425 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:12:53.374481  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:53.375417  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:53.375955  3232 leader_election.cc:343] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.376297  3341 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:53.378043  3418 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.378734  3418 raft_consensus.cc:2804] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.379168  3418 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.379633  3418 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.384188  3388 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.389014  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:53.389688  3341 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.390532  3382 tablet_bootstrap.cc:492] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:53.390982  3382 ts_tablet_manager.cc:1403] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.003s
I20260709 12:12:53.392856  3418 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.393657  3382 raft_consensus.cc:359] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.394292  3382 raft_consensus.cc:385] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.394553  3382 raft_consensus.cc:740] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.395879  3418 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.397078  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:53.397791  3342 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.399166  3384 tablet_bootstrap.cc:492] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:53.399619  3384 ts_tablet_manager.cc:1403] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.000s
I20260709 12:12:53.402521  3384 raft_consensus.cc:359] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.403170  3384 raft_consensus.cc:385] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.403476  3384 raft_consensus.cc:740] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.403935  3341 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:53.404214  3384 consensus_queue.cc:260] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.405565  3157 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:53.406196  3384 ts_tablet_manager.cc:1434] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:53.406795  3418 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.407469  3384 tablet_bootstrap.cc:492] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:53.407449  3418 raft_consensus.cc:697] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:53.411089  3383 tablet_bootstrap.cc:492] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:53.416079  3383 ts_tablet_manager.cc:1403] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.084s	user 0.020s	sys 0.025s
I20260709 12:12:53.416234  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:53.416290  3418 consensus_queue.cc:237] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.396879  3382 consensus_queue.cc:260] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.411993  3342 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:53.414376  3384 tablet_bootstrap.cc:654] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.414245  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:53.420529  3268 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.415030  3449 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.415166  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:53.424407  3192 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:53.424111  3449 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.416894  3267 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.425134  3384 tablet_bootstrap.cc:492] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:53.425619  3384 ts_tablet_manager.cc:1403] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.005s
I20260709 12:12:53.426435  3449 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.413735  3388 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.419026  3382 ts_tablet_manager.cc:1434] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.005s
I20260709 12:12:53.427568  3231 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:53.428545  3382 tablet_bootstrap.cc:492] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:53.428457  3091 catalog_manager.cc:5697] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.429464  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:53.430287  3266 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 1: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:12:53.431100  3425 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.431485  3425 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.431818  3425 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.432500  3384 raft_consensus.cc:359] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.419041  3383 raft_consensus.cc:359] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.433125  3384 raft_consensus.cc:385] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.433454  3383 raft_consensus.cc:385] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.433488  3384 raft_consensus.cc:740] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.433869  3383 raft_consensus.cc:740] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.434301  3384 consensus_queue.cc:260] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.435688  3157 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:53.436414  3384 ts_tablet_manager.cc:1434] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:12:53.437070  3383 consensus_queue.cc:260] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.437680  3384 tablet_bootstrap.cc:492] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:53.438382  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:53.445541  3400 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.438604  3267 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:53.445966  3400 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.446481  3157 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:53.447456  3418 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.448065  3400 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.447898  3418 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.440337  3383 ts_tablet_manager.cc:1434] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:12:53.439137  3388 raft_consensus.cc:2804] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.442611  3268 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:53.445173  3382 tablet_bootstrap.cc:654] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.449967  3383 tablet_bootstrap.cc:492] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:53.450150  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:53.450805  3192 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:53.450932  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:53.449129  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:53.448164  3449 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.452589  3418 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.459194  3382 tablet_bootstrap.cc:492] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:53.459671  3382 ts_tablet_manager.cc:1403] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.007s
I20260709 12:12:53.453884  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:53.454403  3388 raft_consensus.cc:697] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:53.461284  3388 consensus_queue.cc:237] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.462528  3382 raft_consensus.cc:359] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } }
I20260709 12:12:53.463155  3382 raft_consensus.cc:385] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.463474  3382 raft_consensus.cc:740] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.463817  3341 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:53.464330  3382 consensus_queue.cc:260] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } }
I20260709 12:12:53.464823  3449 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.439143  3425 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } }
I20260709 12:12:53.466116  3157 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:53.444270  3384 tablet_bootstrap.cc:654] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.457186  3342 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:53.452008  3231 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:53.457186  3268 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:53.469619  3400 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.471486  3400 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.471845  3400 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.472357  3425 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:12:53.470233  3383 tablet_bootstrap.cc:654] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.476831  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:53.477180  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:53.477500  3192 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.477809  3342 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.470147  3449 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.483619  3449 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.484004  3449 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.484437  3400 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.486534  3400 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.470975  3382 ts_tablet_manager.cc:1434] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:12:53.489488  3382 tablet_bootstrap.cc:492] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:53.493373  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:53.493969  3193 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.495065  3192 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:53.496552  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:53.497573  3342 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:53.502736  3231 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:53.499701  3341 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.504251  3400 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.506315  3400 raft_consensus.cc:697] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:53.507629  3400 consensus_queue.cc:237] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } }
I20260709 12:12:53.505782  3382 tablet_bootstrap.cc:654] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.514783  3193 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:53.515703  3417 consensus_queue.cc:1048] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.518437  3231 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:53.518594  3449 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.519817  3425 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.520340  3425 raft_consensus.cc:697] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:53.521091  3383 tablet_bootstrap.cc:492] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:53.521651  3383 ts_tablet_manager.cc:1403] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.072s	user 0.019s	sys 0.011s
I20260709 12:12:53.521147  3425 consensus_queue.cc:237] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.524783  3383 raft_consensus.cc:359] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.525444  3383 raft_consensus.cc:385] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.526603  3091 catalog_manager.cc:5697] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.525741  3383 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.519805  3341 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:53.529966  3449 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.578961  3384 tablet_bootstrap.cc:492] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:53.530843  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:53.580559  3384 ts_tablet_manager.cc:1403] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.143s	user 0.032s	sys 0.043s
I20260709 12:12:53.580698  3268 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.583556  3384 raft_consensus.cc:359] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.584272  3384 raft_consensus.cc:385] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.584700  3425 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.584851  3384 raft_consensus.cc:740] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.585258  3425 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.585757  3384 consensus_queue.cc:260] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.579535  3383 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.587546  3425 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.588425  3384 ts_tablet_manager.cc:1434] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:53.589445  3383 ts_tablet_manager.cc:1434] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260709 12:12:53.537807  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:53.590152  3384 tablet_bootstrap.cc:492] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:53.590345  3383 tablet_bootstrap.cc:492] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:53.590252  3342 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.591684  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:12:53.595747  3231 leader_election.cc:343] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.597749  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:53.599351  3232 leader_election.cc:343] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:53.599498  3139 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:53.600123  3232 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:53.600996  3425 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.588622  3090 catalog_manager.cc:5697] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.604655  3342 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:53.609958  3157 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:53.610777  3449 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.610948  3384 tablet_bootstrap.cc:654] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.611280  3449 raft_consensus.cc:697] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:53.612644  3449 consensus_queue.cc:237] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.615695  3382 tablet_bootstrap.cc:492] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:53.616176  3417 consensus_queue.cc:1048] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.618523  3382 ts_tablet_manager.cc:1403] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.130s	user 0.019s	sys 0.005s
I20260709 12:12:53.621713  3382 raft_consensus.cc:359] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.622437  3382 raft_consensus.cc:385] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.622726  3382 raft_consensus.cc:740] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.624737  3268 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:53.623387  3382 consensus_queue.cc:260] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.625869  3388 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.626375  3388 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:12:53.627516  3231 consensus_peers.cc:597] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.628914  3418 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.631672  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:53.624761  3383 tablet_bootstrap.cc:654] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.632589  3388 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.637782  3192 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.637957  3342 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:53.640872  3157 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:53.643752  3388 raft_consensus.cc:2804] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.644148  3388 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.644503  3388 raft_consensus.cc:3060] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.645694  3425 consensus_queue.cc:1048] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.652736  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:53.653402  3268 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:53.656493  3425 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.658413  3425 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.660647  3425 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.662277  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:53.662964  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:53.665300  3418 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:53.665464  3232 leader_election.cc:343] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:53.677754  3231 leader_election.cc:343] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.666003  3418 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.682425  3418 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.679071  3231 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:53.684309  3425 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.684134  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:53.685421  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:12:53.686543  3157 leader_election.cc:343] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.686748  3382 ts_tablet_manager.cc:1434] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
W20260709 12:12:53.687630  3156 leader_election.cc:343] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.688114  3382 tablet_bootstrap.cc:492] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:53.688285  3156 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:53.690299  3418 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.697563  3388 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.699651  3417 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.709249  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:53.710014  3268 raft_consensus.cc:3060] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.710616  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:53.711328  3341 raft_consensus.cc:3060] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.722289  3090 catalog_manager.cc:5697] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.723558  3388 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.724463  3341 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:53.725785  3157 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:53.726688  3388 raft_consensus.cc:2804] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.727286  3388 raft_consensus.cc:697] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:53.727541  3383 tablet_bootstrap.cc:492] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:53.728175  3383 ts_tablet_manager.cc:1403] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.138s	user 0.012s	sys 0.002s
I20260709 12:12:53.728264  3388 consensus_queue.cc:237] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.732424  3383 raft_consensus.cc:359] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.733178  3383 raft_consensus.cc:385] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.733518  3383 raft_consensus.cc:740] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.734406  3382 tablet_bootstrap.cc:654] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.738590  3383 consensus_queue.cc:260] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.742159  3383 ts_tablet_manager.cc:1434] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:12:53.743952  3383 tablet_bootstrap.cc:492] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:53.755054  3383 tablet_bootstrap.cc:654] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.760607  3382 tablet_bootstrap.cc:492] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:53.761355  3382 ts_tablet_manager.cc:1403] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.006s
W20260709 12:12:53.761895  3305 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.762997  3449 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.764282  3268 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:53.765662  3382 raft_consensus.cc:359] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.769719  3382 raft_consensus.cc:385] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.770046  3382 raft_consensus.cc:740] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.774317  3384 tablet_bootstrap.cc:492] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:53.774936  3384 ts_tablet_manager.cc:1403] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.185s	user 0.042s	sys 0.068s
I20260709 12:12:53.770881  3382 consensus_queue.cc:260] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.777503  3382 ts_tablet_manager.cc:1434] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:12:53.778476  3382 tablet_bootstrap.cc:492] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:53.778074  3384 raft_consensus.cc:359] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.779569  3384 raft_consensus.cc:385] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.779942  3384 raft_consensus.cc:740] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.780819  3384 consensus_queue.cc:260] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.783408  3384 ts_tablet_manager.cc:1434] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:12:53.785063  3384 tablet_bootstrap.cc:492] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:53.790244  3090 catalog_manager.cc:5697] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.791743  3384 tablet_bootstrap.cc:654] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.794567  3382 tablet_bootstrap.cc:654] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.819959  3425 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.820779  3425 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.825131  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:53.826020  3425 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.826719  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:53.827462  3342 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:53.828787  3232 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:12:53.830827  3231 leader_election.cc:343] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.832134  3425 raft_consensus.cc:2804] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.833009  3425 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.833379  3425 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.836602  3449 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.838174  3391 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.838668  3391 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.841691  3391 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:53.843701  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:12:53.845227  3305 leader_election.cc:343] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.844937  3425 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.848874  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:12:53.850262  3305 leader_election.cc:343] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.850857  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:53.851898  3391 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.852651  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:53.853452  3341 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.856124  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:53.858590  3383 tablet_bootstrap.cc:492] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:53.859054  3383 ts_tablet_manager.cc:1403] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.030s
I20260709 12:12:53.859133  3088 catalog_manager.cc:5697] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:53.863922  3231 leader_election.cc:343] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.865149  3425 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.866438  3383 raft_consensus.cc:359] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.869815  3391 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.870528  3391 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.874815  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:12:53.876816  3305 leader_election.cc:343] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.879302  3391 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:53.879544  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:53.880373  3341 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
W20260709 12:12:53.881728  3305 leader_election.cc:343] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.881644  3232 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:53.882192  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:53.882979  3425 raft_consensus.cc:2804] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.867292  3383 raft_consensus.cc:385] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.885210  3383 raft_consensus.cc:740] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.885942  3383 consensus_queue.cc:260] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.871328  3384 tablet_bootstrap.cc:492] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:53.888348  3384 ts_tablet_manager.cc:1403] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.014s
I20260709 12:12:53.888767  3383 ts_tablet_manager.cc:1434] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:12:53.883841  3425 raft_consensus.cc:697] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:53.890364  3425 consensus_queue.cc:237] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.890865  3383 tablet_bootstrap.cc:492] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:53.890810  3418 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.893060  3391 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.893388  3384 raft_consensus.cc:359] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.895900  3384 raft_consensus.cc:385] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.896196  3384 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.896890  3384 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.901100  3382 tablet_bootstrap.cc:492] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:53.902915  3382 ts_tablet_manager.cc:1403] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.125s	user 0.028s	sys 0.037s
I20260709 12:12:53.906888  3383 tablet_bootstrap.cc:654] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.908394  3382 raft_consensus.cc:359] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.913673  3382 raft_consensus.cc:385] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.913753  3426 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.914350  3426 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.915506  3384 ts_tablet_manager.cc:1434] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 12:12:53.916944  3384 tablet_bootstrap.cc:492] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:53.917418  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:53.919514  3426 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.920084  3382 raft_consensus.cc:740] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.920675  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:53.920984  3382 consensus_queue.cc:260] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.922137  3232 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:53.923662  3426 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.925648  3382 ts_tablet_manager.cc:1434] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 12:12:53.926602  3382 tablet_bootstrap.cc:492] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:53.929888  3384 tablet_bootstrap.cc:654] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.930481  3426 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.930967  3426 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.931535  3382 tablet_bootstrap.cc:654] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.933914  3426 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.934585  3418 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.935124  3418 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:53.943063  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:53.945375  3192 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:53.950733  3089 catalog_manager.cc:5697] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.952010  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:53.954324  3232 leader_election.cc:343] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.957180  3388 consensus_queue.cc:1048] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.964407  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:53.969403  3231 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:53.972525  3425 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.973037  3425 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.973541  3425 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.979573  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:53.980499  3342 raft_consensus.cc:2393] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:12:53.945785  3418 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:53.982043  3157 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:53.984088  3418 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.984825  3400 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.997694  3383 tablet_bootstrap.cc:492] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:53.998633  3383 ts_tablet_manager.cc:1403] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.108s	user 0.038s	sys 0.039s
I20260709 12:12:54.000841  3382 tablet_bootstrap.cc:492] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:54.001354  3382 ts_tablet_manager.cc:1403] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.075s	user 0.029s	sys 0.014s
I20260709 12:12:54.001827  3426 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:54.004999  3400 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.009063  3418 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.010360  3384 tablet_bootstrap.cc:492] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:54.010902  3384 ts_tablet_manager.cc:1403] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.094s	user 0.007s	sys 0.014s
I20260709 12:12:53.997781  3425 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.013985  3400 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.014326  3425 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:54.007393  3382 raft_consensus.cc:359] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.016341  3384 raft_consensus.cc:359] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.016722  3382 raft_consensus.cc:385] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.017050  3382 raft_consensus.cc:740] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.017026  3384 raft_consensus.cc:385] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.017958  3384 raft_consensus.cc:740] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.022518  3382 consensus_queue.cc:260] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.024886  3382 ts_tablet_manager.cc:1434] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:12:54.029505  3383 raft_consensus.cc:359] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.030350  3383 raft_consensus.cc:385] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.030651  3383 raft_consensus.cc:740] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.031670  3383 consensus_queue.cc:260] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.033329  3382 tablet_bootstrap.cc:492] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:54.034041  3383 ts_tablet_manager.cc:1434] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.005s
I20260709 12:12:54.035002  3383 tablet_bootstrap.cc:492] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:54.040596  3384 consensus_queue.cc:260] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.043526  3418 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.049335  3384 ts_tablet_manager.cc:1434] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.008s
I20260709 12:12:54.049767  3383 tablet_bootstrap.cc:654] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.050300  3384 tablet_bootstrap.cc:492] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:54.055871  3382 tablet_bootstrap.cc:654] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.065224  3384 tablet_bootstrap.cc:654] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.066396  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:12:54.068866  3232 leader_election.cc:343] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.071630  3382 tablet_bootstrap.cc:492] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:54.072192  3382 ts_tablet_manager.cc:1403] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.001s
I20260709 12:12:54.076079  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:54.078352  3193 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.082610  3388 consensus_queue.cc:1048] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.089082  3417 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.090121  3417 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.091367  3383 tablet_bootstrap.cc:492] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:54.092708  3383 ts_tablet_manager.cc:1403] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.013s
I20260709 12:12:54.097579  3388 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.109591  3383 raft_consensus.cc:359] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.111057  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:54.112100  3191 raft_consensus.cc:2468] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:54.112713  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:54.111356  3417 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:54.113981  3383 raft_consensus.cc:385] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.121462  3383 raft_consensus.cc:740] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.122925  3383 consensus_queue.cc:260] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.124176  3305 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:12:54.132543  3305 leader_election.cc:343] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.133564  3391 raft_consensus.cc:2804] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.134239  3391 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.134706  3391 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.136966  3388 consensus_queue.cc:1048] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.148352  3382 raft_consensus.cc:359] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.149533  3382 raft_consensus.cc:385] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.146523  3417 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.150012  3382 raft_consensus.cc:740] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.150389  3417 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.153985  3193 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
W20260709 12:12:54.154925  3484 log.cc:927] Time spent T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.074s	user 0.004s	sys 0.000s
I20260709 12:12:54.156152  3231 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:54.157472  3400 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.158150  3400 raft_consensus.cc:697] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:54.159341  3400 consensus_queue.cc:237] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.176540  3382 consensus_queue.cc:260] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.184005  3391 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.188978  3383 ts_tablet_manager.cc:1434] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.002s
I20260709 12:12:54.190723  3383 tablet_bootstrap.cc:492] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:54.191526  3417 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:54.191915  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:54.192559  3191 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.193449  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:54.195704  3384 tablet_bootstrap.cc:492] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:54.196523  3384 ts_tablet_manager.cc:1403] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.146s	user 0.038s	sys 0.067s
I20260709 12:12:54.195420  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:54.197321  3266 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:54.197734  3193 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:54.198830  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:54.201818  3417 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.202370  3417 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.203066  3417 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.205439  3383 tablet_bootstrap.cc:654] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.211766  3391 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:54.224965  3384 raft_consensus.cc:359] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.226028  3384 raft_consensus.cc:385] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.226354  3384 raft_consensus.cc:740] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.227380  3384 consensus_queue.cc:260] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.230650  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:54.231698  3384 ts_tablet_manager.cc:1434] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.007s
I20260709 12:12:54.232086  3266 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.233500  3384 tablet_bootstrap.cc:492] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
W20260709 12:12:54.237063  3305 leader_election.cc:343] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.240197  3417 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.245455  3191 raft_consensus.cc:2468] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:54.246474  3417 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:54.247184  3305 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:12:54.249257  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:54.250463  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:54.251220  3267 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.255019  3383 tablet_bootstrap.cc:492] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:54.250178  3496 raft_consensus.cc:2804] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.249887  3384 tablet_bootstrap.cc:654] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.256498  3496 raft_consensus.cc:697] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:12:54.257787  3496 consensus_queue.cc:237] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.249926  3193 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:54.279585  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 50003.5us
I20260709 12:12:54.255651  3383 ts_tablet_manager.cc:1403] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.004s
I20260709 12:12:54.285032  3193 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:54.293267  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:54.294368  3496 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.295102  3496 raft_consensus.cc:697] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:12:54.295994  3496 consensus_queue.cc:237] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.287760  3267 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:54.290446  3383 raft_consensus.cc:359] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.299674  3383 raft_consensus.cc:385] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.307819  3383 raft_consensus.cc:740] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.312217  3418 consensus_queue.cc:1048] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.308888  3383 consensus_queue.cc:260] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.320272  3383 ts_tablet_manager.cc:1434] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.003s
I20260709 12:12:54.320523  3384 tablet_bootstrap.cc:492] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:54.320995  3384 ts_tablet_manager.cc:1403] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.041s
I20260709 12:12:54.321518  3383 tablet_bootstrap.cc:492] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:54.293418  3382 ts_tablet_manager.cc:1434] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.221s	user 0.014s	sys 0.004s
I20260709 12:12:54.329581  3383 tablet_bootstrap.cc:654] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.329900  3382 tablet_bootstrap.cc:492] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:54.330358  3091 catalog_manager.cc:5697] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.340232  3426 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.340799  3426 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.353892  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:54.358840  3232 leader_election.cc:343] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.367609  3088 catalog_manager.cc:5697] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.372140  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:54.373070  3193 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:54.343343  3426 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:54.353665  3384 raft_consensus.cc:359] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.382855  3384 raft_consensus.cc:385] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.383351  3384 raft_consensus.cc:740] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.384485  3384 consensus_queue.cc:260] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.387459  3384 ts_tablet_manager.cc:1434] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 12:12:54.395728  3384 tablet_bootstrap.cc:492] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:54.391078  3502 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.396481  3502 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.399147  3502 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:54.394420  3382 tablet_bootstrap.cc:654] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.389325  3231 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:54.400970  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:54.404604  3232 leader_election.cc:343] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.404995  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:54.405308  3502 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.405681  3502 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.405663  3193 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:54.406139  3502 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.407339  3231 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:54.408454  3426 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.408907  3426 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.409416  3426 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.410501  3089 catalog_manager.cc:5697] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.414014  3502 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.418452  3502 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:54.419164  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:54.419314  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:54.419821  3193 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:54.420683  3232 leader_election.cc:343] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.425966  3193 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:54.426414  3383 tablet_bootstrap.cc:492] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:54.426991  3383 ts_tablet_manager.cc:1403] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.106s	user 0.061s	sys 0.037s
I20260709 12:12:54.427479  3231 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:54.428491  3502 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.429248  3502 raft_consensus.cc:697] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:54.429855  3383 raft_consensus.cc:359] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.430591  3383 raft_consensus.cc:385] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.430291  3502 consensus_queue.cc:237] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.430902  3383 raft_consensus.cc:740] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.431787  3383 consensus_queue.cc:260] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.441990  3383 ts_tablet_manager.cc:1434] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 12:12:54.443131  3383 tablet_bootstrap.cc:492] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:54.450495  3508 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.453172  3383 tablet_bootstrap.cc:654] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.454746  3382 tablet_bootstrap.cc:492] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:54.455204  3382 ts_tablet_manager.cc:1403] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.126s	user 0.017s	sys 0.000s
I20260709 12:12:54.433876  3426 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.458112  3382 raft_consensus.cc:359] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.458792  3382 raft_consensus.cc:385] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.459064  3382 raft_consensus.cc:740] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.460189  3382 consensus_queue.cc:260] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.462383  3382 ts_tablet_manager.cc:1434] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:12:54.463407  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:54.464083  3191 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.464835  3426 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:54.466390  3384 tablet_bootstrap.cc:654] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.470268  3382 tablet_bootstrap.cc:492] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:54.471823  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:12:54.473649  3232 leader_election.cc:343] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.476042  3191 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:54.476995  3496 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.477793  3496 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.478310  3426 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.480469  3496 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:54.480882  3231 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:54.485024  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:54.485502  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:54.485879  3193 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:54.488569  3417 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.490180  3417 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.492272  3417 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:12:54.493271  3305 leader_election.cc:343] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.489543  3426 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.494215  3426 raft_consensus.cc:697] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:54.495055  3426 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.497694  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:54.498514  3191 raft_consensus.cc:2393] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:12:54.500545  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:54.505369  3305 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:12:54.506579  3305 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:54.507742  3417 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.508276  3417 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.508847  3417 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.509507  3499 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.534348  3382 tablet_bootstrap.cc:654] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.536441  3383 tablet_bootstrap.cc:492] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:54.536998  3383 ts_tablet_manager.cc:1403] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.094s	user 0.041s	sys 0.036s
I20260709 12:12:54.546495  3384 tablet_bootstrap.cc:492] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:54.547056  3384 ts_tablet_manager.cc:1403] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.152s	user 0.008s	sys 0.007s
I20260709 12:12:54.550938  3384 raft_consensus.cc:359] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.551690  3384 raft_consensus.cc:385] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.551970  3384 raft_consensus.cc:740] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.552645  3384 consensus_queue.cc:260] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.555645  3384 ts_tablet_manager.cc:1434] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:12:54.558251  3417 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.559326  3384 tablet_bootstrap.cc:492] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:54.560505  3417 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:54.562242  3499 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.563225  3383 raft_consensus.cc:359] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.563977  3383 raft_consensus.cc:385] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.564273  3383 raft_consensus.cc:740] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.564913  3383 consensus_queue.cc:260] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.565202  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:54.566447  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:54.567027  3193 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:54.572139  3305 leader_election.cc:343] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.573118  3193 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:54.574774  3305 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:12:54.575723  3382 tablet_bootstrap.cc:492] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:54.566466  3383 ts_tablet_manager.cc:1434] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:12:54.576156  3499 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.576973  3499 raft_consensus.cc:697] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:12:54.577275  3383 tablet_bootstrap.cc:492] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:54.577847  3499 consensus_queue.cc:237] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.576193  3382 ts_tablet_manager.cc:1403] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.005s
I20260709 12:12:54.582226  3382 raft_consensus.cc:359] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.582793  3383 tablet_bootstrap.cc:654] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.582948  3382 raft_consensus.cc:385] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.583257  3382 raft_consensus.cc:740] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.576172  3384 tablet_bootstrap.cc:654] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.587543  3382 consensus_queue.cc:260] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.591674  3382 ts_tablet_manager.cc:1434] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:12:54.565089  3088 catalog_manager.cc:5697] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.592973  3382 tablet_bootstrap.cc:492] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:54.593154  3384 tablet_bootstrap.cc:492] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:54.593669  3384 ts_tablet_manager.cc:1403] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.003s
I20260709 12:12:54.594413  3088 catalog_manager.cc:5697] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.596326  3384 raft_consensus.cc:359] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.597085  3384 raft_consensus.cc:385] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.597349  3384 raft_consensus.cc:740] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.599660  3384 consensus_queue.cc:260] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.601132  3383 tablet_bootstrap.cc:492] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:54.601612  3383 ts_tablet_manager.cc:1403] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.016s
I20260709 12:12:54.601624  3382 tablet_bootstrap.cc:654] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.601926  3384 ts_tablet_manager.cc:1434] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:54.602895  3384 tablet_bootstrap.cc:492] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:54.609334  3383 raft_consensus.cc:359] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.610363  3383 raft_consensus.cc:385] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.610658  3384 tablet_bootstrap.cc:654] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.610746  3383 raft_consensus.cc:740] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.612612  3383 consensus_queue.cc:260] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.616199  3383 ts_tablet_manager.cc:1434] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:12:54.624596  3426 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.625625  3383 tablet_bootstrap.cc:492] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:54.640762  3382 tablet_bootstrap.cc:492] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:54.641340  3382 ts_tablet_manager.cc:1403] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.010s
W20260709 12:12:54.643505  3139 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:54.644234  3382 raft_consensus.cc:359] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.645042  3382 raft_consensus.cc:385] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.645334  3382 raft_consensus.cc:740] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.646895  3382 consensus_queue.cc:260] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.648901  3384 tablet_bootstrap.cc:492] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:54.649096  3382 ts_tablet_manager.cc:1434] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:54.649389  3384 ts_tablet_manager.cc:1403] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.004s
I20260709 12:12:54.650061  3382 tablet_bootstrap.cc:492] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:54.651016  3383 tablet_bootstrap.cc:654] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.652438  3384 raft_consensus.cc:359] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.653273  3384 raft_consensus.cc:385] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.653549  3384 raft_consensus.cc:740] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.654343  3384 consensus_queue.cc:260] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.656654  3384 ts_tablet_manager.cc:1434] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:54.653817  3086 catalog_manager.cc:5697] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.658205  3384 tablet_bootstrap.cc:492] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:54.661304  3382 tablet_bootstrap.cc:654] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.662634  3502 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.665925  3384 tablet_bootstrap.cc:654] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.667696  3426 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.668174  3426 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.671411  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:54.671936  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:54.672079  3191 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:54.672580  3340 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:54.673403  3231 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:54.674072  3382 tablet_bootstrap.cc:492] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:54.674515  3502 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.674670  3382 ts_tablet_manager.cc:1403] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 12:12:54.674975  3502 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.675405  3502 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.678325  3382 raft_consensus.cc:359] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.679245  3382 raft_consensus.cc:385] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.679593  3382 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.680436  3382 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.682346  3426 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:54.683393  3382 ts_tablet_manager.cc:1434] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:12:54.684736  3382 tablet_bootstrap.cc:492] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:54.687582  3384 tablet_bootstrap.cc:492] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:54.688223  3384 ts_tablet_manager.cc:1403] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.007s
I20260709 12:12:54.691356  3382 tablet_bootstrap.cc:654] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.693254  3384 raft_consensus.cc:359] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.694253  3384 raft_consensus.cc:385] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.694732  3384 raft_consensus.cc:740] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.697248  3383 tablet_bootstrap.cc:492] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:54.698010  3383 ts_tablet_manager.cc:1403] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.002s
I20260709 12:12:54.703869  3384 consensus_queue.cc:260] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.704887  3499 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.702606  3383 raft_consensus.cc:359] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.705624  3499 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.710137  3499 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:54.710949  3383 raft_consensus.cc:385] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.711486  3383 raft_consensus.cc:740] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.707355  3384 ts_tablet_manager.cc:1434] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:12:54.711799  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:54.713160  3383 consensus_queue.cc:260] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:12:54.714152  3305 leader_election.cc:343] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.720405  3383 ts_tablet_manager.cc:1434] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 12:12:54.721846  3383 tablet_bootstrap.cc:492] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:54.715456  3384 tablet_bootstrap.cc:492] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
W20260709 12:12:54.723351  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.722458  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:54.724267  3266 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:54.724897  3382 tablet_bootstrap.cc:492] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:54.726562  3382 ts_tablet_manager.cc:1403] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.016s
I20260709 12:12:54.727272  3305 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:54.732065  3499 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.732959  3499 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.733522  3499 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.734438  3384 tablet_bootstrap.cc:654] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.735859  3497 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.736589  3497 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.730234  3382 raft_consensus.cc:359] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.739681  3382 raft_consensus.cc:385] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.740065  3383 tablet_bootstrap.cc:654] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.740113  3382 raft_consensus.cc:740] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.741087  3382 consensus_queue.cc:260] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.745131  3193 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.739634  3497 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:54.747455  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:54.749832  3382 ts_tablet_manager.cc:1434] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.005s
I20260709 12:12:54.751536  3382 tablet_bootstrap.cc:492] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
W20260709 12:12:54.752209  3232 leader_election.cc:343] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.751572  3417 consensus_queue.cc:1048] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:12:54.758531  3496 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.771907  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:54.823278  3384 tablet_bootstrap.cc:492] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:54.823825  3384 ts_tablet_manager.cc:1403] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.016s
I20260709 12:12:54.768724  3496 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:12:54.832484  3231 leader_election.cc:343] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.851604  3383 tablet_bootstrap.cc:492] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:54.852162  3383 ts_tablet_manager.cc:1403] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.131s	user 0.039s	sys 0.031s
I20260709 12:12:54.845872  3502 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.872469  3426 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.878706  3426 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.881405  3426 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:54.855170  3231 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:54.883379  3383 raft_consensus.cc:359] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.884112  3383 raft_consensus.cc:385] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.884397  3383 raft_consensus.cc:740] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.879151  3502 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:54.885032  3383 consensus_queue.cc:260] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.888404  3383 ts_tablet_manager.cc:1434] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:12:54.889413  3496 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:12:54.890044  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 59249.3us
I20260709 12:12:54.893697  3382 tablet_bootstrap.cc:654] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.892871  3426 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.902792  3536 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:12:54.916751  3502 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.924355  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:54.924197  3502 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.927026  3499 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.928313  3384 raft_consensus.cc:359] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.929051  3384 raft_consensus.cc:385] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.929337  3384 raft_consensus.cc:740] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.929927  3499 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:54.931773  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:54.934309  3502 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:54.931480  3384 consensus_queue.cc:260] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.936321  3384 ts_tablet_manager.cc:1434] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.000s
I20260709 12:12:54.937410  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:54.938236  3340 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
W20260709 12:12:54.939484  3305 leader_election.cc:343] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.939675  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:54.940301  3341 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:54.954954  3530 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.122s	user 0.001s	sys 0.003s
I20260709 12:12:54.955862  3400 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.956458  3400 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.959726  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:54.963786  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:54.963366  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:12:54.968319  3305 leader_election.cc:343] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.970263  3232 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:54.971920  3508 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.972404  3508 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.972836  3508 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.974717  3388 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.975417  3388 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:54.944312  3340 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.967092  3190 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.981360  3384 tablet_bootstrap.cc:492] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:54.985508  3383 tablet_bootstrap.cc:492] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:54.978442  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:54.989457  3341 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:54.959328  3400 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:12:54.942751  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 50311.8us
W20260709 12:12:54.993253  3232 leader_election.cc:343] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:55.057684  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 67764us
I20260709 12:12:55.055850  3388 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:55.114583  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:55.131808  3231 leader_election.cc:343] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:55.125789  3157 leader_election.cc:343] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.133188  3496 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 12:12:55.208206  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:55.138447  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:12:55.185967  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 64586.4us
I20260709 12:12:55.249318  3190 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:55.253784  3191 raft_consensus.cc:2393] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 1: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:12:55.255451  3539 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.256125  3539 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.258836  3539 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:12:55.222168  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 94614us
W20260709 12:12:55.281180  3231 leader_election.cc:343] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.281981  3231 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:55.286823  3535 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.287555  3535 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.302872  3384 tablet_bootstrap.cc:654] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.307147  3497 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.322316  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:55.323084  3190 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:55.323115  3535 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:55.323899  3231 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:55.316058  3382 tablet_bootstrap.cc:492] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:55.324930  3382 ts_tablet_manager.cc:1403] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.574s	user 0.015s	sys 0.032s
I20260709 12:12:55.316511  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:55.306839  3232 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:55.327608  3497 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.343880  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:55.339491  3400 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.342903  3382 raft_consensus.cc:359] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.345418  3382 raft_consensus.cc:385] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.345721  3382 raft_consensus.cc:740] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.346647  3400 raft_consensus.cc:697] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:55.347200  3382 consensus_queue.cc:260] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.347714  3400 consensus_queue.cc:237] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.349445  3382 ts_tablet_manager.cc:1434] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:12:55.350191  3382 tablet_bootstrap.cc:492] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:55.352033  3535 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:55.352524  3535 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.356491  3535 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:55.357901  3383 tablet_bootstrap.cc:654] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.373471  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:55.374198  3535 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.364503  3508 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.378392  3426 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.378718  3535 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:55.378960  3426 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.380260  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:55.380911  3266 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.381314  3426 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:12:55.381261  3232 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:55.389017  3157 leader_election.cc:343] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.389389  3502 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.391374  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:55.392375  3190 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:55.391324  3267 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.400192  3266 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:55.400671  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:55.411351  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:55.433544  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:55.424853  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:55.434492  3541 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.435065  3541 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.437839  3541 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:55.443699  3190 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:12:55.444823  3188 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:55.446753  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:55.447201  3508 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:55.447746  3265 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:55.450799  3497 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.457757  3382 tablet_bootstrap.cc:654] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.461483  3338 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:12:55.473187  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:55.484611  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:55.485345  3339 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.485945  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:55.486883  3535 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:55.487480  3535 raft_consensus.cc:697] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:12:55.488410  3535 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.490712  3088 catalog_manager.cc:5697] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.496980  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:55.498756  3383 tablet_bootstrap.cc:492] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:55.499295  3383 ts_tablet_manager.cc:1403] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.514s	user 0.020s	sys 0.011s
I20260709 12:12:55.502432  3156 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:55.505100  3383 raft_consensus.cc:359] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.506907  3383 raft_consensus.cc:385] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.507228  3383 raft_consensus.cc:740] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
W20260709 12:12:55.509634  3156 leader_election.cc:343] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.510149  3156 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:55.510366  3426 consensus_queue.cc:1048] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.511571  3449 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.512247  3231 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:55.508337  3497 consensus_queue.cc:1059] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:12:55.513450  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:55.514034  3502 raft_consensus.cc:3055] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:55.514454  3502 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:55.514861  3384 tablet_bootstrap.cc:492] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:55.513455  3539 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.515555  3384 ts_tablet_manager.cc:1403] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.534s	user 0.053s	sys 0.110s
I20260709 12:12:55.508071  3383 consensus_queue.cc:260] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.515879  3539 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.515820  3502 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.517431  3539 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.517813  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:55.518071  3502 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:55.520058  3339 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:55.520282  3383 ts_tablet_manager.cc:1434] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:12:55.521312  3383 tablet_bootstrap.cc:492] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
W20260709 12:12:55.505314  3305 leader_election.cc:343] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.523746  3305 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:55.524295  3384 raft_consensus.cc:359] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.524978  3384 raft_consensus.cc:385] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.525326  3536 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.526209  3499 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.530001  3497 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.526019  3305 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:55.531013  3384 raft_consensus.cc:740] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.534963  3384 consensus_queue.cc:260] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:12:55.536504  3231 leader_election.cc:343] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.538034  3384 ts_tablet_manager.cc:1434] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:12:55.538947  3384 tablet_bootstrap.cc:492] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:55.541781  3535 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.547451  3499 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.548009  3539 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.549135  3189 raft_consensus.cc:2393] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 1: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:12:55.550103  3539 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:55.553674  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:12:55.555128  3157 leader_election.cc:343] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.556677  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:55.557695  3267 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.552307  3535 raft_consensus.cc:697] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:12:55.561518  3535 consensus_queue.cc:237] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.569875  3267 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:55.571841  3383 tablet_bootstrap.cc:654] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.574395  3156 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:55.575282  3539 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:12:55.577061  3232 leader_election.cc:343] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.587539  3232 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:55.576143  3539 raft_consensus.cc:697] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:55.591089  3382 tablet_bootstrap.cc:492] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:55.591827  3382 ts_tablet_manager.cc:1403] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.242s	user 0.016s	sys 0.004s
I20260709 12:12:55.594231  3400 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.598807  3539 consensus_queue.cc:237] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.596463  3232 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:55.600878  3384 tablet_bootstrap.cc:654] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.604948  3400 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.612416  3400 raft_consensus.cc:697] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:55.623639  3382 raft_consensus.cc:359] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.625418  3382 raft_consensus.cc:385] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.625715  3382 raft_consensus.cc:740] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.639292  3400 consensus_queue.cc:237] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.643733  3382 consensus_queue.cc:260] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.647104  3383 tablet_bootstrap.cc:492] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:55.647866  3383 ts_tablet_manager.cc:1403] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.008s
I20260709 12:12:55.653820  3382 ts_tablet_manager.cc:1434] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.002s
I20260709 12:12:55.655303  3382 tablet_bootstrap.cc:492] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:55.657032  3383 raft_consensus.cc:359] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.658068  3383 raft_consensus.cc:385] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.658473  3383 raft_consensus.cc:740] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.660452  3383 consensus_queue.cc:260] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.668391  3383 ts_tablet_manager.cc:1434] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 12:12:55.669565  3383 tablet_bootstrap.cc:492] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:55.675628  3382 tablet_bootstrap.cc:654] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.677685  3087 catalog_manager.cc:5697] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.681100  3087 catalog_manager.cc:5697] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.701159  3383 tablet_bootstrap.cc:654] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.702697  3502 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.703233  3502 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.707677  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:55.696967  3086 catalog_manager.cc:5697] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.709203  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:55.709263  3384 tablet_bootstrap.cc:492] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:55.709982  3339 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:55.713521  3384 ts_tablet_manager.cc:1403] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.175s	user 0.027s	sys 0.000s
I20260709 12:12:55.714546  3232 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:55.715895  3497 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.716264  3497 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.716243  3384 raft_consensus.cc:359] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.717065  3384 raft_consensus.cc:385] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:55.717223  3231 leader_election.cc:343] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.716738  3497 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.717764  3499 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.719924  3502 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:55.718473  3499 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.725175  3382 tablet_bootstrap.cc:492] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:55.725775  3382 ts_tablet_manager.cc:1403] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.011s
I20260709 12:12:55.717341  3384 raft_consensus.cc:740] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.726202  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:55.726967  3384 consensus_queue.cc:260] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.729574  3384 ts_tablet_manager.cc:1434] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:12:55.730587  3384 tablet_bootstrap.cc:492] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:55.732247  3499 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:55.734426  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:55.734741  3088 catalog_manager.cc:5697] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.735630  3268 raft_consensus.cc:2393] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:12:55.736658  3497 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.737514  3305 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:55.740018  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:12:55.741672  3231 leader_election.cc:343] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.741974  3499 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.744796  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:55.745448  3339 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.741782  3497 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:55.748170  3383 tablet_bootstrap.cc:492] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:55.748693  3383 ts_tablet_manager.cc:1403] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.008s
I20260709 12:12:55.751688  3383 raft_consensus.cc:359] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.752414  3383 raft_consensus.cc:385] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.752728  3383 raft_consensus.cc:740] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.753677  3382 raft_consensus.cc:359] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.753428  3383 consensus_queue.cc:260] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.754391  3382 raft_consensus.cc:385] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.754701  3382 raft_consensus.cc:740] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.756098  3383 ts_tablet_manager.cc:1434] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:55.757122  3383 tablet_bootstrap.cc:492] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:55.759172  3537 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.759730  3537 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.760747  3499 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.762152  3537 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:55.762298  3339 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:55.762939  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:55.763660  3190 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:55.763785  3384 tablet_bootstrap.cc:654] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.764067  3383 tablet_bootstrap.cc:654] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.765951  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:55.766700  3268 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:55.764101  3382 consensus_queue.cc:260] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:12:55.768505  3139 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:55.769541  3232 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:55.769840  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:55.770687  3535 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.770838  3497 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.771257  3535 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.771499  3497 raft_consensus.cc:697] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:55.771800  3535 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.772545  3497 consensus_queue.cc:237] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.782339  3382 ts_tablet_manager.cc:1434] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 12:12:55.783849  3382 tablet_bootstrap.cc:492] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:55.792459  3535 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.799383  3383 tablet_bootstrap.cc:492] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:55.799954  3383 ts_tablet_manager.cc:1403] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.000s
I20260709 12:12:55.800053  3384 tablet_bootstrap.cc:492] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:55.800518  3384 ts_tablet_manager.cc:1403] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.070s	user 0.027s	sys 0.009s
I20260709 12:12:55.802775  3383 raft_consensus.cc:359] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.802896  3384 raft_consensus.cc:359] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.803560  3384 raft_consensus.cc:385] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.803830  3384 raft_consensus.cc:740] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.804492  3384 consensus_queue.cc:260] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.807559  3383 raft_consensus.cc:385] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.804970  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:55.808563  3383 raft_consensus.cc:740] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.809201  3190 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.810336  3384 ts_tablet_manager.cc:1434] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:12:55.813308  3383 consensus_queue.cc:260] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.809274  3535 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:55.835155  3384 tablet_bootstrap.cc:492] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:55.838018  3383 ts_tablet_manager.cc:1434] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.038s	user 0.016s	sys 0.009s
I20260709 12:12:55.838948  3383 tablet_bootstrap.cc:492] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:55.812083  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:55.839962  3268 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.842494  3382 tablet_bootstrap.cc:654] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.848049  3497 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.845216  3086 catalog_manager.cc:5697] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.858942  3190 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:55.860286  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:55.861105  3535 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.861593  3535 raft_consensus.cc:697] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:12:55.862673  3535 consensus_queue.cc:237] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.864212  3268 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:55.864504  3400 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.870400  3539 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.871297  3384 tablet_bootstrap.cc:654] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.871063  3539 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.873591  3382 tablet_bootstrap.cc:492] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:55.874065  3382 ts_tablet_manager.cc:1403] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.001s
I20260709 12:12:55.875065  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:55.877977  3539 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:55.879882  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:55.880878  3267 raft_consensus.cc:2393] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 1: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:12:55.883090  3382 raft_consensus.cc:359] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.883908  3382 raft_consensus.cc:385] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.884227  3382 raft_consensus.cc:740] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.884933  3156 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:55.892423  3539 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.904891  3382 consensus_queue.cc:260] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.909335  3382 ts_tablet_manager.cc:1434] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:12:55.911880  3382 tablet_bootstrap.cc:492] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:55.914147  3400 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.914832  3539 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.914791  3400 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.918026  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:55.918273  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:55.919209  3400 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:12:55.919950  3231 leader_election.cc:343] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:55.920698  3232 leader_election.cc:343] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.921178  3232 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:55.922732  3400 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.927227  3383 tablet_bootstrap.cc:654] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.933533  3384 tablet_bootstrap.cc:492] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:55.933990  3384 ts_tablet_manager.cc:1403] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.099s	user 0.021s	sys 0.040s
I20260709 12:12:55.936139  3384 raft_consensus.cc:359] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.935921  3090 catalog_manager.cc:5697] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.936823  3384 raft_consensus.cc:385] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.937157  3384 raft_consensus.cc:740] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.937606  3383 tablet_bootstrap.cc:492] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:55.938084  3383 ts_tablet_manager.cc:1403] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.005s
I20260709 12:12:55.937958  3384 consensus_queue.cc:260] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.939073  3382 tablet_bootstrap.cc:654] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.941274  3384 ts_tablet_manager.cc:1434] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:12:55.943629  3384 tablet_bootstrap.cc:492] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:55.949697  3384 tablet_bootstrap.cc:654] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.953828  3382 tablet_bootstrap.cc:492] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:55.954322  3382 ts_tablet_manager.cc:1403] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.006s
I20260709 12:12:55.955365  3383 raft_consensus.cc:359] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.957029  3382 raft_consensus.cc:359] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.960609  3382 raft_consensus.cc:385] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.960605  3383 raft_consensus.cc:385] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.961058  3382 raft_consensus.cc:740] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.961294  3383 raft_consensus.cc:740] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.961995  3382 consensus_queue.cc:260] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.962086  3383 consensus_queue.cc:260] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.964593  3382 ts_tablet_manager.cc:1434] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:12:55.965553  3382 tablet_bootstrap.cc:492] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:55.969471  3384 tablet_bootstrap.cc:492] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:55.970208  3384 ts_tablet_manager.cc:1403] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.003s
I20260709 12:12:55.972436  3382 tablet_bootstrap.cc:654] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.973634  3384 raft_consensus.cc:359] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.974478  3384 raft_consensus.cc:385] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.974753  3384 raft_consensus.cc:740] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.975605  3384 consensus_queue.cc:260] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:55.978261  3384 ts_tablet_manager.cc:1434] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:12:55.979313  3384 tablet_bootstrap.cc:492] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:55.981259  3383 ts_tablet_manager.cc:1434] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 12:12:55.982460  3383 tablet_bootstrap.cc:492] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:55.989030  3384 tablet_bootstrap.cc:654] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.989030  3383 tablet_bootstrap.cc:654] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.000377  3189 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:56.002807  3535 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.005777  3382 tablet_bootstrap.cc:492] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:56.006300  3382 ts_tablet_manager.cc:1403] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.041s	user 0.023s	sys 0.012s
I20260709 12:12:56.008625  3384 tablet_bootstrap.cc:492] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:56.009294  3384 ts_tablet_manager.cc:1403] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.000s
I20260709 12:12:56.010499  3382 raft_consensus.cc:359] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.011305  3382 raft_consensus.cc:385] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.011605  3382 raft_consensus.cc:740] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.012684  3382 consensus_queue.cc:260] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.011965  3384 raft_consensus.cc:359] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.015255  3384 raft_consensus.cc:385] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.015677  3384 raft_consensus.cc:740] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.016467  3384 consensus_queue.cc:260] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.020510  3382 ts_tablet_manager.cc:1434] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:12:56.021445  3382 tablet_bootstrap.cc:492] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:56.024070  3268 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:12:56.024461  3268 pending_rounds.cc:85] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 0
I20260709 12:12:56.024744  3268 pending_rounds.cc:107] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:12:56.025032  3268 raft_consensus.cc:2889] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:56.026693  3496 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.031194  3384 ts_tablet_manager.cc:1434] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:12:56.033063  3384 tablet_bootstrap.cc:492] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:56.034301  3339 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.039137  3384 tablet_bootstrap.cc:654] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.041512  3383 tablet_bootstrap.cc:492] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:56.041990  3383 ts_tablet_manager.cc:1403] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.004s
I20260709 12:12:56.045192  3383 raft_consensus.cc:359] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.045879  3383 raft_consensus.cc:385] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.046137  3383 raft_consensus.cc:740] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.046774  3383 consensus_queue.cc:260] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.048954  3383 ts_tablet_manager.cc:1434] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:56.049880  3383 tablet_bootstrap.cc:492] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:56.055579  3383 tablet_bootstrap.cc:654] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.059396  3400 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.066579  3383 tablet_bootstrap.cc:492] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:56.067150  3383 ts_tablet_manager.cc:1403] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 12:12:56.069819  3383 raft_consensus.cc:359] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.070503  3383 raft_consensus.cc:385] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.070775  3383 raft_consensus.cc:740] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.071579  3383 consensus_queue.cc:260] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.076217  3383 ts_tablet_manager.cc:1434] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:12:56.077154  3383 tablet_bootstrap.cc:492] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:56.077370  3497 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.078033  3497 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.080394  3502 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.081007  3502 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.088719  3382 tablet_bootstrap.cc:654] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.082461  3497 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:56.116483  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:56.119155  3502 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:56.121730  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:56.123692  3232 leader_election.cc:343] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:56.125730  3231 leader_election.cc:343] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.128402  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:56.129067  3190 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:56.129863  3539 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.132354  3231 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:56.133482  3497 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.133966  3497 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.134399  3497 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.139442  3539 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.140002  3539 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.143119  3543 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.143635  3543 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.147023  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:56.103030  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:56.148453  3157 leader_election.cc:343] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.153831  3543 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:56.155561  3497 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.143271  3539 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:56.161523  3384 tablet_bootstrap.cc:492] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:56.161986  3384 ts_tablet_manager.cc:1403] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.129s	user 0.042s	sys 0.059s
I20260709 12:12:56.158903  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:56.160535  3383 tablet_bootstrap.cc:654] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.163993  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:56.181695  3188 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.181545  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:56.182337  3190 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.158110  3341 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:56.189050  3537 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.189587  3537 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.191831  3537 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:56.192260  3232 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:56.193485  3497 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:56.194286  3497 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.195384  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:56.195657  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:56.194759  3497 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.196870  3497 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.198787  3156 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:12:56.199119  3232 leader_election.cc:343] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.198796  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:56.200066  3539 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.200424  3266 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:56.201475  3508 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.202051  3384 raft_consensus.cc:359] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.202979  3384 raft_consensus.cc:385] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.204032  3190 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:56.206247  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:56.206938  3193 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:56.210320  3537 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.210815  3305 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:56.211680  3537 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.212175  3537 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.203313  3384 raft_consensus.cc:740] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.212596  3537 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.213246  3384 consensus_queue.cc:260] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.215219  3267 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:56.225870  3496 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.231038  3543 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.231935  3537 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.241315  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:56.242102  3193 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.245925  3382 tablet_bootstrap.cc:492] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:56.246387  3382 ts_tablet_manager.cc:1403] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.225s	user 0.007s	sys 0.015s
I20260709 12:12:56.239190  3497 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.248987  3382 raft_consensus.cc:359] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.248708  3231 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:56.270112  3382 raft_consensus.cc:385] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.270427  3382 raft_consensus.cc:740] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.271056  3382 consensus_queue.cc:260] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.272675  3383 tablet_bootstrap.cc:492] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:56.273180  3383 ts_tablet_manager.cc:1403] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.196s	user 0.013s	sys 0.013s
I20260709 12:12:56.273231  3382 ts_tablet_manager.cc:1434] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:12:56.274262  3382 tablet_bootstrap.cc:492] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:56.251461  3156 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:56.276212  3508 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.276808  3508 raft_consensus.cc:697] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:56.276923  3543 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.277312  3543 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.277696  3543 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.277804  3508 consensus_queue.cc:237] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.252565  3537 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:56.280820  3382 tablet_bootstrap.cc:654] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.258744  3497 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:56.249229  3384 ts_tablet_manager.cc:1434] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.003s
I20260709 12:12:56.289731  3384 tablet_bootstrap.cc:492] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:56.291023  3382 tablet_bootstrap.cc:492] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:56.291510  3382 ts_tablet_manager.cc:1403] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:12:56.293910  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:56.294181  3382 raft_consensus.cc:359] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.294852  3382 raft_consensus.cc:385] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.295153  3382 raft_consensus.cc:740] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.295867  3497 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.296619  3383 raft_consensus.cc:359] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.297365  3383 raft_consensus.cc:385] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.297663  3383 raft_consensus.cc:740] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.301745  3384 tablet_bootstrap.cc:654] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.301535  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:56.302280  3268 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:56.303469  3231 leader_election.cc:343] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.307807  3537 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.298352  3383 consensus_queue.cc:260] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.295799  3382 consensus_queue.cc:260] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.257226  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:56.313609  3339 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.313714  3508 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.314582  3508 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.316923  3508 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:56.316885  3382 ts_tablet_manager.cc:1434] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:12:56.323907  3382 tablet_bootstrap.cc:492] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:56.325173  3383 ts_tablet_manager.cc:1434] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.001s
I20260709 12:12:56.326336  3383 tablet_bootstrap.cc:492] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:56.275769  3193 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:56.324041  3537 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.288031  3543 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.329151  3088 catalog_manager.cc:5697] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.324924  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:56.344161  3535 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.344939  3535 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.345925  3338 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:56.331687  3537 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.347744  3535 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:56.351914  3496 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.352355  3496 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.354086  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:56.354676  3537 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:56.461001  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:56.584139  3190 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:56.423615  3539 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.432473  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:56.555341  3339 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:56.591491  3496 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:56.543927  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:56.592293  3383 tablet_bootstrap.cc:654] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.592557  3262 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:56.330755  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 53206.9us
I20260709 12:12:56.586295  3539 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.598680  3382 tablet_bootstrap.cc:654] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.357936  3508 raft_consensus.cc:2804] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.512768  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:12:56.603595  3603 log.cc:927] Time spent T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.252s	user 0.004s	sys 0.021s
I20260709 12:12:56.609635  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:56.478924  3590 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.621888  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:56.357290  3543 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:56.420853  3268 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:56.616999  3193 raft_consensus.cc:2393] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:12:56.625379  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:56.625963  3337 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.568424  3602 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.612699  3508 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.629648  3305 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:56.617419  3590 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:12:56.635480  3305 leader_election.cc:343] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:56.636372  3305 leader_election.cc:343] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.635039  3496 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.639866  3496 raft_consensus.cc:697] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:12:56.640861  3496 consensus_queue.cc:237] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.634724  3508 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.646104  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:56.645496  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:56.660531  3384 tablet_bootstrap.cc:492] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:56.661196  3384 ts_tablet_manager.cc:1403] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.372s	user 0.025s	sys 0.054s
I20260709 12:12:56.657341  3232 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:56.632865  3602 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.657912  3535 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
W20260709 12:12:56.708333  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 51861.1us
I20260709 12:12:56.700827  3497 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:12:56.711207  3305 leader_election.cc:343] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.711594  3305 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:56.704192  3188 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:56.712917  3305 leader_election.cc:343] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.713299  3305 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:56.715615  3497 raft_consensus.cc:697] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:56.716485  3497 consensus_queue.cc:237] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.712495  3508 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.720311  3590 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:56.721635  3508 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:12:56.702099  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 44865.6us
I20260709 12:12:56.726677  3382 tablet_bootstrap.cc:492] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:56.727097  3382 ts_tablet_manager.cc:1403] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.403s	user 0.016s	sys 0.024s
I20260709 12:12:56.729214  3610 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.717926  3537 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.731354  3382 raft_consensus.cc:359] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.732332  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:56.733074  3382 raft_consensus.cc:385] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.733373  3382 raft_consensus.cc:740] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.737171  3382 consensus_queue.cc:260] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.728631  3539 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:56.746045  3382 ts_tablet_manager.cc:1434] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:12:56.747306  3382 tablet_bootstrap.cc:492] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:56.764575  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:56.764876  3602 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:56.765527  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:56.766088  3339 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.766973  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:56.766330  3384 raft_consensus.cc:359] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.768217  3384 raft_consensus.cc:385] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.768492  3384 raft_consensus.cc:740] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.769182  3193 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:56.771481  3384 consensus_queue.cc:260] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:12:56.777009  3232 leader_election.cc:343] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.778604  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:56.778999  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:56.779313  3266 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:56.779676  3190 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.783191  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:56.779084  3087 catalog_manager.cc:5697] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.790128  3384 ts_tablet_manager.cc:1434] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.129s	user 0.007s	sys 0.001s
I20260709 12:12:56.814146  3384 tablet_bootstrap.cc:492] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:56.764065  3337 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:56.795285  3090 catalog_manager.cc:5697] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.818608  3609 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.813123  3156 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:56.821254  3383 tablet_bootstrap.cc:492] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:56.821750  3383 ts_tablet_manager.cc:1403] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.496s	user 0.058s	sys 0.095s
I20260709 12:12:56.810372  3339 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:56.827227  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:56.827602  3539 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.828022  3539 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.828334  3539 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.829347  3383 raft_consensus.cc:359] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.830057  3383 raft_consensus.cc:385] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.830317  3383 raft_consensus.cc:740] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.830976  3497 raft_consensus.cc:2804] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.831089  3231 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:56.831630  3497 raft_consensus.cc:697] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:56.832111  3508 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.832526  3508 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.832505  3497 consensus_queue.cc:237] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.833148  3508 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.830993  3383 consensus_queue.cc:260] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.816150  3190 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:56.840342  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:56.843890  3262 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:56.844568  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:56.847330  3232 consensus_peers.cc:597] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:56.849221  3383 ts_tablet_manager.cc:1434] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:12:56.860647  3383 tablet_bootstrap.cc:492] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:56.862409  3157 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:56.863289  3602 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.863941  3602 raft_consensus.cc:697] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:56.865020  3602 consensus_queue.cc:237] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.868667  3539 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.870990  3539 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:12:56.873054  3157 leader_election.cc:343] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.874589  3157 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:56.875275  3382 tablet_bootstrap.cc:654] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.877072  3591 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.912425  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:12:56.915562  3157 leader_election.cc:343] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.915742  3086 catalog_manager.cc:5697] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.915915  3087 catalog_manager.cc:5697] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.908208  3508 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.923991  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:56.924926  3262 raft_consensus.cc:2393] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:12:56.926227  3384 tablet_bootstrap.cc:654] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.942103  3383 tablet_bootstrap.cc:654] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.942478  3382 tablet_bootstrap.cc:492] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:56.948828  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:12:56.950215  3232 leader_election.cc:343] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.950837  3508 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:56.943249  3382 ts_tablet_manager.cc:1403] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.196s	user 0.015s	sys 0.002s
I20260709 12:12:56.954799  3400 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.955258  3383 tablet_bootstrap.cc:492] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:56.955765  3383 ts_tablet_manager.cc:1403] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.005s
W20260709 12:12:56.952418  3139 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:56.960094  3400 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.960121  3383 raft_consensus.cc:359] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.957633  3382 raft_consensus.cc:359] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.961100  3383 raft_consensus.cc:385] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.961251  3382 raft_consensus.cc:385] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.961438  3383 raft_consensus.cc:740] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.961560  3382 raft_consensus.cc:740] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.962335  3382 consensus_queue.cc:260] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.962335  3383 consensus_queue.cc:260] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.964537  3383 ts_tablet_manager.cc:1434] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:56.965293  3156 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:56.966050  3591 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.966964  3383 tablet_bootstrap.cc:492] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:56.973387  3383 tablet_bootstrap.cc:654] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.976603  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:56.977756  3191 raft_consensus.cc:2393] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 1: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:12:56.985035  3383 tablet_bootstrap.cc:492] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:56.985505  3383 ts_tablet_manager.cc:1403] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:12:56.986976  3382 ts_tablet_manager.cc:1434] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:12:56.988013  3382 tablet_bootstrap.cc:492] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:56.988257  3383 raft_consensus.cc:359] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.988940  3383 raft_consensus.cc:385] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.989212  3383 raft_consensus.cc:740] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.990043  3383 consensus_queue.cc:260] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:56.992352  3383 ts_tablet_manager.cc:1434] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:12:56.993368  3383 tablet_bootstrap.cc:492] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:56.996541  3382 tablet_bootstrap.cc:654] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.002848  3383 tablet_bootstrap.cc:654] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.009102  3591 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.009709  3591 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.013110  3591 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.013052  3231 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:57.014576  3400 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.017112  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:57.017786  3339 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:57.019140  3157 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:57.019735  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:57.020244  3591 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.020722  3591 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.021181  3591 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:57.022456  3156 leader_election.cc:343] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.025190  3609 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.025640  3609 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.027911  3609 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:57.028633  3382 tablet_bootstrap.cc:492] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:57.029697  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:57.030094  3382 ts_tablet_manager.cc:1403] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.007s
I20260709 12:12:57.029714  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:12:57.032327  3305 leader_election.cc:343] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.032931  3382 raft_consensus.cc:359] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.033655  3382 raft_consensus.cc:385] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:57.033730  3305 leader_election.cc:343] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.033993  3382 raft_consensus.cc:740] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.034090  3591 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.035786  3305 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:57.034883  3382 consensus_queue.cc:260] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.036666  3383 tablet_bootstrap.cc:492] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:57.036929  3613 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.037146  3383 ts_tablet_manager.cc:1403] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.006s
I20260709 12:12:57.038010  3382 ts_tablet_manager.cc:1434] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 12:12:57.039479  3382 tablet_bootstrap.cc:492] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:57.039697  3383 raft_consensus.cc:359] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.040313  3383 raft_consensus.cc:385] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.040553  3383 raft_consensus.cc:740] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.028882  3384 tablet_bootstrap.cc:492] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:57.042344  3384 ts_tablet_manager.cc:1403] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.228s	user 0.031s	sys 0.028s
I20260709 12:12:57.041184  3383 consensus_queue.cc:260] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.045040  3384 raft_consensus.cc:359] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.045526  3383 ts_tablet_manager.cc:1434] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:12:57.045724  3384 raft_consensus.cc:385] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.045890  3591 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.046123  3384 raft_consensus.cc:740] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.046350  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:57.046931  3383 tablet_bootstrap.cc:492] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:57.047045  3384 consensus_queue.cc:260] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.049278  3384 ts_tablet_manager.cc:1434] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:57.050305  3384 tablet_bootstrap.cc:492] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:57.053577  3383 tablet_bootstrap.cc:654] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.056421  3384 tablet_bootstrap.cc:654] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.058670  3383 tablet_bootstrap.cc:492] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:57.059167  3383 ts_tablet_manager.cc:1403] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:12:57.060477  3384 tablet_bootstrap.cc:492] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:57.060868  3384 ts_tablet_manager.cc:1403] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:12:57.061892  3383 raft_consensus.cc:359] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.062637  3383 raft_consensus.cc:385] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.062708  3384 raft_consensus.cc:359] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.062999  3383 raft_consensus.cc:740] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.063928  3383 consensus_queue.cc:260] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.065181  3591 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.065579  3383 ts_tablet_manager.cc:1434] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:57.065462  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:57.065606  3591 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.066301  3266 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.066645  3383 tablet_bootstrap.cc:492] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:57.067767  3591 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.063364  3384 raft_consensus.cc:385] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.070101  3384 raft_consensus.cc:740] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.070815  3384 consensus_queue.cc:260] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.071139  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:57.072571  3157 leader_election.cc:343] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.074465  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:57.046972  3339 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.077035  3383 tablet_bootstrap.cc:654] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.078198  3384 ts_tablet_manager.cc:1434] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
W20260709 12:12:57.078325  3156 leader_election.cc:343] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.078733  3156 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:57.079151  3384 tablet_bootstrap.cc:492] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:57.080202  3543 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.074479  3266 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:57.082521  3156 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:57.083482  3591 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.084184  3591 raft_consensus.cc:697] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:57.085381  3384 tablet_bootstrap.cc:654] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.085301  3591 consensus_queue.cc:237] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.091496  3609 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.092370  3609 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.099516  3609 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:57.101464  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:57.102391  3191 raft_consensus.cc:2393] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:12:57.104396  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:57.105217  3266 raft_consensus.cc:2393] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:12:57.106998  3305 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:57.109043  3609 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.110615  3339 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:57.117046  3382 tablet_bootstrap.cc:654] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.118896  3383 tablet_bootstrap.cc:492] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:57.119462  3383 ts_tablet_manager.cc:1403] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.008s
I20260709 12:12:57.119963  3384 tablet_bootstrap.cc:492] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:57.120536  3384 ts_tablet_manager.cc:1403] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.012s
I20260709 12:12:57.123529  3191 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.125900  3602 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.126245  3609 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.126395  3602 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.133939  3496 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.134598  3590 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.135118  3590 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.135540  3496 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.139868  3383 raft_consensus.cc:359] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.139056  3384 raft_consensus.cc:359] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.138732  3590 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.141188  3383 raft_consensus.cc:385] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.141199  3384 raft_consensus.cc:385] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.142266  3383 raft_consensus.cc:740] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.142270  3384 raft_consensus.cc:740] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.143730  3384 consensus_queue.cc:260] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.144769  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:57.143743  3383 consensus_queue.cc:260] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.150137  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:57.151124  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:57.151461  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:57.152149  3193 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:57.152314  3266 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:57.155812  3156 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:12:57.156452  3157 leader_election.cc:343] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.158043  3590 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.153788  3231 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:57.161150  3384 ts_tablet_manager.cc:1434] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 12:12:57.136058  3496 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.162335  3590 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.162794  3590 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.163185  3590 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.164408  3496 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:57.138978  3602 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.170856  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:57.171255  3539 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.171653  3268 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:57.171675  3539 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:57.165994  3232 leader_election.cc:343] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.172868  3539 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.176512  3384 tablet_bootstrap.cc:492] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:57.178836  3305 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:57.183059  3383 ts_tablet_manager.cc:1434] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.002s
I20260709 12:12:57.180866  3613 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.175714  3590 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.184594  3383 tablet_bootstrap.cc:492] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:57.184850  3589 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:57.191952  3382 tablet_bootstrap.cc:492] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:57.192435  3382 ts_tablet_manager.cc:1403] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.153s	user 0.027s	sys 0.029s
I20260709 12:12:57.184979  3613 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.185418  3602 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.201237  3539 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.189114  3535 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:12:57.198633  3613 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.186066  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:12:57.208030  3305 leader_election.cc:343] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.216931  3087 catalog_manager.cc:5697] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.208398  3602 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.227079  3589 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.227665  3589 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.230767  3589 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.230583  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:57.233160  3384 tablet_bootstrap.cc:654] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.236814  3268 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:57.241694  3602 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.247821  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:57.248611  3341 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:57.247135  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:57.251188  3157 leader_election.cc:343] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.252274  3383 tablet_bootstrap.cc:654] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.252455  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:57.252820  3382 raft_consensus.cc:359] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.255599  3382 raft_consensus.cc:385] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.255951  3382 raft_consensus.cc:740] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.258980  3539 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.264117  3589 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.264729  3589 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.266844  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:57.266917  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:57.270870  3497 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.274148  3382 consensus_queue.cc:260] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.265060  3590 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.278005  3382 ts_tablet_manager.cc:1434] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.001s
I20260709 12:12:57.280390  3382 tablet_bootstrap.cc:492] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:57.273397  3589 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.262894  3156 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:12:57.303216  3634 log.cc:927] Time spent T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:12:57.278487  3613 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.308014  3539 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:57.305401  3232 leader_election.cc:343] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.314020  3539 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:57.313419  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 50637.8us
I20260709 12:12:57.328001  3539 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.358492  3589 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.367862  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:12:57.368423  3637 log.cc:927] Time spent T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:12:57.371402  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:57.372229  3190 raft_consensus.cc:2393] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 1: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:12:57.377018  3231 leader_election.cc:343] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.377544  3383 tablet_bootstrap.cc:492] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:57.378062  3383 ts_tablet_manager.cc:1403] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.194s	user 0.018s	sys 0.017s
I20260709 12:12:57.378165  3613 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:57.378082  3231 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:57.390914  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:57.388818  3400 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.395783  3382 tablet_bootstrap.cc:654] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.401753  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:57.401954  3383 raft_consensus.cc:359] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.402427  3261 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.402568  3383 raft_consensus.cc:385] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.402877  3383 raft_consensus.cc:740] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.390954  3543 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.406183  3266 raft_consensus.cc:2393] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:12:57.407716  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:12:57.408995  3305 leader_election.cc:343] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.409401  3543 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.411561  3543 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.412114  3589 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.413738  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:57.414336  3340 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:57.415174  3539 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.415612  3157 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:57.416474  3602 raft_consensus.cc:2804] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.416857  3602 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.417188  3602 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.417335  3539 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.403589  3383 consensus_queue.cc:260] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.420481  3589 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.425611  3156 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:57.428689  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:57.434399  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:57.437263  3340 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.443742  3539 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.444113  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:57.444984  3337 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.449810  3261 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:57.451908  3383 ts_tablet_manager.cc:1434] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 12:12:57.454286  3305 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:57.456092  3384 tablet_bootstrap.cc:492] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:57.456506  3384 ts_tablet_manager.cc:1403] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.288s	user 0.019s	sys 0.012s
W20260709 12:12:57.454528  3231 leader_election.cc:343] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.458308  3539 consensus_queue.cc:1048] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.459277  3383 tablet_bootstrap.cc:492] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:57.466852  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:57.467556  3264 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.477259  3384 raft_consensus.cc:359] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.477960  3384 raft_consensus.cc:385] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.478188  3384 raft_consensus.cc:740] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.479035  3384 consensus_queue.cc:260] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.468737  3496 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.481710  3599 consensus_queue.cc:1048] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:12:57.482336  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:57.490455  3496 raft_consensus.cc:697] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:12:57.494279  3496 consensus_queue.cc:237] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.495664  3602 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.500629  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:57.501451  3339 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.518219  3339 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:57.523751  3384 ts_tablet_manager.cc:1434] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.004s
I20260709 12:12:57.526934  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:57.527305  3157 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:57.531641  3384 tablet_bootstrap.cc:492] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:57.530601  3383 tablet_bootstrap.cc:654] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.520296  3602 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.536557  3539 raft_consensus.cc:2804] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.539661  3340 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
W20260709 12:12:57.529151  3156 leader_election.cc:343] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.547348  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:57.541970  3539 raft_consensus.cc:697] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:57.552119  3640 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.552795  3539 consensus_queue.cc:237] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.554278  3640 raft_consensus.cc:697] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:57.555846  3640 consensus_queue.cc:237] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:12:57.556577  3156 leader_election.cc:343] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.571601  3087 catalog_manager.cc:5697] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:57.577363  3382 tablet_bootstrap.cc:492] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:57.577932  3382 ts_tablet_manager.cc:1403] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.298s	user 0.014s	sys 0.014s
I20260709 12:12:57.579890  3264 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:57.581195  3382 raft_consensus.cc:359] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.582190  3382 raft_consensus.cc:385] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.582471  3382 raft_consensus.cc:740] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.583174  3382 consensus_queue.cc:260] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.584839  3382 ts_tablet_manager.cc:1434] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:57.584357  3156 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:57.585695  3599 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.585839  3382 tablet_bootstrap.cc:492] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:57.586190  3599 raft_consensus.cc:697] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:57.587558  3337 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:57.587064  3599 consensus_queue.cc:237] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.599653  3383 tablet_bootstrap.cc:492] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:57.600193  3383 ts_tablet_manager.cc:1403] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.002s
I20260709 12:12:57.603844  3384 tablet_bootstrap.cc:654] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.605037  3383 raft_consensus.cc:359] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.606853  3383 raft_consensus.cc:385] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.607445  3383 raft_consensus.cc:740] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.608574  3383 consensus_queue.cc:260] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.620819  3383 ts_tablet_manager.cc:1434] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:12:57.621798  3383 tablet_bootstrap.cc:492] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:57.629127  3090 catalog_manager.cc:5697] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.645015  3382 tablet_bootstrap.cc:654] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.649097  3337 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.654109  3602 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.659804  3383 tablet_bootstrap.cc:654] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.680522  3384 tablet_bootstrap.cc:492] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:57.680385  3088 catalog_manager.cc:5697] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.681361  3384 ts_tablet_manager.cc:1403] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.150s	user 0.014s	sys 0.002s
I20260709 12:12:57.682041  3382 tablet_bootstrap.cc:492] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:57.682504  3382 ts_tablet_manager.cc:1403] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.006s
I20260709 12:12:57.685130  3382 raft_consensus.cc:359] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.685854  3382 raft_consensus.cc:385] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.685213  3384 raft_consensus.cc:359] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.686160  3382 raft_consensus.cc:740] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.686299  3384 raft_consensus.cc:385] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.686933  3384 raft_consensus.cc:740] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.687851  3384 consensus_queue.cc:260] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.693212  3539 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.709919  3384 ts_tablet_manager.cc:1434] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:12:57.711033  3384 tablet_bootstrap.cc:492] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:57.686949  3382 consensus_queue.cc:260] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.719769  3384 tablet_bootstrap.cc:654] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.725428  3382 ts_tablet_manager.cc:1434] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 12:12:57.725351  3087 catalog_manager.cc:5697] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.726739  3382 tablet_bootstrap.cc:492] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:57.731936  3383 tablet_bootstrap.cc:492] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:57.732492  3383 ts_tablet_manager.cc:1403] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.111s	user 0.035s	sys 0.013s
I20260709 12:12:57.734436  3382 tablet_bootstrap.cc:654] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.734823  3384 tablet_bootstrap.cc:492] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:57.735292  3384 ts_tablet_manager.cc:1403] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 12:12:57.735615  3383 raft_consensus.cc:359] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.736299  3383 raft_consensus.cc:385] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.736554  3383 raft_consensus.cc:740] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.737233  3383 consensus_queue.cc:260] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.739377  3383 ts_tablet_manager.cc:1434] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:57.740470  3383 tablet_bootstrap.cc:492] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:57.747402  3383 tablet_bootstrap.cc:654] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.738751  3384 raft_consensus.cc:359] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.751700  3384 raft_consensus.cc:385] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.752017  3384 raft_consensus.cc:740] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.752948  3384 consensus_queue.cc:260] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.755036  3384 ts_tablet_manager.cc:1434] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:12:57.755945  3384 tablet_bootstrap.cc:492] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:57.759490  3382 tablet_bootstrap.cc:492] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:57.761804  3384 tablet_bootstrap.cc:654] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.761940  3383 tablet_bootstrap.cc:492] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:57.762421  3383 ts_tablet_manager.cc:1403] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.007s
I20260709 12:12:57.762784  3382 ts_tablet_manager.cc:1403] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.012s
I20260709 12:12:57.765156  3383 raft_consensus.cc:359] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.765872  3383 raft_consensus.cc:385] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.766122  3383 raft_consensus.cc:740] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.766283  3382 raft_consensus.cc:359] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.766906  3382 raft_consensus.cc:385] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.766753  3383 consensus_queue.cc:260] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.767166  3382 raft_consensus.cc:740] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.767817  3382 consensus_queue.cc:260] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.770006  3382 ts_tablet_manager.cc:1434] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:57.772523  3383 ts_tablet_manager.cc:1434] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:12:57.773434  3383 tablet_bootstrap.cc:492] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:57.775620  3382 tablet_bootstrap.cc:492] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:57.780037  3383 tablet_bootstrap.cc:654] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.781919  3384 tablet_bootstrap.cc:492] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:57.782368  3384 ts_tablet_manager.cc:1403] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.006s
I20260709 12:12:57.782744  3382 tablet_bootstrap.cc:654] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.785010  3384 raft_consensus.cc:359] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.785701  3384 raft_consensus.cc:385] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.785953  3384 raft_consensus.cc:740] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.786564  3384 consensus_queue.cc:260] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.788709  3384 ts_tablet_manager.cc:1434] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:12:57.789568  3384 tablet_bootstrap.cc:492] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:57.795496  3384 tablet_bootstrap.cc:654] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.800855  3384 tablet_bootstrap.cc:492] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:57.801309  3384 ts_tablet_manager.cc:1403] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:12:57.803872  3384 raft_consensus.cc:359] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.804498  3384 raft_consensus.cc:385] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.804842  3384 raft_consensus.cc:740] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.805472  3384 consensus_queue.cc:260] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.810420  3384 ts_tablet_manager.cc:1434] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:12:57.811623  3384 tablet_bootstrap.cc:492] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:57.818234  3384 tablet_bootstrap.cc:654] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.823953  3383 tablet_bootstrap.cc:492] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:57.824572  3539 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.825081  3383 ts_tablet_manager.cc:1403] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.023s
I20260709 12:12:57.825044  3539 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.827005  3539 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.828302  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:57.830792  3157 leader_election.cc:343] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.830842  3383 raft_consensus.cc:359] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.831727  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:57.831929  3383 raft_consensus.cc:385] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.832350  3383 raft_consensus.cc:740] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.833158  3383 consensus_queue.cc:260] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.824668  3382 tablet_bootstrap.cc:492] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:57.835664  3382 ts_tablet_manager.cc:1403] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.060s	user 0.029s	sys 0.019s
I20260709 12:12:57.838069  3382 raft_consensus.cc:359] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.838693  3382 raft_consensus.cc:385] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.838939  3382 raft_consensus.cc:740] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.839584  3382 consensus_queue.cc:260] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.841140  3383 ts_tablet_manager.cc:1434] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:12:57.841902  3382 ts_tablet_manager.cc:1434] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:57.842083  3383 tablet_bootstrap.cc:492] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:57.842907  3382 tablet_bootstrap.cc:492] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
W20260709 12:12:57.847101  3156 leader_election.cc:343] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.847718  3156 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:57.852197  3599 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.862164  3382 tablet_bootstrap.cc:654] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.864377  3384 tablet_bootstrap.cc:492] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:57.864348  3383 tablet_bootstrap.cc:654] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.865007  3384 ts_tablet_manager.cc:1403] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.013s
I20260709 12:12:57.867780  3384 raft_consensus.cc:359] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.868570  3384 raft_consensus.cc:385] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.869617  3384 raft_consensus.cc:740] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.870342  3384 consensus_queue.cc:260] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.871124  3382 tablet_bootstrap.cc:492] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:57.871809  3382 ts_tablet_manager.cc:1403] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 12:12:57.874327  3382 raft_consensus.cc:359] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.874961  3382 raft_consensus.cc:385] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.875203  3382 raft_consensus.cc:740] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.875808  3382 consensus_queue.cc:260] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.880995  3384 ts_tablet_manager.cc:1434] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:12:57.882036  3384 tablet_bootstrap.cc:492] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:57.887796  3384 tablet_bootstrap.cc:654] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.890455  3382 ts_tablet_manager.cc:1434] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:12:57.891678  3382 tablet_bootstrap.cc:492] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:57.894454  3383 tablet_bootstrap.cc:492] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:57.894991  3383 ts_tablet_manager.cc:1403] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.010s
I20260709 12:12:57.896680  3384 tablet_bootstrap.cc:492] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:57.897130  3384 ts_tablet_manager.cc:1403] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:12:57.897456  3382 tablet_bootstrap.cc:654] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.897830  3383 raft_consensus.cc:359] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.898574  3383 raft_consensus.cc:385] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.898881  3383 raft_consensus.cc:740] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.899879  3383 consensus_queue.cc:260] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.902438  3383 ts_tablet_manager.cc:1434] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:57.903328  3383 tablet_bootstrap.cc:492] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:57.899672  3384 raft_consensus.cc:359] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.905279  3384 raft_consensus.cc:385] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.905640  3384 raft_consensus.cc:740] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.908300  3384 consensus_queue.cc:260] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.911419  3384 ts_tablet_manager.cc:1434] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:12:57.912094  3383 tablet_bootstrap.cc:654] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.912683  3384 tablet_bootstrap.cc:492] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:57.920385  3599 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.920917  3599 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.922485  3384 tablet_bootstrap.cc:654] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.924011  3599 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.925354  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:57.926015  3339 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:57.927253  3157 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:57.928999  3539 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.929396  3539 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.929747  3539 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.930831  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:57.931586  3264 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:57.941365  3384 tablet_bootstrap.cc:492] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:57.941869  3384 ts_tablet_manager.cc:1403] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.000s
I20260709 12:12:57.939056  3539 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.947544  3543 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.948190  3543 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.950714  3543 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.950857  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:57.951540  3341 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.951465  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:57.947512  3539 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.952293  3262 raft_consensus.cc:2393] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 1: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:12:57.944902  3384 raft_consensus.cc:359] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.953078  3384 raft_consensus.cc:385] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.953415  3384 raft_consensus.cc:740] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.954099  3539 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.954641  3539 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.957156  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:57.957794  3382 tablet_bootstrap.cc:492] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:57.958407  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:57.958228  3384 consensus_queue.cc:260] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.959044  3262 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:57.960304  3156 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:57.960453  3384 ts_tablet_manager.cc:1434] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:12:57.961066  3543 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.961539  3543 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.961977  3543 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.970180  3640 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.970685  3640 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.971580  3539 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.972097  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:57.972755  3339 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:57.973260  3543 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.958994  3157 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:57.970211  3191 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.975945  3543 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.958259  3382 ts_tablet_manager.cc:1403] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.022s
I20260709 12:12:57.977653  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:57.978219  3339 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.980307  3384 tablet_bootstrap.cc:492] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:57.981223  3639 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.981712  3639 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.986673  3639 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:57.987532  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:57.988168  3193 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:57.990788  3231 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:57.992149  3339 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:57.997280  3382 raft_consensus.cc:359] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:57.998288  3382 raft_consensus.cc:385] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.998648  3382 raft_consensus.cc:740] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.000460  3157 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:58.002372  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:57.988950  3496 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.004747  3496 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.003769  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:57.997061  3400 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.007225  3602 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.007402  3189 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:58.007757  3400 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.008280  3400 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.013954  3496 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:58.014030  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:58.002985  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:58.014935  3193 raft_consensus.cc:2393] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:12:58.011544  3640 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.011705  3539 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.014962  3341 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:58.017297  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:58.016018  3539 raft_consensus.cc:697] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:58.015412  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:58.018661  3264 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.018886  3539 consensus_queue.cc:237] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.020959  3157 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:58.003018  3382 consensus_queue.cc:260] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.024462  3231 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:58.014997  3262 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.025660  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:58.025326  3591 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.026405  3266 raft_consensus.cc:2393] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:12:58.026358  3591 raft_consensus.cc:697] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:58.031872  3591 consensus_queue.cc:237] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.034066  3589 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.034448  3589 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.035173  3589 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.041004  3305 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:58.042574  3382 ts_tablet_manager.cc:1434] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.002s
I20260709 12:12:58.030010  3337 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:58.043596  3382 tablet_bootstrap.cc:492] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:58.043303  3496 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:58.037998  3232 leader_election.cc:343] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.041570  3640 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.048314  3543 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.052086  3640 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.054208  3640 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.058406  3382 tablet_bootstrap.cc:654] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.060792  3087 catalog_manager.cc:5697] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.063934  3264 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:58.066452  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:58.067832  3262 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
W20260709 12:12:58.068594  3232 leader_election.cc:343] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.070250  3383 tablet_bootstrap.cc:492] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:58.070549  3640 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.070691  3383 ts_tablet_manager.cc:1403] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.168s	user 0.029s	sys 0.049s
I20260709 12:12:58.073781  3383 raft_consensus.cc:359] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.074608  3383 raft_consensus.cc:385] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.074941  3383 raft_consensus.cc:740] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.071024  3640 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.075237  3496 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.060278  3400 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.070577  3589 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.080617  3640 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.080475  3383 consensus_queue.cc:260] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.081586  3613 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.082087  3383 ts_tablet_manager.cc:1434] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.005s
I20260709 12:12:58.081916  3508 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.083184  3383 tablet_bootstrap.cc:492] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:58.083289  3508 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.083758  3508 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.094684  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:58.083300  3400 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.096448  3599 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:12:58.100252  3090 catalog_manager.cc:5697] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:58.107414  3156 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:58.109938  3231 leader_election.cc:343] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.105821  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:58.112615  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:58.113547  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:12:58.113976  3231 leader_election.cc:343] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.114166  3192 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.114377  3231 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:58.115365  3400 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.117372  3496 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:12:58.120353  3189 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.123545  3589 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.103989  3508 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.128103  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:58.109367  3599 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:12:58.137416  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:58.138509  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:58.152997  3340 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:58.165084  3232 leader_election.cc:343] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:58.166196  3231 leader_election.cc:343] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.163316  3192 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:58.170739  3231 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:58.165735  3232 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:58.168321  3382 tablet_bootstrap.cc:492] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:58.174154  3382 ts_tablet_manager.cc:1403] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.009s
I20260709 12:12:58.175073  3508 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.175276  3639 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.175659  3508 raft_consensus.cc:697] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:58.176590  3508 consensus_queue.cc:237] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.174751  3191 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:58.179836  3676 log.cc:927] Time spent T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:12:58.184968  3589 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.199559  3383 tablet_bootstrap.cc:654] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.200646  3382 raft_consensus.cc:359] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.201393  3382 raft_consensus.cc:385] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.201751  3382 raft_consensus.cc:740] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.202489  3382 consensus_queue.cc:260] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.205586  3340 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:58.206609  3382 ts_tablet_manager.cc:1434] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.004s
I20260709 12:12:58.207300  3384 tablet_bootstrap.cc:654] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.208724  3639 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.209769  3639 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.213035  3639 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.214182  3191 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:58.216827  3382 tablet_bootstrap.cc:492] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:58.216764  3231 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:58.217617  3589 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.218530  3589 raft_consensus.cc:697] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:58.239333  3090 catalog_manager.cc:5697] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.250638  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:58.260277  3193 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:58.261899  3231 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:58.264142  3639 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.264786  3639 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.265303  3639 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:58.274541  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 59899.2us
I20260709 12:12:58.256052  3589 consensus_queue.cc:237] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.280409  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:58.280623  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:58.308030  3684 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.308583  3684 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.310623  3684 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:58.319478  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:58.324810  3384 tablet_bootstrap.cc:492] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:58.325487  3384 ts_tablet_manager.cc:1403] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.345s	user 0.020s	sys 0.005s
I20260709 12:12:58.322813  3339 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:58.343879  3384 raft_consensus.cc:359] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.344652  3384 raft_consensus.cc:385] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.344933  3384 raft_consensus.cc:740] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.345556  3384 consensus_queue.cc:260] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.334754  3639 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.335990  3382 tablet_bootstrap.cc:654] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:58.338465  3139 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:58.355288  3384 ts_tablet_manager.cc:1434] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 12:12:58.357204  3384 tablet_bootstrap.cc:492] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:58.368919  3383 tablet_bootstrap.cc:492] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:58.369669  3383 ts_tablet_manager.cc:1403] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.287s	user 0.026s	sys 0.026s
W20260709 12:12:58.364195  3232 leader_election.cc:343] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.372115  3232 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:12:58.375970  3232 leader_election.cc:343] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.378717  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:58.379894  3262 raft_consensus.cc:2393] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:12:58.378113  3400 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.393126  3384 tablet_bootstrap.cc:654] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.400449  3543 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.401014  3543 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.402634  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:58.403266  3193 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:58.403162  3543 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.411726  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:12:58.413913  3613 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.419872  3613 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.420416  3613 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.421732  3382 tablet_bootstrap.cc:492] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:58.422256  3382 ts_tablet_manager.cc:1403] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.206s	user 0.021s	sys 0.017s
I20260709 12:12:58.419816  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:58.423362  3087 catalog_manager.cc:5697] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.416020  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:58.417223  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:58.424988  3193 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.430025  3382 raft_consensus.cc:359] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:12:58.430349  3157 leader_election.cc:343] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.430945  3382 raft_consensus.cc:385] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.431357  3382 raft_consensus.cc:740] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
W20260709 12:12:58.434351  3156 leader_election.cc:343] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.434468  3639 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.434825  3156 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:58.436194  3193 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:58.437040  3599 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.442317  3383 raft_consensus.cc:359] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.447960  3383 raft_consensus.cc:385] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.448364  3383 raft_consensus.cc:740] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.432143  3382 consensus_queue.cc:260] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.452605  3382 ts_tablet_manager.cc:1434] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:12:58.452472  3383 consensus_queue.cc:260] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.459333  3231 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:58.461151  3698 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.461691  3698 raft_consensus.cc:697] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:58.462582  3698 consensus_queue.cc:237] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.465539  3383 ts_tablet_manager.cc:1434] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.095s	user 0.003s	sys 0.003s
I20260709 12:12:58.466639  3383 tablet_bootstrap.cc:492] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:58.469308  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:58.471810  3382 tablet_bootstrap.cc:492] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:58.443814  3613 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.473573  3339 raft_consensus.cc:2393] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 1: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:12:58.473857  3543 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.474905  3384 tablet_bootstrap.cc:492] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:58.475347  3384 ts_tablet_manager.cc:1403] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.118s	user 0.022s	sys 0.012s
I20260709 12:12:58.477892  3384 raft_consensus.cc:359] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.478538  3384 raft_consensus.cc:385] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.478814  3384 raft_consensus.cc:740] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.479773  3384 consensus_queue.cc:260] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.488026  3613 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:58.488716  3384 ts_tablet_manager.cc:1434] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 12:12:58.489909  3384 tablet_bootstrap.cc:492] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:58.491022  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:58.491957  3193 raft_consensus.cc:2393] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:12:58.492520  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:58.494338  3591 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.495766  3383 tablet_bootstrap.cc:654] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.497373  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:58.498239  3496 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.517033  3382 tablet_bootstrap.cc:654] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.517609  3383 tablet_bootstrap.cc:492] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:58.518092  3383 ts_tablet_manager.cc:1403] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.002s
I20260709 12:12:58.522639  3384 tablet_bootstrap.cc:654] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.523386  3087 catalog_manager.cc:5697] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.527994  3602 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.547537  3496 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.548418  3496 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.549405  3383 raft_consensus.cc:359] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.550357  3383 raft_consensus.cc:385] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.550700  3383 raft_consensus.cc:740] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.551010  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:58.556387  3383 consensus_queue.cc:260] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:12:58.557291  3305 leader_election.cc:343] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.557767  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:58.558427  3268 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:58.559582  3305 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:58.550370  3496 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:58.561192  3613 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.562104  3613 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.563222  3613 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.566592  3382 tablet_bootstrap.cc:492] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:58.567070  3382 ts_tablet_manager.cc:1403] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.095s	user 0.022s	sys 0.010s
I20260709 12:12:58.568457  3383 ts_tablet_manager.cc:1434] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.007s
I20260709 12:12:58.570505  3613 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.572352  3383 tablet_bootstrap.cc:492] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:58.574151  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:58.574342  3382 raft_consensus.cc:359] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.575032  3382 raft_consensus.cc:385] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.575302  3382 raft_consensus.cc:740] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
W20260709 12:12:58.576208  3305 leader_election.cc:343] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.578642  3383 tablet_bootstrap.cc:654] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.578730  3613 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:58.583745  3264 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.583853  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:58.584488  3268 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.591066  3382 consensus_queue.cc:260] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.593997  3382 ts_tablet_manager.cc:1434] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:12:58.596694  3384 tablet_bootstrap.cc:492] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:58.597196  3384 ts_tablet_manager.cc:1403] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.002s
I20260709 12:12:58.599974  3384 raft_consensus.cc:359] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.600381  3268 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:58.600728  3384 raft_consensus.cc:385] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.601065  3384 raft_consensus.cc:740] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.603868  3382 tablet_bootstrap.cc:492] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:58.609342  3384 consensus_queue.cc:260] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.611477  3602 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.612936  3384 ts_tablet_manager.cc:1434] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:12:58.613922  3384 tablet_bootstrap.cc:492] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:58.615758  3305 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:12:58.617959  3683 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.618660  3683 raft_consensus.cc:697] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:12:58.619503  3683 consensus_queue.cc:237] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.620452  3383 tablet_bootstrap.cc:492] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:58.620903  3383 ts_tablet_manager.cc:1403] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.000s
I20260709 12:12:58.621006  3382 tablet_bootstrap.cc:654] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.623675  3383 raft_consensus.cc:359] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.624426  3383 raft_consensus.cc:385] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.624693  3383 raft_consensus.cc:740] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.625128  3384 tablet_bootstrap.cc:654] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.625386  3383 consensus_queue.cc:260] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.627574  3383 ts_tablet_manager.cc:1434] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:12:58.631071  3639 consensus_queue.cc:1048] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.631800  3400 consensus_queue.cc:1048] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.634558  3383 tablet_bootstrap.cc:492] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:58.635805  3602 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.636288  3602 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.638240  3384 tablet_bootstrap.cc:492] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:58.638715  3384 ts_tablet_manager.cc:1403] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.003s
I20260709 12:12:58.642021  3383 tablet_bootstrap.cc:654] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.645130  3602 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.645052  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:58.645783  3340 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:58.646992  3157 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:58.648403  3602 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.648774  3602 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.649120  3602 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.654409  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:58.655164  3383 tablet_bootstrap.cc:492] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:58.655882  3383 ts_tablet_manager.cc:1403] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 12:12:58.655140  3266 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:58.659050  3383 raft_consensus.cc:359] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.659739  3383 raft_consensus.cc:385] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.660013  3383 raft_consensus.cc:740] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.659945  3384 raft_consensus.cc:359] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.660691  3384 raft_consensus.cc:385] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.660972  3383 consensus_queue.cc:260] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.660972  3384 raft_consensus.cc:740] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.663848  3384 consensus_queue.cc:260] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.664364  3383 ts_tablet_manager.cc:1434] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:58.665514  3383 tablet_bootstrap.cc:492] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:58.667090  3384 ts_tablet_manager.cc:1434] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:12:58.668000  3384 tablet_bootstrap.cc:492] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:58.673532  3383 tablet_bootstrap.cc:654] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.680907  3384 tablet_bootstrap.cc:654] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.685906  3383 tablet_bootstrap.cc:492] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:58.686527  3383 ts_tablet_manager.cc:1403] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 12:12:58.690071  3383 raft_consensus.cc:359] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.691015  3383 raft_consensus.cc:385] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.691386  3383 raft_consensus.cc:740] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.697701  3090 catalog_manager.cc:5697] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.692385  3383 consensus_queue.cc:260] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.725162  3383 ts_tablet_manager.cc:1434] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.007s
I20260709 12:12:58.726145  3383 tablet_bootstrap.cc:492] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:58.706964  3384 tablet_bootstrap.cc:492] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:58.731513  3384 ts_tablet_manager.cc:1403] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.003s
W20260709 12:12:58.732722  3232 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:58.734160  3384 raft_consensus.cc:359] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.734861  3384 raft_consensus.cc:385] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.735112  3384 raft_consensus.cc:740] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.708673  3382 tablet_bootstrap.cc:492] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:58.709316  3602 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.735853  3382 ts_tablet_manager.cc:1403] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.132s	user 0.019s	sys 0.021s
I20260709 12:12:58.737004  3384 consensus_queue.cc:260] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.737304  3602 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.738358  3382 raft_consensus.cc:359] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.738989  3382 raft_consensus.cc:385] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.739253  3382 raft_consensus.cc:740] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.739610  3384 ts_tablet_manager.cc:1434] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:58.740525  3384 tablet_bootstrap.cc:492] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:58.741672  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:58.742540  3341 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.745991  3384 tablet_bootstrap.cc:654] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.750690  3383 tablet_bootstrap.cc:654] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.753314  3382 consensus_queue.cc:260] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.752079  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:58.755415  3266 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.758754  3613 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.759385  3613 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.761945  3613 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:58.764371  3384 tablet_bootstrap.cc:492] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:58.765089  3384 ts_tablet_manager.cc:1403] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.007s
I20260709 12:12:58.766090  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:58.766783  3268 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:12:58.767812  3305 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:58.768406  3384 raft_consensus.cc:359] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.771770  3384 raft_consensus.cc:385] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.772126  3384 raft_consensus.cc:740] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.772913  3384 consensus_queue.cc:260] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.775252  3384 ts_tablet_manager.cc:1434] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:12:58.769100  3382 ts_tablet_manager.cc:1434] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:12:58.768998  3683 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.775857  3683 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.776254  3384 tablet_bootstrap.cc:492] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:58.777598  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:58.776275  3683 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:58.784236  3305 leader_election.cc:343] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.784570  3602 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.785271  3602 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.788211  3602 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.790122  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:58.790861  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:58.791721  3268 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:58.790864  3338 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:58.794122  3157 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:58.795545  3602 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.796141  3602 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.796649  3602 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.795310  3384 tablet_bootstrap.cc:654] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.807513  3382 tablet_bootstrap.cc:492] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:58.825924  3683 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.826663  3341 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:58.830152  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:58.832815  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:58.839676  3268 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.841468  3384 tablet_bootstrap.cc:492] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:58.841930  3384 ts_tablet_manager.cc:1403] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.013s
I20260709 12:12:58.844573  3698 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:12:58.845063  3698 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.848222  3268 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:58.836051  3157 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:58.849181  3543 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.849655  3543 raft_consensus.cc:697] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:58.850487  3543 consensus_queue.cc:237] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.837893  3383 tablet_bootstrap.cc:492] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:58.853282  3383 ts_tablet_manager.cc:1403] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.127s	user 0.019s	sys 0.022s
I20260709 12:12:58.857004  3383 raft_consensus.cc:359] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.857801  3383 raft_consensus.cc:385] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.858120  3383 raft_consensus.cc:740] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.858250  3382 tablet_bootstrap.cc:654] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.831321  3602 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.839087  3683 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:12:58.862844  3305 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:58.834019  3266 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:58.864074  3613 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.864598  3613 raft_consensus.cc:697] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:12:58.865489  3613 consensus_queue.cc:237] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.866089  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:58.858881  3383 consensus_queue.cc:260] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.868587  3191 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.868927  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:58.869887  3383 ts_tablet_manager.cc:1434] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:12:58.870196  3698 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.870846  3383 tablet_bootstrap.cc:492] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:58.866874  3341 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.873551  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:58.875761  3602 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.876053  3191 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:12:58.876750  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:58.877430  3266 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.885830  3383 tablet_bootstrap.cc:654] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.893460  3384 raft_consensus.cc:359] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.894302  3341 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:58.896028  3157 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:58.897156  3602 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.897797  3602 raft_consensus.cc:697] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:58.898896  3602 consensus_queue.cc:237] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.900386  3639 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.900918  3639 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.903183  3639 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.907284  3231 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:58.909539  3639 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:58.912374  3639 consensus_queue.cc:1048] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.913637  3090 catalog_manager.cc:5697] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.894313  3384 raft_consensus.cc:385] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.914616  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:58.915154  3384 raft_consensus.cc:740] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.915954  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:58.915915  3384 consensus_queue.cc:260] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.916661  3191 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:58.917779  3384 ts_tablet_manager.cc:1434] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.000s
I20260709 12:12:58.918495  3266 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:58.918862  3384 tablet_bootstrap.cc:492] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
W20260709 12:12:58.923080  3232 leader_election.cc:343] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.912683  3383 tablet_bootstrap.cc:492] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:58.924948  3383 ts_tablet_manager.cc:1403] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.010s
I20260709 12:12:58.926352  3231 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:58.926990  3639 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.928550  3695 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.930276  3695 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.930761  3695 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.937868  3383 raft_consensus.cc:359] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.938838  3383 raft_consensus.cc:385] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.939211  3383 raft_consensus.cc:740] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.940047  3383 consensus_queue.cc:260] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.929369  3639 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.951144  3088 catalog_manager.cc:5697] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.953744  3639 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.975066  3383 ts_tablet_manager.cc:1434] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.001s
I20260709 12:12:58.965993  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:58.969892  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:58.979162  3193 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:58.980163  3383 tablet_bootstrap.cc:492] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:58.981863  3231 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:58.982368  3384 tablet_bootstrap.cc:654] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.963778  3698 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.972677  3695 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:58.990057  3695 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:58.982714  3639 raft_consensus.cc:2804] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.991585  3383 tablet_bootstrap.cc:654] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.976730  3382 tablet_bootstrap.cc:492] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:58.994616  3382 ts_tablet_manager.cc:1403] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.187s	user 0.025s	sys 0.028s
I20260709 12:12:58.995790  3384 tablet_bootstrap.cc:492] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
W20260709 12:12:58.983626  3232 leader_election.cc:343] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.996409  3384 ts_tablet_manager.cc:1403] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.002s
I20260709 12:12:58.991230  3639 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.993283  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:58.998805  3639 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.999102  3193 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.001756  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:12:59.003062  3232 leader_election.cc:343] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.003098  3088 catalog_manager.cc:5697] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.006829  3382 raft_consensus.cc:359] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.010978  3382 raft_consensus.cc:385] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.011384  3382 raft_consensus.cc:740] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.013504  3193 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:59.013952  3384 raft_consensus.cc:359] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.014591  3231 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:59.015595  3698 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.016160  3698 raft_consensus.cc:697] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:12:59.012246  3382 consensus_queue.cc:260] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.017160  3698 consensus_queue.cc:237] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.010133  3639 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.024977  3382 ts_tablet_manager.cc:1434] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:12:59.026355  3382 tablet_bootstrap.cc:492] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:59.027779  3639 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.032689  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:12:59.033396  3191 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.014611  3384 raft_consensus.cc:385] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.037186  3384 raft_consensus.cc:740] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.037987  3384 consensus_queue.cc:260] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.040758  3384 ts_tablet_manager.cc:1434] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:12:59.041640  3384 tablet_bootstrap.cc:492] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:59.045240  3639 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.045792  3639 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.048154  3639 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.053542  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:59.054575  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:59.055585  3695 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:12:59.067667  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:59.077734  3640 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.067723  3613 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:12:59.081458  3383 tablet_bootstrap.cc:492] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:59.082196  3383 ts_tablet_manager.cc:1403] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.102s	user 0.027s	sys 0.014s
I20260709 12:12:59.081880  3640 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.080695  3088 catalog_manager.cc:5697] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:59.078934  3232 leader_election.cc:343] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.087571  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:59.088289  3231 leader_election.cc:343] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.088779  3231 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:59.089955  3698 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.095094  3382 tablet_bootstrap.cc:654] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.095498  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:59.084275  3640 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.099490  3191 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:12:59.103719  3231 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:12:59.107542  3602 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.108153  3384 tablet_bootstrap.cc:654] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.108105  3602 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.108940  3695 raft_consensus.cc:2804] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.110268  3602 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.110699  3695 raft_consensus.cc:697] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:12:59.112422  3232 leader_election.cc:343] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:59.113462  3232 leader_election.cc:343] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.111619  3695 consensus_queue.cc:237] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.114966  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:59.115954  3338 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:59.117297  3157 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:59.118860  3539 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:59.119519  3539 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.119946  3539 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:59.123148  3383 raft_consensus.cc:359] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.124176  3383 raft_consensus.cc:385] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.124542  3383 raft_consensus.cc:740] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.125602  3383 consensus_queue.cc:260] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.131562  3602 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.132155  3602 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.135767  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:59.137410  3384 tablet_bootstrap.cc:492] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:59.137939  3384 ts_tablet_manager.cc:1403] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.097s	user 0.006s	sys 0.005s
W20260709 12:12:59.138409  3157 leader_election.cc:343] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.139532  3602 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.144601  3383 ts_tablet_manager.cc:1434] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
I20260709 12:12:59.145709  3383 tablet_bootstrap.cc:492] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
W20260709 12:12:59.148732  3231 leader_election.cc:343] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.149237  3231 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:59.149348  3384 raft_consensus.cc:359] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.150097  3384 raft_consensus.cc:385] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.151011  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:59.151590  3695 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.152010  3266 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
W20260709 12:12:59.150413  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.150413  3384 raft_consensus.cc:740] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.157639  3539 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.158319  3384 consensus_queue.cc:260] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.160837  3383 tablet_bootstrap.cc:654] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.161813  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:59.162513  3338 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:59.162534  3384 ts_tablet_manager.cc:1434] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 12:12:59.164270  3384 tablet_bootstrap.cc:492] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:59.169417  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:59.170337  3262 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:59.172652  3383 tablet_bootstrap.cc:492] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:59.173254  3383 ts_tablet_manager.cc:1403] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.003s
I20260709 12:12:59.176476  3383 raft_consensus.cc:359] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.177220  3383 raft_consensus.cc:385] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.177522  3383 raft_consensus.cc:740] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.178929  3383 consensus_queue.cc:260] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.181363  3383 ts_tablet_manager.cc:1434] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:12:59.182474  3383 tablet_bootstrap.cc:492] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:59.177960  3384 tablet_bootstrap.cc:654] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.188369  3543 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.188949  3543 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.191160  3539 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.192276  3383 tablet_bootstrap.cc:654] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.192971  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:59.193847  3543 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.194082  3339 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:59.194581  3157 leader_election.cc:343] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.207724  3382 tablet_bootstrap.cc:492] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:59.208912  3382 ts_tablet_manager.cc:1403] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.183s	user 0.023s	sys 0.010s
I20260709 12:12:59.220964  3382 raft_consensus.cc:359] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.222317  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:59.222584  3382 raft_consensus.cc:385] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.222949  3382 raft_consensus.cc:740] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.223008  3262 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:59.223799  3382 consensus_queue.cc:260] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.226352  3382 ts_tablet_manager.cc:1434] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:12:59.231328  3156 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:59.232228  3338 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:12:59.232540  3543 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.233112  3543 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.233361  3157 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:59.231725  3382 tablet_bootstrap.cc:492] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:59.233574  3543 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.234387  3539 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:59.234992  3539 raft_consensus.cc:697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:59.235716  3539 consensus_queue.cc:237] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.239969  3383 tablet_bootstrap.cc:492] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:12:59.239727  3384 tablet_bootstrap.cc:492] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:59.243378  3602 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.244555  3382 tablet_bootstrap.cc:654] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.244573  3383 ts_tablet_manager.cc:1403] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.007s
I20260709 12:12:59.244685  3384 ts_tablet_manager.cc:1403] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.000s
I20260709 12:12:59.244654  3602 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.248549  3602 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.236696  3262 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:12:59.248847  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:59.249557  3338 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:59.247772  3383 raft_consensus.cc:359] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.251928  3383 raft_consensus.cc:385] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.252202  3157 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:59.252348  3383 raft_consensus.cc:740] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.253226  3602 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:59.253839  3602 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.253273  3383 consensus_queue.cc:260] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.254427  3602 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:59.254595  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:59.255259  3268 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:59.256954  3383 ts_tablet_manager.cc:1434] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:12:59.257943  3383 tablet_bootstrap.cc:492] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:12:59.258162  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:59.250741  3384 raft_consensus.cc:359] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.259596  3268 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:59.259791  3384 raft_consensus.cc:385] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.260176  3384 raft_consensus.cc:740] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.261020  3382 tablet_bootstrap.cc:492] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:12:59.260988  3384 consensus_queue.cc:260] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.261667  3382 ts_tablet_manager.cc:1403] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.007s
I20260709 12:12:59.242902  3543 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.264000  3384 ts_tablet_manager.cc:1434] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:12:59.265125  3384 tablet_bootstrap.cc:492] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:59.265842  3543 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.266268  3602 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.267590  3382 raft_consensus.cc:359] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.268386  3382 raft_consensus.cc:385] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.269330  3602 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.394853  3602 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.268714  3382 raft_consensus.cc:740] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.397629  3602 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.334364  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:59.449138  3339 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:59.328500  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:59.332105  3156 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:12:59.334641  3087 catalog_manager.cc:5697] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.325889  3743 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.460902  3743 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.502055  3338 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.517627  3751 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.526696  3751 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.534471  3599 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.527278  3751 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.575740  3382 consensus_queue.cc:260] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.578783  3382 ts_tablet_manager.cc:1434] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.317s	user 0.012s	sys 0.006s
I20260709 12:12:59.579531  3384 tablet_bootstrap.cc:700] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent opening tablet: real 0.120s	user 0.003s	sys 0.010s
I20260709 12:12:59.557097  3599 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.580754  3384 tablet_bootstrap.cc:654] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.603048  3744 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.597765  3602 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.616250  3599 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.603917  3744 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.674582  3339 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:12:59.672366  3743 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:12:59.693441  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 361628us
I20260709 12:12:59.675262  3744 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.709956  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:59.740123  3745 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.740856  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:59.741066  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:12:59.739651  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 43947.3us
I20260709 12:12:59.748446  3383 tablet_bootstrap.cc:654] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.740873  3745 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.770641  3384 tablet_bootstrap.cc:492] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:12:59.774955  3384 ts_tablet_manager.cc:1403] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.510s	user 0.012s	sys 0.025s
I20260709 12:12:59.760303  3602 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:12:59.779304  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:59.782418  3334 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:59.784941  3745 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.794343  3382 tablet_bootstrap.cc:492] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:12:59.798702  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:59.799638  3188 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:12:59.805922  3384 raft_consensus.cc:359] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.813794  3157 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:12:59.821645  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 66511.9us
W20260709 12:12:59.822480  3157 leader_election.cc:343] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.823813  3602 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:59.824368  3602 raft_consensus.cc:697] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:12:59.825466  3602 consensus_queue.cc:237] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.807211  3384 raft_consensus.cc:385] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.829173  3384 raft_consensus.cc:740] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
W20260709 12:12:59.830132  3157 leader_election.cc:343] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.799247  3751 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.848048  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:59.808799  3763 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.098s
I20260709 12:12:59.855559  3268 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.861384  3384 consensus_queue.cc:260] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:12:59.865741  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:12:59.866873  3266 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:59.821177  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:12:59.874585  3191 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:59.876029  3232 consensus_peers.cc:597] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.882627  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:12:59.890636  3639 raft_consensus.cc:2804] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.895709  3639 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.896126  3639 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.897351  3341 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:59.903321  3759 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:12:59.885313  3384 ts_tablet_manager.cc:1434] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.002s
W20260709 12:12:59.921059  3139 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:59.921707  3383 tablet_bootstrap.cc:492] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
W20260709 12:12:59.924419  3232 consensus_peers.cc:597] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.925130  3751 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:12:59.931005  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:12:59.941253  3383 ts_tablet_manager.cc:1403] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.684s	user 0.024s	sys 0.011s
I20260709 12:12:59.944489  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:59.945026  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:59.945502  3267 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
W20260709 12:12:59.949950  3157 leader_election.cc:343] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.958735  3259 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:59.960942  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:12:59.961840  3264 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:12:59.966343  3496 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:12:59.967206  3268 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:59.972004  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:12:59.987025  3755 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.980206  3338 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:12:59.995621  3384 tablet_bootstrap.cc:492] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:12:59.996433  3684 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.011560  3157 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:00.016323  3090 catalog_manager.cc:5697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.997241  3684 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.017217  3602 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.019834  3602 raft_consensus.cc:697] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:00.020361  3383 raft_consensus.cc:359] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.021193  3383 raft_consensus.cc:385] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.020917  3602 consensus_queue.cc:237] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.021517  3383 raft_consensus.cc:740] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.022603  3383 consensus_queue.cc:260] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.024634  3382 tablet_bootstrap.cc:654] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.025533  3383 ts_tablet_manager.cc:1434] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.001s
I20260709 12:13:00.026364  3684 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:00.032130  3383 tablet_bootstrap.cc:492] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:13:00.019121  3266 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
W20260709 12:13:00.039585  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 43544.5us
I20260709 12:13:00.061151  3156 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:00.064675  3156 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:00.068686  3639 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.071625  3743 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.072069  3743 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.072433  3743 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.080255  3539 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.080758  3539 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:00.081516  3232 leader_election.cc:343] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.084044  3539 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:00.087387  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:00.089365  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:00.060264  3759 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:13:00.094547  3262 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.104460  3639 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:00.110280  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:00.113574  3156 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:00.114023  3157 leader_election.cc:343] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.114455  3753 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:00.115324  3599 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.115918  3599 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.116233  3599 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.129050  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:00.130041  3342 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:00.131733  3772 log.cc:927] Time spent T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.054s	user 0.000s	sys 0.009s
I20260709 12:13:00.130981  3767 consensus_queue.cc:1048] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:13:00.138232  3750 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.131872  3752 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:13:00.186897  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 71448us
I20260709 12:13:00.191970  3759 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:00.227869  3777 log.cc:927] Time spent T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:13:00.229362  3382 tablet_bootstrap.cc:492] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:13:00.229794  3382 ts_tablet_manager.cc:1403] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.436s	user 0.020s	sys 0.011s
W20260709 12:13:00.233253  3231 leader_election.cc:343] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.233613  3384 tablet_bootstrap.cc:654] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.236214  3231 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:00.235169  3599 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.241729  3745 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.256904  3383 tablet_bootstrap.cc:654] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.250401  3382 raft_consensus.cc:359] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.258308  3382 raft_consensus.cc:385] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.258585  3382 raft_consensus.cc:740] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.245296  3599 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:00.254346  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:00.261116  3778 log.cc:927] Time spent T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:13:00.263393  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:00.248472  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:00.266449  3193 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.271171  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:00.271996  3259 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:13:00.251835  3342 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:13:00.251134  3743 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:00.295507  3156 leader_election.cc:343] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.296166  3156 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:00.297138  3763 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:00.305754  3780 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:13:00.347191  3781 log.cc:927] Time spent T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:13:00.348073  3743 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:00.349016  3400 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.349506  3400 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:00.357641  3779 log.cc:927] Time spent T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.136s	user 0.000s	sys 0.002s
I20260709 12:13:00.386164  3400 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:00.346714  3262 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:00.437206  3400 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.437805  3400 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.473824  3383 tablet_bootstrap.cc:492] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:13:00.474473  3383 ts_tablet_manager.cc:1403] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.447s	user 0.016s	sys 0.039s
I20260709 12:13:00.474648  3400 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:00.482400  3193 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:13:00.501965  3383 raft_consensus.cc:359] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.502928  3383 raft_consensus.cc:385] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.503234  3383 raft_consensus.cc:740] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.528545  3383 consensus_queue.cc:260] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.528764  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:00.531709  3384 tablet_bootstrap.cc:492] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:13:00.532325  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:00.533165  3262 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.535477  3383 ts_tablet_manager.cc:1434] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 12:13:00.536576  3383 tablet_bootstrap.cc:492] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:13:00.540346  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:00.540809  3342 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:00.541834  3262 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:00.544360  3384 ts_tablet_manager.cc:1403] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.549s	user 0.031s	sys 0.011s
W20260709 12:13:00.544760  3157 leader_election.cc:343] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.531284  3263 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:00.546906  3157 leader_election.cc:343] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.549486  3384 raft_consensus.cc:359] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.554407  3602 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.555608  3384 raft_consensus.cc:385] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.558732  3263 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:00.558765  3384 raft_consensus.cc:740] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.560536  3384 consensus_queue.cc:260] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.562975  3384 ts_tablet_manager.cc:1434] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:13:00.563930  3382 consensus_queue.cc:260] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.564746  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:00.566577  3382 ts_tablet_manager.cc:1434] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.337s	user 0.011s	sys 0.008s
I20260709 12:13:00.567559  3765 raft_consensus.cc:2804] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.568070  3765 raft_consensus.cc:697] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:00.568943  3765 consensus_queue.cc:237] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.583642  3384 tablet_bootstrap.cc:492] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:13:00.584862  3156 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:00.591024  3087 catalog_manager.cc:5697] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.592370  3268 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:00.593019  3087 catalog_manager.cc:5697] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.596031  3602 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.596701  3602 raft_consensus.cc:697] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:00.597680  3602 consensus_queue.cc:237] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.600625  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:00.606019  3156 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:00.607681  3539 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.608199  3539 raft_consensus.cc:697] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:00.609606  3382 tablet_bootstrap.cc:492] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:13:00.609206  3539 consensus_queue.cc:237] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.613474  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:00.607362  3156 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:00.629678  3599 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.649134  3747 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:00.661448  3383 tablet_bootstrap.cc:654] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.662472  3599 raft_consensus.cc:697] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:00.689918  3384 tablet_bootstrap.cc:654] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.695443  3599 consensus_queue.cc:237] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:00.718685  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 87764.6us
W20260709 12:13:00.722539  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 55017.5us
I20260709 12:13:00.723948  3305 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:00.727238  3750 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:00.733383  3232 leader_election.cc:343] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.734407  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:00.728611  3750 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.763738  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:00.767194  3157 leader_election.cc:343] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.728991  3599 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:13:00.767928  3750 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:00.782070  3749 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:00.813159  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:00.823933  3757 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.824647  3757 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.827234  3382 tablet_bootstrap.cc:654] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.830336  3757 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:13:00.838963  3231 leader_election.cc:343] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.851294  3231 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:00.852119  3745 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.860584  3231 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:00.863009  3400 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:00.874161  3749 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:00.874761  3749 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:00.890906  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 75709us
I20260709 12:13:00.893882  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:00.894599  3384 tablet_bootstrap.cc:492] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:13:00.895085  3384 ts_tablet_manager.cc:1403] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.312s	user 0.024s	sys 0.032s
I20260709 12:13:00.896997  3749 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.897730  3384 raft_consensus.cc:359] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.898370  3384 raft_consensus.cc:385] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.898615  3384 raft_consensus.cc:740] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.899277  3384 consensus_queue.cc:260] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.899928  3749 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:00.894620  3382 tablet_bootstrap.cc:492] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:13:00.901809  3382 ts_tablet_manager.cc:1403] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.334s	user 0.015s	sys 0.007s
I20260709 12:13:00.901322  3384 ts_tablet_manager.cc:1434] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:00.942286  3383 tablet_bootstrap.cc:492] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:13:00.944180  3383 ts_tablet_manager.cc:1403] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.408s	user 0.027s	sys 0.038s
I20260709 12:13:00.943495  3384 tablet_bootstrap.cc:492] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:13:00.945904  3758 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.946410  3758 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.952301  3758 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:00.951346  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:00.954960  3382 raft_consensus.cc:359] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.955761  3382 raft_consensus.cc:385] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.956068  3382 raft_consensus.cc:740] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.956765  3382 consensus_queue.cc:260] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.959394  3383 raft_consensus.cc:359] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.960199  3383 raft_consensus.cc:385] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.960489  3383 raft_consensus.cc:740] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.961232  3383 consensus_queue.cc:260] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:00.962868  3382 ts_tablet_manager.cc:1434] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.007s
I20260709 12:13:00.968832  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:00.973711  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:13:00.976446  3232 leader_election.cc:343] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.991077  3382 tablet_bootstrap.cc:492] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:13:00.996075  3384 tablet_bootstrap.cc:654] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.996481  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:00.997287  3262 raft_consensus.cc:2393] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:00.999781  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:01.000973  3599 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:01.002358  3156 leader_election.cc:343] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.002825  3156 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:01.003588  3750 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.004908  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:01.000422  3262 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.008157  3383 ts_tablet_manager.cc:1434] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 12:13:01.009284  3383 tablet_bootstrap.cc:492] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:13:01.011560  3262 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
W20260709 12:13:01.016754  3139 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:01.020818  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:01.028007  3263 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:13:01.034154  3814 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:01.036751  3231 leader_election.cc:343] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.039660  3231 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:01.044981  3305 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:01.046506  3749 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:01.047560  3749 raft_consensus.cc:697] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:01.048444  3749 consensus_queue.cc:237] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.049208  3543 consensus_queue.cc:1059] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:01.050220  3543 raft_consensus.cc:3055] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:01.050560  3543 raft_consensus.cc:740] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:01.051307  3543 consensus_queue.cc:260] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.052551  3543 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.044356  3758 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.058702  3791 consensus_queue.cc:1048] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:01.074911  3382 tablet_bootstrap.cc:654] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.078760  3814 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:01.079154  3157 consensus_peers.cc:597] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:01.080148  3758 consensus_queue.cc:1048] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.090157  3383 tablet_bootstrap.cc:654] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.091531  3384 tablet_bootstrap.cc:492] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:13:01.092130  3384 ts_tablet_manager.cc:1403] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.149s	user 0.005s	sys 0.033s
I20260709 12:13:01.102126  3087 catalog_manager.cc:5697] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.144543  3384 raft_consensus.cc:359] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.145370  3384 raft_consensus.cc:385] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.145651  3384 raft_consensus.cc:740] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.146298  3384 consensus_queue.cc:260] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.148561  3384 ts_tablet_manager.cc:1434] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.003s
I20260709 12:13:01.183643  3543 consensus_queue.cc:1048] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:13:01.191197  3758 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.195097  3755 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.195871  3383 tablet_bootstrap.cc:492] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:13:01.195662  3755 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.196461  3383 ts_tablet_manager.cc:1403] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.187s	user 0.007s	sys 0.029s
I20260709 12:13:01.191815  3758 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.198998  3755 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:01.200685  3758 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:01.204710  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:01.206041  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:01.209860  3543 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:01.216666  3384 tablet_bootstrap.cc:492] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
W20260709 12:13:01.216907  3232 leader_election.cc:343] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.216363  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:01.220480  3267 raft_consensus.cc:2393] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:01.221498  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:01.222160  3382 tablet_bootstrap.cc:492] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:13:01.222136  3192 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:13:01.222803  3382 ts_tablet_manager.cc:1403] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.232s	user 0.010s	sys 0.016s
I20260709 12:13:01.224275  3305 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:01.227803  3749 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.226354  3088 catalog_manager.cc:5697] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.233963  3088 catalog_manager.cc:5697] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.239106  3088 catalog_manager.cc:5697] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.242584  3749 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.242756  3382 raft_consensus.cc:359] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.246908  3382 raft_consensus.cc:385] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.247344  3382 raft_consensus.cc:740] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.248235  3382 consensus_queue.cc:260] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.255766  3231 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:01.257779  3758 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.258212  3758 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.258586  3758 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.258848  3384 tablet_bootstrap.cc:654] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.266283  3382 ts_tablet_manager.cc:1434] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.003s
I20260709 12:13:01.271987  3383 raft_consensus.cc:359] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.273406  3382 tablet_bootstrap.cc:492] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:13:01.273470  3383 raft_consensus.cc:385] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.275810  3543 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.277722  3383 raft_consensus.cc:740] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.276382  3599 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.278582  3383 consensus_queue.cc:260] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.288832  3383 ts_tablet_manager.cc:1434] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.001s
I20260709 12:13:01.284600  3090 catalog_manager.cc:5697] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:01.300239  3383 tablet_bootstrap.cc:492] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:13:01.314318  3811 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.314947  3811 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.317369  3811 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:01.344535  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:01.345839  3192 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:13:01.352792  3758 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.353345  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:01.354359  3814 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.354809  3814 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.354952  3758 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:01.355178  3814 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.314345  3782 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:13:01.359318  3383 tablet_bootstrap.cc:654] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.342166  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:01.363740  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:01.366825  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:01.367394  3191 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.394706  3191 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:13:01.403757  3384 tablet_bootstrap.cc:492] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:13:01.404179  3267 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:01.404321  3384 ts_tablet_manager.cc:1403] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.203s	user 0.006s	sys 0.015s
I20260709 12:13:01.420588  3231 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:01.421366  3400 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.421895  3400 raft_consensus.cc:697] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:01.422884  3382 tablet_bootstrap.cc:654] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.422765  3400 consensus_queue.cc:237] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.432706  3384 raft_consensus.cc:359] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.433460  3384 raft_consensus.cc:385] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.433739  3384 raft_consensus.cc:740] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.434293  3384 consensus_queue.cc:260] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.438285  3814 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.439002  3384 ts_tablet_manager.cc:1434] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:13:01.444278  3384 tablet_bootstrap.cc:492] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9: Bootstrap starting.
I20260709 12:13:01.446942  3336 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 1: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:01.450167  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:01.469817  3192 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:01.470877  3382 tablet_bootstrap.cc:492] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:13:01.471465  3382 ts_tablet_manager.cc:1403] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.198s	user 0.015s	sys 0.004s
I20260709 12:13:01.449203  3828 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.449426  3814 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:01.483459  3640 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.484732  3382 raft_consensus.cc:359] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.490224  3382 raft_consensus.cc:385] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.490115  3640 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.490844  3382 raft_consensus.cc:740] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.492300  3640 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:01.492010  3382 consensus_queue.cc:260] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.494803  3382 ts_tablet_manager.cc:1434] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:13:01.495883  3382 tablet_bootstrap.cc:492] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:13:01.486707  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:01.513998  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:01.517606  3496 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.518905  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:01.502867  3828 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.530542  3192 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:13:01.529845  3185 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:01.533428  3811 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:01.536219  3382 tablet_bootstrap.cc:654] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.542232  3383 tablet_bootstrap.cc:492] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:13:01.542836  3383 ts_tablet_manager.cc:1403] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.251s	user 0.024s	sys 0.023s
I20260709 12:13:01.545537  3828 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:01.546545  3383 raft_consensus.cc:359] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.547556  3383 raft_consensus.cc:385] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.547932  3383 raft_consensus.cc:740] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.547792  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:01.548847  3383 consensus_queue.cc:260] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:01.549650  3157 leader_election.cc:343] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.551537  3400 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.552088  3400 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.564563  3384 tablet_bootstrap.cc:654] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:01.565208  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 103147us
I20260709 12:13:01.567952  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:01.575325  3383 ts_tablet_manager.cc:1434] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 12:13:01.575575  3811 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.576124  3811 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.576777  3383 tablet_bootstrap.cc:492] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:13:01.578154  3811 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:01.581207  3400 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:01.582587  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:01.583657  3185 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:13:01.585162  3305 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:01.588546  3232 leader_election.cc:343] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.607897  3382 tablet_bootstrap.cc:492] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:13:01.607550  3090 catalog_manager.cc:5697] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.608572  3382 ts_tablet_manager.cc:1403] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.113s	user 0.009s	sys 0.005s
I20260709 12:13:01.610809  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:01.589074  3814 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.617635  3339 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:13:01.624418  3232 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:01.625236  3833 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.628355  3833 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.628765  3833 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.622920  3814 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.638829  3814 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.642097  3382 raft_consensus.cc:359] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.643249  3382 raft_consensus.cc:385] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.643883  3382 raft_consensus.cc:740] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.645274  3382 consensus_queue.cc:260] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.650014  3382 ts_tablet_manager.cc:1434] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.001s
I20260709 12:13:01.651404  3382 tablet_bootstrap.cc:492] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:13:01.657207  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:01.657954  3192 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:13:01.659296  3814 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.663965  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:01.664592  3185 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.665786  3384 tablet_bootstrap.cc:492] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9: No bootstrap required, opened a new log
I20260709 12:13:01.668305  3383 tablet_bootstrap.cc:654] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.672032  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:01.672832  3262 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:13:01.674525  3384 ts_tablet_manager.cc:1403] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9: Time spent bootstrapping tablet: real 0.230s	user 0.018s	sys 0.017s
I20260709 12:13:01.685736  3833 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.691952  3267 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:01.693449  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:01.697230  3814 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:01.697307  3384 raft_consensus.cc:359] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.699393  3185 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:13:01.700912  3265 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:01.704334  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:01.702068  3384 raft_consensus.cc:385] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.705533  3384 raft_consensus.cc:740] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.705849  3305 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:01.706393  3335 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 1: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:01.706348  3384 consensus_queue.cc:260] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.706857  3814 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.708321  3814 raft_consensus.cc:697] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:01.708886  3384 ts_tablet_manager.cc:1434] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.004s
I20260709 12:13:01.709808  3231 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:01.710811  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:01.710284  3814 consensus_queue.cc:237] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.712005  3265 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:01.713121  3640 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.713578  3640 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.713969  3640 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.709455  3833 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:01.715391  3383 tablet_bootstrap.cc:492] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:13:01.716097  3383 ts_tablet_manager.cc:1403] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.140s	user 0.012s	sys 0.004s
I20260709 12:13:01.719158  3383 raft_consensus.cc:359] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.715498  3382 tablet_bootstrap.cc:654] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.722378  3640 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.728667  3640 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:01.721052  3383 raft_consensus.cc:385] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.730564  3383 raft_consensus.cc:740] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.729995  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:01.731364  3383 consensus_queue.cc:260] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:01.732009  3232 leader_election.cc:343] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.736716  3383 ts_tablet_manager.cc:1434] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:13:01.739333  3383 tablet_bootstrap.cc:492] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3: Bootstrap starting.
I20260709 12:13:01.740638  3382 tablet_bootstrap.cc:492] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:13:01.741171  3382 ts_tablet_manager.cc:1403] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.005s
I20260709 12:13:01.744021  3156 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:01.744771  3828 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.744402  3382 raft_consensus.cc:359] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.745136  3828 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.745265  3382 raft_consensus.cc:385] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.745527  3828 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.745642  3382 raft_consensus.cc:740] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.746490  3382 consensus_queue.cc:260] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.750000  3382 ts_tablet_manager.cc:1434] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:13:01.751955  3383 tablet_bootstrap.cc:654] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.753121  3382 tablet_bootstrap.cc:492] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:13:01.754377  3828 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.760206  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:13:01.761502  3157 leader_election.cc:343] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.765746  3828 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:01.768374  3382 tablet_bootstrap.cc:654] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.792428  3496 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:01.792481  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:01.792791  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:01.796936  3811 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.799917  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:01.809444  3192 raft_consensus.cc:2393] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 1: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:01.811103  3383 tablet_bootstrap.cc:492] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3: No bootstrap required, opened a new log
I20260709 12:13:01.811635  3383 ts_tablet_manager.cc:1403] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.000s
I20260709 12:13:01.817127  3382 tablet_bootstrap.cc:492] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:13:01.817742  3382 ts_tablet_manager.cc:1403] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.009s
I20260709 12:13:01.807482  3811 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.822556  3811 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:01.814165  3263 raft_consensus.cc:2393] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:01.824286  3185 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 1: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:01.828095  3087 catalog_manager.cc:5697] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:01.832894  3382 raft_consensus.cc:359] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.833655  3382 raft_consensus.cc:385] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.858491  3382 raft_consensus.cc:740] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.834477  3383 raft_consensus.cc:359] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.842518  3843 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.859151  3383 raft_consensus.cc:385] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.859510  3383 raft_consensus.cc:740] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.859334  3843 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.859614  3382 consensus_queue.cc:260] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.860229  3383 consensus_queue.cc:260] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.861498  3843 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:01.843592  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:01.844646  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:01.862416  3383 ts_tablet_manager.cc:1434] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.002s
I20260709 12:13:01.862705  3263 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:13:01.854336  3231 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:01.864562  3695 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.865025  3231 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:01.866197  3791 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.862421  3185 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 0.
I20260709 12:13:01.857966  3156 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:01.869064  3753 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.868597  3382 ts_tablet_manager.cc:1434] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:13:01.872130  3305 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:01.875927  3842 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.876307  3842 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.876663  3842 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.880882  3382 tablet_bootstrap.cc:492] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:13:01.890756  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:01.892354  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:01.896144  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:01.896891  3749 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.899227  3382 tablet_bootstrap.cc:654] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.898039  3842 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.914165  3842 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:01.914752  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:01.915364  3192 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.915614  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:01.916066  3382 tablet_bootstrap.cc:492] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:13:01.916186  3263 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.916539  3382 ts_tablet_manager.cc:1403] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 12:13:01.920327  3382 raft_consensus.cc:359] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.920996  3382 raft_consensus.cc:385] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.921258  3382 raft_consensus.cc:740] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.921409  3263 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:13:01.921970  3382 consensus_queue.cc:260] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.922883  3192 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:13:01.923995  3382 ts_tablet_manager.cc:1434] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:01.924592  3305 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:01.924962  3382 tablet_bootstrap.cc:492] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:13:01.928470  3842 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.929005  3842 raft_consensus.cc:697] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:01.929910  3749 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.929994  3842 consensus_queue.cc:237] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.930461  3749 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.932320  3749 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:01.934104  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:01.936151  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:01.937804  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:01.938719  3749 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.939879  3382 tablet_bootstrap.cc:654] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.944168  3382 tablet_bootstrap.cc:492] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:13:01.944479  3382 ts_tablet_manager.cc:1403] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 12:13:01.946297  3382 raft_consensus.cc:359] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.946972  3382 raft_consensus.cc:385] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.947214  3382 raft_consensus.cc:740] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.947845  3382 consensus_queue.cc:260] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.949896  3382 ts_tablet_manager.cc:1434] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:01.949570  3090 catalog_manager.cc:5697] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:01.950802  3382 tablet_bootstrap.cc:492] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:13:01.957123  3382 tablet_bootstrap.cc:654] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.963616  3336 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.969594  3382 tablet_bootstrap.cc:492] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:13:01.970098  3382 ts_tablet_manager.cc:1403] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 12:13:01.972651  3382 raft_consensus.cc:359] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.973290  3382 raft_consensus.cc:385] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.973539  3382 raft_consensus.cc:740] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.974185  3382 consensus_queue.cc:260] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.976100  3382 ts_tablet_manager.cc:1434] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:13:01.976945  3382 tablet_bootstrap.cc:492] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
I20260709 12:13:01.982237  3382 tablet_bootstrap.cc:654] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.988600  3695 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.989082  3382 tablet_bootstrap.cc:492] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:13:01.989634  3382 ts_tablet_manager.cc:1403] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.013s	user 0.001s	sys 0.008s
I20260709 12:13:01.989082  3695 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.992347  3382 raft_consensus.cc:359] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.992754  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:01.993002  3382 raft_consensus.cc:385] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.993279  3382 raft_consensus.cc:740] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.993363  3192 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 0.
I20260709 12:13:01.993954  3382 consensus_queue.cc:260] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:01.994676  3231 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:01.994307  3695 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:01.995378  3640 raft_consensus.cc:2804] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.995622  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:01.995770  3640 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.996105  3382 ts_tablet_manager.cc:1434] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:01.996136  3640 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.997182  3382 tablet_bootstrap.cc:492] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141: Bootstrap starting.
W20260709 12:13:01.997529  3232 leader_election.cc:343] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.999011  3750 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.999580  3750 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:02.001736  3750 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:02.002394  3695 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.002831  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:02.003458  3339 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:13:02.004097  3382 tablet_bootstrap.cc:654] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.004201  3640 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:02.004911  3157 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:02.006480  3640 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:02.007400  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:02.007851  3750 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.008235  3750 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.008559  3750 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:02.009049  3232 leader_election.cc:343] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.010303  3382 tablet_bootstrap.cc:492] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141: No bootstrap required, opened a new log
I20260709 12:13:02.011125  3382 ts_tablet_manager.cc:1403] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.005s
I20260709 12:13:02.013453  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:02.013526  3382 raft_consensus.cc:359] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:02.014118  3192 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.014533  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:02.015213  3265 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:13:02.014199  3382 raft_consensus.cc:385] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.017557  3382 raft_consensus.cc:740] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.018265  3382 consensus_queue.cc:260] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:02.020623  3382 ts_tablet_manager.cc:1434] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:13:02.025218  3192 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:13:02.031859  3231 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:02.032605  3758 raft_consensus.cc:2804] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.034479  3758 raft_consensus.cc:697] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:02.035319  3758 consensus_queue.cc:237] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:02.057524  3835 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.068249  3750 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:02.071669  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:02.072283  3265 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.073136  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:02.073812  3336 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.074342  3339 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.071154  3750 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:02.090405  3842 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.091202  3842 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:02.121121  3265 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:02.124539  3842 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:02.127636  3156 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:02.128424  3750 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.128940  3750 raft_consensus.cc:697] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:02.129753  3750 consensus_queue.cc:237] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:02.131078  3336 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:02.132208  3090 catalog_manager.cc:5697] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.140286  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:02.141213  3192 raft_consensus.cc:2393] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:02.143527  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:02.144362  3263 raft_consensus.cc:2393] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:02.157249  3305 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:02.157984  3842 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:02.165292  3139 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:02.167291  3842 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.170614  3090 catalog_manager.cc:5697] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.173368  3749 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.201519  3842 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.227792  3753 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.228405  3753 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:02.230361  3753 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:02.231012  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:02.231372  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:02.231748  3263 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:13:02.232089  3336 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 0.
I20260709 12:13:02.232827  3156 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:02.233577  3753 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.233873  3753 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.234130  3753 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.240479  3753 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:02.242287  3753 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:02.243055  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:02.243144  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:02.243821  3263 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.243878  3336 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.250739  3336 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:02.251847  3263 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:02.251921  3157 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:02.252775  3750 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.253240  3750 raft_consensus.cc:697] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:02.254187  3750 consensus_queue.cc:237] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:02.271055  3339 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.278137  3090 catalog_manager.cc:5697] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.337711  3842 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.338263  3842 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:02.340137  3842 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:02.340726  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:02.341135  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:02.341372  3188 raft_consensus.cc:2393] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 1: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:02.342479  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:02.343087  3842 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.349310  3842 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.432137  3833 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.441753  3640 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.501057  3842 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.511500  3843 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.515292  3753 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.530612  3753 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.674593  3599 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.688505  3750 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:03.200004  3139 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:03.846379  3753 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.846982  3753 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:03.849701  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:03.850097  3753 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:03.850363  3262 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:03.850322  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:03.851933  3336 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:03.852339  3156 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:03.853240  3753 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:03.853613  3753 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.853924  3753 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.858817  3753 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:03.861218  3753 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:03.862296  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:03.862461  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:03.863106  3335 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.863217  3262 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.868750  3262 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:03.869767  3156 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:03.870021  3335 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:03.870601  3753 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:03.871126  3753 raft_consensus.cc:697] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:03.871845  3753 consensus_queue.cc:237] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:03.882539  3090 catalog_manager.cc:5697] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.365681  3335 raft_consensus.cc:1275] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:04.367241  3599 consensus_queue.cc:1048] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.395409  3262 raft_consensus.cc:1275] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:04.397925  3599 consensus_queue.cc:1048] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.565513  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:05.601918  3886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:05.603330  3887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:05.603914  3889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:05.604730  2017 server_base.cc:1061] running on GCE node
I20260709 12:13:05.607143  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:05.607455  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:05.607698  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599185607676 us; error 0 us; skew 500 ppm
I20260709 12:13:05.608378  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:05.611383  2017 webserver.cc:533] Webserver started at http://127.1.248.68:39571/ using document root <none> and password file <none>
I20260709 12:13:05.611970  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:05.612145  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:05.612504  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:05.613683  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-3-root/instance:
uuid: "6f0cdd57c5934921829c205d32b2b8a5"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-z9f9"
I20260709 12:13:05.618641  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:13:05.622782  3894 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.624581  2017 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:13:05.624946  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-3-root
uuid: "6f0cdd57c5934921829c205d32b2b8a5"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-z9f9"
I20260709 12:13:05.625315  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:05.648231  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:05.650038  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:05.652231  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:05.655134  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:05.655356  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.655715  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:05.655915  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.720338  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.68:43599
I20260709 12:13:05.720903  3956 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.68:43599 every 8 connection(s)
I20260709 12:13:05.724334  2017 auto_leader_rebalancer-test.cc:439] add a tserver: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:05.746315  3957 heartbeater.cc:344] Connected to a master server at 127.1.248.126:35191
I20260709 12:13:05.746805  3957 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:05.747958  3957 heartbeater.cc:507] Master 127.1.248.126:35191 requested a full tablet report, sending...
I20260709 12:13:05.750361  3088 ts_manager.cc:194] Registered new tserver with Master: 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:05.752415  3088 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34704
I20260709 12:13:06.383299  3263 consensus_queue.cc:237] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:06.392220  3192 raft_consensus.cc:1275] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.395246  3835 consensus_queue.cc:1048] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.399945  3335 raft_consensus.cc:1275] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.406942  3835 consensus_queue.cc:1048] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.408957  3835 raft_consensus.cc:2955] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:06.411518  3192 raft_consensus.cc:2955] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:06.442209  3088 catalog_manager.cc:5697] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:06.463850  3232 consensus_peers.cc:597] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 09cb299c977a476ab873860cf7e2a44c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.464856  3339 raft_consensus.cc:2955] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:06.477613  3192 consensus_queue.cc:237] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:06.492075  3263 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.494079  3339 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.493991  3961 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.495469  3753 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:06.509861  3157 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17a639dfba9c4cd98fcc0e73a3de49f9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.512686  3753 raft_consensus.cc:2955] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:06.516119  3262 raft_consensus.cc:2955] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:06.523478  3336 raft_consensus.cc:2955] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:06.533547  3192 consensus_queue.cc:237] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:06.542207  3087 catalog_manager.cc:5697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:06.566622  3262 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.568769  3961 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:06.571686  3157 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51ff9b5ea5944e51914ded65407b153b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.575845  3339 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.577817  3753 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.590444  3753 raft_consensus.cc:2955] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:06.593736  3339 raft_consensus.cc:2955] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:06.602229  3262 raft_consensus.cc:2955] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:06.604434  3192 consensus_queue.cc:237] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:06.626806  3339 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.627799  3262 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.628363  3961 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.629958  3753 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.622777  3090 catalog_manager.cc:5697] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
W20260709 12:13:06.633563  3157 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb103e3ac0ca481bace4eb01f0725ae8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.678102  3961 raft_consensus.cc:2955] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:06.686470  3339 raft_consensus.cc:2955] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:06.688740  3265 raft_consensus.cc:2955] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:06.703418  3087 catalog_manager.cc:5697] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.755321  3957 heartbeater.cc:499] Master 127.1.248.126:35191 was elected leader, sending a full tablet report...
I20260709 12:13:06.859004  3987 ts_tablet_manager.cc:933] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:06.862151  3987 tablet_copy_client.cc:323] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.66:38853
I20260709 12:13:06.871711  3990 ts_tablet_manager.cc:933] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:06.874697  3990 tablet_copy_client.cc:323] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.65:44889
I20260709 12:13:06.875854  3278 tablet_copy_service.cc:140] P 1ef05c9d901046dca7fe0e638cc693b9: Received BeginTabletCopySession request for tablet 09cb299c977a476ab873860cf7e2a44c from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:40120)
I20260709 12:13:06.876523  3278 tablet_copy_service.cc:161] P 1ef05c9d901046dca7fe0e638cc693b9: Beginning new tablet copy session on tablet 09cb299c977a476ab873860cf7e2a44c from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:40120: session id = 6f0cdd57c5934921829c205d32b2b8a5-09cb299c977a476ab873860cf7e2a44c
I20260709 12:13:06.884495  3278 tablet_copy_source_session.cc:215] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:06.888090  3203 tablet_copy_service.cc:140] P 7ac63b674f204bc4805ab989f8c965d3: Received BeginTabletCopySession request for tablet 17a639dfba9c4cd98fcc0e73a3de49f9 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:47276)
I20260709 12:13:06.888698  3203 tablet_copy_service.cc:161] P 7ac63b674f204bc4805ab989f8c965d3: Beginning new tablet copy session on tablet 17a639dfba9c4cd98fcc0e73a3de49f9 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:47276: session id = 6f0cdd57c5934921829c205d32b2b8a5-17a639dfba9c4cd98fcc0e73a3de49f9
I20260709 12:13:06.888948  3987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cb299c977a476ab873860cf7e2a44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.898828  3203 tablet_copy_source_session.cc:215] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:06.902478  3990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a639dfba9c4cd98fcc0e73a3de49f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.905699  3987 tablet_copy_client.cc:806] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:06.906287  3987 tablet_copy_client.cc:670] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:06.910395  3987 tablet_copy_client.cc:538] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:06.918077  3990 tablet_copy_client.cc:806] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:06.918550  3987 tablet_bootstrap.cc:492] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:06.918776  3990 tablet_copy_client.cc:670] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:06.923296  3990 tablet_copy_client.cc:538] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:06.936029  3990 tablet_bootstrap.cc:492] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:06.966755  3987 tablet_bootstrap.cc:492] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:06.968796  3987 tablet_bootstrap.cc:492] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:06.969755  3987 ts_tablet_manager.cc:1403] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.051s	user 0.039s	sys 0.009s
I20260709 12:13:06.973104  3987 raft_consensus.cc:359] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:06.974478  3987 raft_consensus.cc:740] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:06.976766  3993 ts_tablet_manager.cc:933] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:06.978446  3987 consensus_queue.cc:260] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:06.979694  3993 tablet_copy_client.cc:323] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.65:44889
I20260709 12:13:06.980679  3990 tablet_bootstrap.cc:492] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:06.981519  3203 tablet_copy_service.cc:140] P 7ac63b674f204bc4805ab989f8c965d3: Received BeginTabletCopySession request for tablet 51ff9b5ea5944e51914ded65407b153b from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:47276)
I20260709 12:13:06.981807  3990 tablet_bootstrap.cc:492] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:06.982120  3203 tablet_copy_service.cc:161] P 7ac63b674f204bc4805ab989f8c965d3: Beginning new tablet copy session on tablet 51ff9b5ea5944e51914ded65407b153b from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:47276: session id = 6f0cdd57c5934921829c205d32b2b8a5-51ff9b5ea5944e51914ded65407b153b
I20260709 12:13:06.982506  3990 ts_tablet_manager.cc:1403] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.009s
I20260709 12:13:06.985484  3990 raft_consensus.cc:359] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:06.987370  3990 raft_consensus.cc:740] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:06.988097  3990 consensus_queue.cc:260] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:06.989827  3203 tablet_copy_source_session.cc:215] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:06.994249  3993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ff9b5ea5944e51914ded65407b153b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.032375  3987 ts_tablet_manager.cc:1434] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.062s	user 0.014s	sys 0.016s
I20260709 12:13:07.035706  3278 tablet_copy_service.cc:342] P 1ef05c9d901046dca7fe0e638cc693b9: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-09cb299c977a476ab873860cf7e2a44c received from {username='slave'} at 127.0.0.1:40120
I20260709 12:13:07.036377  3278 tablet_copy_service.cc:434] P 1ef05c9d901046dca7fe0e638cc693b9: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-09cb299c977a476ab873860cf7e2a44c on tablet 09cb299c977a476ab873860cf7e2a44c with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:07.059170  3993 tablet_copy_client.cc:806] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:07.059827  3993 tablet_copy_client.cc:670] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:07.060961  3990 ts_tablet_manager.cc:1434] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.078s	user 0.017s	sys 0.039s
I20260709 12:13:07.063187  3993 tablet_copy_client.cc:538] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:07.063228  3203 tablet_copy_service.cc:342] P 7ac63b674f204bc4805ab989f8c965d3: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-17a639dfba9c4cd98fcc0e73a3de49f9 received from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:07.063763  3203 tablet_copy_service.cc:434] P 7ac63b674f204bc4805ab989f8c965d3: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-17a639dfba9c4cd98fcc0e73a3de49f9 on tablet 17a639dfba9c4cd98fcc0e73a3de49f9 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:07.071602  3993 tablet_bootstrap.cc:492] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:07.109612  3993 tablet_bootstrap.cc:492] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.112421  3993 tablet_bootstrap.cc:492] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:07.113205  3993 ts_tablet_manager.cc:1403] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.018s
I20260709 12:13:07.116488  3993 raft_consensus.cc:359] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:07.117489  3993 raft_consensus.cc:740] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:07.119072  3993 consensus_queue.cc:260] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:07.122468  3993 ts_tablet_manager.cc:1434] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:13:07.130613  3203 tablet_copy_service.cc:342] P 7ac63b674f204bc4805ab989f8c965d3: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-51ff9b5ea5944e51914ded65407b153b received from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:07.131062  3203 tablet_copy_service.cc:434] P 7ac63b674f204bc4805ab989f8c965d3: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-51ff9b5ea5944e51914ded65407b153b on tablet 51ff9b5ea5944e51914ded65407b153b with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:07.161734  3993 ts_tablet_manager.cc:933] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:07.164108  3993 tablet_copy_client.cc:323] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.65:44889
I20260709 12:13:07.165674  3203 tablet_copy_service.cc:140] P 7ac63b674f204bc4805ab989f8c965d3: Received BeginTabletCopySession request for tablet fb103e3ac0ca481bace4eb01f0725ae8 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:47276)
I20260709 12:13:07.166208  3203 tablet_copy_service.cc:161] P 7ac63b674f204bc4805ab989f8c965d3: Beginning new tablet copy session on tablet fb103e3ac0ca481bace4eb01f0725ae8 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:47276: session id = 6f0cdd57c5934921829c205d32b2b8a5-fb103e3ac0ca481bace4eb01f0725ae8
I20260709 12:13:07.172072  3203 tablet_copy_source_session.cc:215] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:07.174656  3993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb103e3ac0ca481bace4eb01f0725ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.189344  3993 tablet_copy_client.cc:806] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:07.191186  3993 tablet_copy_client.cc:670] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:07.195312  3993 tablet_copy_client.cc:538] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:07.204165  3993 tablet_bootstrap.cc:492] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:07.225435  3993 tablet_bootstrap.cc:492] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.226444  3993 tablet_bootstrap.cc:492] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:07.227814  3993 ts_tablet_manager.cc:1403] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.003s
I20260709 12:13:07.230921  3993 raft_consensus.cc:359] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:07.231832  3993 raft_consensus.cc:740] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:07.232475  3993 consensus_queue.cc:260] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:07.234877  3993 ts_tablet_manager.cc:1434] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:13:07.236807  3203 tablet_copy_service.cc:342] P 7ac63b674f204bc4805ab989f8c965d3: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-fb103e3ac0ca481bace4eb01f0725ae8 received from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:07.237254  3203 tablet_copy_service.cc:434] P 7ac63b674f204bc4805ab989f8c965d3: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-fb103e3ac0ca481bace4eb01f0725ae8 on tablet fb103e3ac0ca481bace4eb01f0725ae8 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:07.376834  3932 raft_consensus.cc:1217] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:13:07.394878  3932 raft_consensus.cc:1217] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:07.464030  3932 raft_consensus.cc:1217] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:07.702714  3932 raft_consensus.cc:1217] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:07.871649  3884 raft_consensus.cc:1064] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:07.874779  3884 consensus_queue.cc:237] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:07.882505  3339 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:07.882602  3932 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:07.883159  3263 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:07.884487  3884 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.885560  3961 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.886302  3753 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.908044  3753 raft_consensus.cc:2955] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:07.910118  3265 raft_consensus.cc:2955] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:07.929149  3335 raft_consensus.cc:2955] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:07.951674  3932 raft_consensus.cc:2955] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:07.966650  3088 catalog_manager.cc:5697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.057929  4010 raft_consensus.cc:1064] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:08.060717  4010 consensus_queue.cc:237] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:08.074457  3932 raft_consensus.cc:1275] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.078931  3336 raft_consensus.cc:1275] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.081749  4011 consensus_queue.cc:1048] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.083817  3966 consensus_queue.cc:1048] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.085204  3961 raft_consensus.cc:1064] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:08.087463  3961 consensus_queue.cc:237] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:08.109819  3961 raft_consensus.cc:1064] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:08.110069  3192 raft_consensus.cc:1275] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.109431  3966 raft_consensus.cc:2955] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.111727  3932 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.111776  3335 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.113224  4014 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.115684  3961 consensus_queue.cc:237] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:08.116845  4008 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.124089  3335 raft_consensus.cc:2955] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.127032  4011 consensus_queue.cc:1048] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.133013  3262 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.158226  3192 raft_consensus.cc:2955] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.167748  3931 raft_consensus.cc:2955] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:13:08.198253  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 58287.1us
I20260709 12:13:08.201889  4014 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:13:08.223107  3932 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.225823  3753 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.226454  3339 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.233024  3753 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.231796  3267 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.265300  3961 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:08.271281  3262 raft_consensus.cc:2955] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.269140  4008 raft_consensus.cc:2955] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.277650  3087 catalog_manager.cc:5697] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.284808  3335 raft_consensus.cc:2955] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.313767  3188 consensus_queue.cc:237] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:08.334393  3265 consensus_queue.cc:237] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:08.337523  4024 raft_consensus.cc:2955] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.338274  3339 raft_consensus.cc:2955] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.342511  3932 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:08.356822  4006 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:08.368112  3753 raft_consensus.cc:2955] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.370012  3932 raft_consensus.cc:2955] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.372004  3931 raft_consensus.cc:2955] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.362591  3088 catalog_manager.cc:5697] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.383376  3262 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:08.393046  4014 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:08.390585  3090 catalog_manager.cc:5697] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.398032  3931 raft_consensus.cc:1275] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.399535  3336 raft_consensus.cc:1275] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.401245  3835 consensus_queue.cc:1048] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:08.402202  4005 consensus_queue.cc:1048] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:08.401252  3263 raft_consensus.cc:2955] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.417196  4009 raft_consensus.cc:2955] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.419185  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 17a639dfba9c4cd98fcc0e73a3de49f9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:08.421872  3335 raft_consensus.cc:2955] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.430672  3267 raft_consensus.cc:2955] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.421038  3931 raft_consensus.cc:2955] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.450600  3932 raft_consensus.cc:2955] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.468779  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 09cb299c977a476ab873860cf7e2a44c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:08.493175  3188 consensus_queue.cc:237] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:08.494412  3088 catalog_manager.cc:5697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.496345  3088 catalog_manager.cc:5697] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.510306  3335 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.510905  3931 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.511818  4014 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:08.515513  3328 tablet_service.cc:1558] Processing DeleteTablet for tablet 17a639dfba9c4cd98fcc0e73a3de49f9 with delete_type TABLET_DATA_TOMBSTONED (TS eb49d92feeb14382b3baa49d696b6141 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:08.518776  4031 tablet_replica.cc:333] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:13:08.519845  4031 raft_consensus.cc:2243] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:08.520828  4014 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:08.521137  4031 raft_consensus.cc:2272] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:08.525080  3182 tablet_service.cc:1558] Processing DeleteTablet for tablet 09cb299c977a476ab873860cf7e2a44c with delete_type TABLET_DATA_TOMBSTONED (TS 7ac63b674f204bc4805ab989f8c965d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40488
I20260709 12:13:08.525640  4008 raft_consensus.cc:2955] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.525373  3335 raft_consensus.cc:2955] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.537209  4032 tablet_replica.cc:333] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:13:08.538465  4032 raft_consensus.cc:2243] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:08.538166  3931 raft_consensus.cc:2955] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.539582  4032 raft_consensus.cc:2272] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:08.545176  4032 ts_tablet_manager.cc:1916] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:08.550134  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fb103e3ac0ca481bace4eb01f0725ae8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:08.548718  3188 consensus_queue.cc:237] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:08.557586  3090 catalog_manager.cc:5697] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.574411  4032 ts_tablet_manager.cc:1929] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:08.574923  4032 log.cc:1199] T 09cb299c977a476ab873860cf7e2a44c P 7ac63b674f204bc4805ab989f8c965d3: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/wals/09cb299c977a476ab873860cf7e2a44c
I20260709 12:13:08.576535  3075 catalog_manager.cc:5028] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): tablet 09cb299c977a476ab873860cf7e2a44c (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:08.579676  3250 tablet_service.cc:1558] Processing DeleteTablet for tablet fb103e3ac0ca481bace4eb01f0725ae8 with delete_type TABLET_DATA_TOMBSTONED (TS 1ef05c9d901046dca7fe0e638cc693b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:08.580843  4031 ts_tablet_manager.cc:1916] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:08.587275  3931 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.590324  3333 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.597290  4024 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:08.605254  4006 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:08.606683  4031 ts_tablet_manager.cc:1929] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:13:08.607165  4031 log.cc:1199] T 17a639dfba9c4cd98fcc0e73a3de49f9 P eb49d92feeb14382b3baa49d696b6141: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/wals/17a639dfba9c4cd98fcc0e73a3de49f9
I20260709 12:13:08.609443  3076 catalog_manager.cc:5028] TS eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): tablet 17a639dfba9c4cd98fcc0e73a3de49f9 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:08.622844  3961 raft_consensus.cc:2955] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.637456  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 51ff9b5ea5944e51914ded65407b153b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:08.637832  3333 raft_consensus.cc:2955] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.639950  3931 raft_consensus.cc:2955] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:08.655166  4033 tablet_replica.cc:333] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:13:08.658771  3088 catalog_manager.cc:5697] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.663821  4033 raft_consensus.cc:2243] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:08.664669  4033 raft_consensus.cc:2272] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:08.670176  4033 ts_tablet_manager.cc:1916] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:08.672892  3250 tablet_service.cc:1558] Processing DeleteTablet for tablet 51ff9b5ea5944e51914ded65407b153b with delete_type TABLET_DATA_TOMBSTONED (TS 1ef05c9d901046dca7fe0e638cc693b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:08.686198  4033 ts_tablet_manager.cc:1929] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:08.686571  4033 log.cc:1199] T fb103e3ac0ca481bace4eb01f0725ae8 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/wals/fb103e3ac0ca481bace4eb01f0725ae8
I20260709 12:13:08.687964  3075 catalog_manager.cc:5028] TS 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): tablet fb103e3ac0ca481bace4eb01f0725ae8 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:08.688112  4033 tablet_replica.cc:333] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:13:08.689055  4033 raft_consensus.cc:2243] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:08.689785  4033 raft_consensus.cc:2272] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:08.693481  4033 ts_tablet_manager.cc:1916] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:08.706908  4033 ts_tablet_manager.cc:1929] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:08.707283  4033 log.cc:1199] T 51ff9b5ea5944e51914ded65407b153b P 1ef05c9d901046dca7fe0e638cc693b9: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/wals/51ff9b5ea5944e51914ded65407b153b
I20260709 12:13:08.708554  3075 catalog_manager.cc:5028] TS 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): tablet 51ff9b5ea5944e51914ded65407b153b (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:09.796155  3267 consensus_queue.cc:237] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:09.804275  3335 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:09.804587  3188 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:09.804581  3232 consensus_peers.cc:597] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9471f19ecb64571bc899936c896d99f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:09.805858  4036 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.806782  4005 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.814848  4035 raft_consensus.cc:2955] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:09.816414  3335 raft_consensus.cc:2955] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:09.816484  3188 raft_consensus.cc:2955] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:09.829903  3188 consensus_queue.cc:237] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:09.836258  3086 catalog_manager.cc:5697] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:09.846736  3157 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c79ed88d91bd49d4a95c3eb59fb97a63. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:09.851094  3267 raft_consensus.cc:1275] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:09.852599  4014 consensus_queue.cc:1048] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:09.856110  3335 raft_consensus.cc:1275] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:09.857597  4008 consensus_queue.cc:1048] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:09.862222  4014 raft_consensus.cc:2955] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:09.863922  3267 raft_consensus.cc:2955] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:09.894170  3267 consensus_queue.cc:237] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:09.895251  3335 raft_consensus.cc:2955] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:09.901247  3088 catalog_manager.cc:5697] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:09.905537  3232 consensus_peers.cc:597] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c298faf2e6b4619a5c83569e86043e8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:09.907291  3333 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:09.907302  3192 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:09.910264  4005 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.912437  4005 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.935782  4035 raft_consensus.cc:2955] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:09.937595  3335 raft_consensus.cc:2955] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:09.938145  3192 raft_consensus.cc:2955] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:09.957655  3090 catalog_manager.cc:5697] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:09.969120  3192 consensus_queue.cc:237] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:13:09.983820  3157 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9796736c241b42c283a7f6a433742bed. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:09.984577  3333 raft_consensus.cc:1275] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:09.986220  3263 raft_consensus.cc:1275] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:09.987457  4008 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.988804  4014 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.996977  4014 raft_consensus.cc:2955] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:10.000878  3335 raft_consensus.cc:2955] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:10.005017  3263 raft_consensus.cc:2955] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:10.022877  3088 catalog_manager.cc:5697] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.190490  4056 ts_tablet_manager.cc:933] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:10.199340  4056 tablet_copy_client.cc:323] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.66:38853
I20260709 12:13:10.201660  3278 tablet_copy_service.cc:140] P 1ef05c9d901046dca7fe0e638cc693b9: Received BeginTabletCopySession request for tablet b9471f19ecb64571bc899936c896d99f from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:40120)
I20260709 12:13:10.202332  3278 tablet_copy_service.cc:161] P 1ef05c9d901046dca7fe0e638cc693b9: Beginning new tablet copy session on tablet b9471f19ecb64571bc899936c896d99f from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:40120: session id = 6f0cdd57c5934921829c205d32b2b8a5-b9471f19ecb64571bc899936c896d99f
I20260709 12:13:10.212929  3278 tablet_copy_source_session.cc:215] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:10.220772  4056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9471f19ecb64571bc899936c896d99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.237768  4056 tablet_copy_client.cc:806] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:10.238556  4056 tablet_copy_client.cc:670] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:10.242815  4056 tablet_copy_client.cc:538] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:10.253865  4056 tablet_bootstrap.cc:492] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:10.280025  4056 tablet_bootstrap.cc:492] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:10.281091  4056 tablet_bootstrap.cc:492] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:10.282981  4056 ts_tablet_manager.cc:1403] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.009s
I20260709 12:13:10.288908  4056 raft_consensus.cc:359] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:10.290747  4056 raft_consensus.cc:740] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:10.291519  4056 consensus_queue.cc:260] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:10.300612  4059 ts_tablet_manager.cc:933] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:10.303337  4059 tablet_copy_client.cc:323] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.65:44889
I20260709 12:13:10.303689  4056 ts_tablet_manager.cc:1434] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 12:13:10.305451  3278 tablet_copy_service.cc:342] P 1ef05c9d901046dca7fe0e638cc693b9: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-b9471f19ecb64571bc899936c896d99f received from {username='slave'} at 127.0.0.1:40120
I20260709 12:13:10.305950  3278 tablet_copy_service.cc:434] P 1ef05c9d901046dca7fe0e638cc693b9: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-b9471f19ecb64571bc899936c896d99f on tablet b9471f19ecb64571bc899936c896d99f with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:10.307752  3203 tablet_copy_service.cc:140] P 7ac63b674f204bc4805ab989f8c965d3: Received BeginTabletCopySession request for tablet c79ed88d91bd49d4a95c3eb59fb97a63 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:47276)
I20260709 12:13:10.308329  3203 tablet_copy_service.cc:161] P 7ac63b674f204bc4805ab989f8c965d3: Beginning new tablet copy session on tablet c79ed88d91bd49d4a95c3eb59fb97a63 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:47276: session id = 6f0cdd57c5934921829c205d32b2b8a5-c79ed88d91bd49d4a95c3eb59fb97a63
I20260709 12:13:10.315284  3203 tablet_copy_source_session.cc:215] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:10.323163  4059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79ed88d91bd49d4a95c3eb59fb97a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.340107  4059 tablet_copy_client.cc:806] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:10.340739  4059 tablet_copy_client.cc:670] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:10.344913  4059 tablet_copy_client.cc:538] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:10.352926  4059 tablet_bootstrap.cc:492] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:10.374455  4059 tablet_bootstrap.cc:492] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:10.375414  4059 tablet_bootstrap.cc:492] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:10.376055  4059 ts_tablet_manager.cc:1403] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.005s
I20260709 12:13:10.379091  4059 raft_consensus.cc:359] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:10.380028  4059 raft_consensus.cc:740] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:10.380677  4059 consensus_queue.cc:260] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:10.383466  4059 ts_tablet_manager.cc:1434] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:10.385231  3203 tablet_copy_service.cc:342] P 7ac63b674f204bc4805ab989f8c965d3: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-c79ed88d91bd49d4a95c3eb59fb97a63 received from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:10.385656  3203 tablet_copy_service.cc:434] P 7ac63b674f204bc4805ab989f8c965d3: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-c79ed88d91bd49d4a95c3eb59fb97a63 on tablet c79ed88d91bd49d4a95c3eb59fb97a63 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:10.498996  4059 ts_tablet_manager.cc:933] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:10.502339  4059 tablet_copy_client.cc:323] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.65:44889
I20260709 12:13:10.504128  3203 tablet_copy_service.cc:140] P 7ac63b674f204bc4805ab989f8c965d3: Received BeginTabletCopySession request for tablet 9796736c241b42c283a7f6a433742bed from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:47276)
I20260709 12:13:10.504732  3203 tablet_copy_service.cc:161] P 7ac63b674f204bc4805ab989f8c965d3: Beginning new tablet copy session on tablet 9796736c241b42c283a7f6a433742bed from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:47276: session id = 6f0cdd57c5934921829c205d32b2b8a5-9796736c241b42c283a7f6a433742bed
I20260709 12:13:10.508072  4056 ts_tablet_manager.cc:933] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:10.512392  4056 tablet_copy_client.cc:323] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.66:38853
I20260709 12:13:10.513974  3278 tablet_copy_service.cc:140] P 1ef05c9d901046dca7fe0e638cc693b9: Received BeginTabletCopySession request for tablet 8c298faf2e6b4619a5c83569e86043e8 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:40120)
I20260709 12:13:10.514468  3278 tablet_copy_service.cc:161] P 1ef05c9d901046dca7fe0e638cc693b9: Beginning new tablet copy session on tablet 8c298faf2e6b4619a5c83569e86043e8 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:40120: session id = 6f0cdd57c5934921829c205d32b2b8a5-8c298faf2e6b4619a5c83569e86043e8
I20260709 12:13:10.514489  3203 tablet_copy_source_session.cc:215] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:10.519959  4059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9796736c241b42c283a7f6a433742bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.522457  3278 tablet_copy_source_session.cc:215] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:10.528903  4056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c298faf2e6b4619a5c83569e86043e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.542591  4059 tablet_copy_client.cc:806] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:10.543258  4059 tablet_copy_client.cc:670] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:10.550361  4056 tablet_copy_client.cc:806] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:10.551029  4056 tablet_copy_client.cc:670] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:10.556560  4056 tablet_copy_client.cc:538] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:10.558293  4059 tablet_copy_client.cc:538] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:10.567606  4056 tablet_bootstrap.cc:492] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:10.567783  4059 tablet_bootstrap.cc:492] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:10.588295  4056 tablet_bootstrap.cc:492] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:10.589066  4056 tablet_bootstrap.cc:492] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:10.589628  4056 ts_tablet_manager.cc:1403] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 12:13:10.590508  4059 tablet_bootstrap.cc:492] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:10.591631  4059 tablet_bootstrap.cc:492] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:10.592309  4059 ts_tablet_manager.cc:1403] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.025s	user 0.022s	sys 0.000s
I20260709 12:13:10.594291  4056 raft_consensus.cc:359] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:10.595242  4056 raft_consensus.cc:740] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:10.595956  4056 consensus_queue.cc:260] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:10.596277  4059 raft_consensus.cc:359] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:10.597191  4059 raft_consensus.cc:740] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:10.598225  4056 ts_tablet_manager.cc:1434] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:10.597898  4059 consensus_queue.cc:260] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:10.600337  4059 ts_tablet_manager.cc:1434] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:10.605857  3203 tablet_copy_service.cc:342] P 7ac63b674f204bc4805ab989f8c965d3: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-9796736c241b42c283a7f6a433742bed received from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:10.606297  3203 tablet_copy_service.cc:434] P 7ac63b674f204bc4805ab989f8c965d3: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-9796736c241b42c283a7f6a433742bed on tablet 9796736c241b42c283a7f6a433742bed with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:10.606380  3278 tablet_copy_service.cc:342] P 1ef05c9d901046dca7fe0e638cc693b9: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-8c298faf2e6b4619a5c83569e86043e8 received from {username='slave'} at 127.0.0.1:40120
I20260709 12:13:10.606999  3278 tablet_copy_service.cc:434] P 1ef05c9d901046dca7fe0e638cc693b9: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-8c298faf2e6b4619a5c83569e86043e8 on tablet 8c298faf2e6b4619a5c83569e86043e8 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:10.618150  3931 raft_consensus.cc:1217] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:10.693954  3931 raft_consensus.cc:1217] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:10.900823  3931 raft_consensus.cc:1217] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:10.988044  4067 raft_consensus.cc:1064] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:10.990347  4067 consensus_queue.cc:237] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:10.997337  3931 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.998909  4067 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:10.999619  3335 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.000968  3966 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:11.001938  3188 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.003512  4067 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:11.014902  4067 raft_consensus.cc:2955] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.023221  3188 raft_consensus.cc:2955] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.025395  3333 raft_consensus.cc:2955] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.057551  3931 raft_consensus.cc:2955] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.064918  3088 catalog_manager.cc:5697] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.070317  3932 raft_consensus.cc:1217] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:11.112634  3267 consensus_queue.cc:237] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:11.130132  4014 raft_consensus.cc:1064] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:11.133445  3931 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.133198  4014 consensus_queue.cc:237] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:11.135145  4035 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.141186  3333 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.145161  3966 raft_consensus.cc:2955] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.149060  3932 raft_consensus.cc:2955] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.147760  3931 raft_consensus.cc:1275] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.154583  4008 consensus_queue.cc:1048] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:11.155364  4067 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.162942  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9471f19ecb64571bc899936c896d99f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:11.163986  3335 raft_consensus.cc:2955] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.180825  3086 catalog_manager.cc:5697] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.195542  3265 raft_consensus.cc:1275] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.204814  3182 tablet_service.cc:1558] Processing DeleteTablet for tablet b9471f19ecb64571bc899936c896d99f with delete_type TABLET_DATA_TOMBSTONED (TS 7ac63b674f204bc4805ab989f8c965d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40488
I20260709 12:13:11.207010  3333 raft_consensus.cc:1275] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.210779  4008 consensus_queue.cc:1048] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:11.214731  4014 consensus_queue.cc:1048] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:11.222638  4080 tablet_replica.cc:333] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:13:11.224467  4080 raft_consensus.cc:2243] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:11.225477  4080 raft_consensus.cc:2272] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:11.229868  4080 ts_tablet_manager.cc:1916] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:11.237721  4014 raft_consensus.cc:2955] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.241926  3335 raft_consensus.cc:2955] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.258036  4080 ts_tablet_manager.cc:1929] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:11.258602  4080 log.cc:1199] T b9471f19ecb64571bc899936c896d99f P 7ac63b674f204bc4805ab989f8c965d3: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/wals/b9471f19ecb64571bc899936c896d99f
I20260709 12:13:11.252242  3262 raft_consensus.cc:2955] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.265666  3086 catalog_manager.cc:5697] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.295704  3931 raft_consensus.cc:2955] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.299760  3075 catalog_manager.cc:5028] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): tablet b9471f19ecb64571bc899936c896d99f (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:11.299634  3185 consensus_queue.cc:237] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:11.315201  3262 raft_consensus.cc:1275] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.327597  4024 consensus_queue.cc:1048] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.330585  3932 raft_consensus.cc:1275] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.333581  4024 consensus_queue.cc:1048] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.339586  4008 raft_consensus.cc:2955] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.341331  3262 raft_consensus.cc:2955] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.351110  3931 raft_consensus.cc:2955] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.354641  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c79ed88d91bd49d4a95c3eb59fb97a63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:11.364777  3086 catalog_manager.cc:5697] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.376766  3328 tablet_service.cc:1558] Processing DeleteTablet for tablet c79ed88d91bd49d4a95c3eb59fb97a63 with delete_type TABLET_DATA_TOMBSTONED (TS eb49d92feeb14382b3baa49d696b6141 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:11.378897  4085 tablet_replica.cc:333] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:13:11.380236  4085 raft_consensus.cc:2243] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:11.381805  4085 raft_consensus.cc:2272] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:11.387919  4085 ts_tablet_manager.cc:1916] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:11.410300  4085 ts_tablet_manager.cc:1929] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:11.410882  4085 log.cc:1199] T c79ed88d91bd49d4a95c3eb59fb97a63 P eb49d92feeb14382b3baa49d696b6141: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/wals/c79ed88d91bd49d4a95c3eb59fb97a63
I20260709 12:13:11.411084  4035 raft_consensus.cc:1064] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:11.412945  3076 catalog_manager.cc:5028] TS eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): tablet c79ed88d91bd49d4a95c3eb59fb97a63 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:11.413570  4035 consensus_queue.cc:237] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:11.428862  3931 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.434585  4067 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:11.435263  3339 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.436332  3192 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.437772  4067 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:11.439157  4035 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:11.461306  4035 raft_consensus.cc:2955] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.464481  3333 raft_consensus.cc:2955] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.463308  3192 raft_consensus.cc:2955] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.480019  3931 raft_consensus.cc:2955] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.499871  3087 catalog_manager.cc:5697] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.526727  3263 consensus_queue.cc:237] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:11.538393  3931 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.540038  4072 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:11.543473  3339 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.549045  4035 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.550259  4067 raft_consensus.cc:2955] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.555104  3338 raft_consensus.cc:2955] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.560204  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8c298faf2e6b4619a5c83569e86043e8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:11.566210  3931 raft_consensus.cc:2955] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.586069  3090 catalog_manager.cc:5697] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.604730  3182 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c298faf2e6b4619a5c83569e86043e8 with delete_type TABLET_DATA_TOMBSTONED (TS 7ac63b674f204bc4805ab989f8c965d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40488
I20260709 12:13:11.605792  4080 tablet_replica.cc:333] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:13:11.619516  4080 raft_consensus.cc:2243] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:11.620352  4080 raft_consensus.cc:2272] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:11.623912  4080 ts_tablet_manager.cc:1916] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:11.641886  4080 ts_tablet_manager.cc:1929] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:11.642426  4080 log.cc:1199] T 8c298faf2e6b4619a5c83569e86043e8 P 7ac63b674f204bc4805ab989f8c965d3: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/wals/8c298faf2e6b4619a5c83569e86043e8
I20260709 12:13:11.647624  3075 catalog_manager.cc:5028] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): tablet 8c298faf2e6b4619a5c83569e86043e8 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:11.685041  4008 raft_consensus.cc:1064] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:11.687611  4008 consensus_queue.cc:237] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:11.694252  3338 raft_consensus.cc:1275] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.694381  3931 raft_consensus.cc:1275] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.694648  3263 raft_consensus.cc:1275] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.696048  4014 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:11.696904  4084 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:11.700011  4008 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:11.716377  3931 raft_consensus.cc:2955] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.714444  4014 raft_consensus.cc:2955] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.731176  3338 raft_consensus.cc:2955] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.734908  3090 catalog_manager.cc:5697] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.750728  3262 raft_consensus.cc:2955] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:13:11.838356  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 89502.8us
I20260709 12:13:11.851418  3188 consensus_queue.cc:237] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:11.863967  3267 raft_consensus.cc:1275] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.864817  3931 raft_consensus.cc:1275] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.866408  4094 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.876614  4094 raft_consensus.cc:2955] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.878486  3262 raft_consensus.cc:2955] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.883610  4024 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.888036  3931 raft_consensus.cc:2955] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.902362  3090 catalog_manager.cc:5697] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:11.914669  3328 tablet_service.cc:1558] Processing DeleteTablet for tablet 9796736c241b42c283a7f6a433742bed with delete_type TABLET_DATA_TOMBSTONED (TS eb49d92feeb14382b3baa49d696b6141 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:11.920065  4095 tablet_replica.cc:333] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:13:11.921156  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9796736c241b42c283a7f6a433742bed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:11.921154  4095 raft_consensus.cc:2243] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:11.922588  4095 raft_consensus.cc:2272] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:11.926926  4095 ts_tablet_manager.cc:1916] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:11.939899  4095 ts_tablet_manager.cc:1929] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:11.940198  4095 log.cc:1199] T 9796736c241b42c283a7f6a433742bed P eb49d92feeb14382b3baa49d696b6141: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/wals/9796736c241b42c283a7f6a433742bed
I20260709 12:13:11.941431  3076 catalog_manager.cc:5028] TS eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): tablet 9796736c241b42c283a7f6a433742bed (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:13.008916  3333 consensus_queue.cc:237] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:13.018199  3262 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.020366  3188 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.021425  4097 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:13.023062  3984 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:13.034865  3984 raft_consensus.cc:2955] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:13.036136  3185 raft_consensus.cc:2955] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:13.042682  3262 raft_consensus.cc:2955] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
W20260709 12:13:13.054934  3306 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: acb4310417b348518d7accdf0538e249. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:13.060416  3086 catalog_manager.cc:5697] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:13.063104  3185 consensus_queue.cc:237] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:13:13.081691  3157 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4338ede94a794c41ba16cba6ac585f9a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:13.082403  3338 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.084352  4008 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:13.085045  3262 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.086387  4107 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:13.103042  4107 raft_consensus.cc:2955] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:13.111250  3338 raft_consensus.cc:2955] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:13.118073  3263 raft_consensus.cc:2955] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:13.132432  3086 catalog_manager.cc:5697] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:13.133275  3338 consensus_queue.cc:237] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:13.151160  3263 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:13.153537  3306 consensus_peers.cc:597] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa54c541b3454731ad51d4012eb0ad72. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:13.156138  3185 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.156594  4097 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:13.158878  4083 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:13.168349  3984 raft_consensus.cc:2955] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:13.170265  3263 raft_consensus.cc:2955] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:13.175717  3185 raft_consensus.cc:2955] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:13.181645  3262 consensus_queue.cc:237] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:13.186250  3090 catalog_manager.cc:5697] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:13.219161  3232 consensus_peers.cc:597] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a10fd7fda53e4a8ea272336588c66980. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:13.227337  3339 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.231762  3188 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.235103  4067 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:13.237375  4096 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:13.256502  4117 raft_consensus.cc:2955] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:13.258282  3339 raft_consensus.cc:2955] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:13.260543  3188 raft_consensus.cc:2955] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:13.277762  3090 catalog_manager.cc:5697] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:13.476264  4120 ts_tablet_manager.cc:933] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:13.478451  4120 tablet_copy_client.cc:323] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.67:35301
I20260709 12:13:13.531085  3352 tablet_copy_service.cc:140] P eb49d92feeb14382b3baa49d696b6141: Received BeginTabletCopySession request for tablet acb4310417b348518d7accdf0538e249 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:52822)
I20260709 12:13:13.531766  3352 tablet_copy_service.cc:161] P eb49d92feeb14382b3baa49d696b6141: Beginning new tablet copy session on tablet acb4310417b348518d7accdf0538e249 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:52822: session id = 6f0cdd57c5934921829c205d32b2b8a5-acb4310417b348518d7accdf0538e249
I20260709 12:13:13.543642  3352 tablet_copy_source_session.cc:215] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:13.547164  4120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb4310417b348518d7accdf0538e249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:13.552433  4123 ts_tablet_manager.cc:933] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:13.572662  4123 tablet_copy_client.cc:323] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.67:35301
I20260709 12:13:13.578953  3352 tablet_copy_service.cc:140] P eb49d92feeb14382b3baa49d696b6141: Received BeginTabletCopySession request for tablet aa54c541b3454731ad51d4012eb0ad72 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:52822)
I20260709 12:13:13.579583  3352 tablet_copy_service.cc:161] P eb49d92feeb14382b3baa49d696b6141: Beginning new tablet copy session on tablet aa54c541b3454731ad51d4012eb0ad72 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:52822: session id = 6f0cdd57c5934921829c205d32b2b8a5-aa54c541b3454731ad51d4012eb0ad72
I20260709 12:13:13.592727  3352 tablet_copy_source_session.cc:215] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:13.594738  4120 tablet_copy_client.cc:806] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:13.595588  4120 tablet_copy_client.cc:670] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:13.600069  4120 tablet_copy_client.cc:538] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:13.601722  4123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa54c541b3454731ad51d4012eb0ad72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:13.613898  4120 tablet_bootstrap.cc:492] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:13.630398  4123 tablet_copy_client.cc:806] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:13.631078  4123 tablet_copy_client.cc:670] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:13.635601  4123 tablet_copy_client.cc:538] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:13.644948  4120 tablet_bootstrap.cc:492] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:13.646005  4120 tablet_bootstrap.cc:492] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:13.646327  4123 tablet_bootstrap.cc:492] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:13.646708  4120 ts_tablet_manager.cc:1403] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.001s
I20260709 12:13:13.652518  4120 raft_consensus.cc:359] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:13.653517  4120 raft_consensus.cc:740] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:13.657464  4120 consensus_queue.cc:260] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:13.677522  4127 ts_tablet_manager.cc:933] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:13.684783  4127 tablet_copy_client.cc:323] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.65:44889
I20260709 12:13:13.686600  3203 tablet_copy_service.cc:140] P 7ac63b674f204bc4805ab989f8c965d3: Received BeginTabletCopySession request for tablet 4338ede94a794c41ba16cba6ac585f9a from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:47276)
I20260709 12:13:13.687157  3203 tablet_copy_service.cc:161] P 7ac63b674f204bc4805ab989f8c965d3: Beginning new tablet copy session on tablet 4338ede94a794c41ba16cba6ac585f9a from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:47276: session id = 6f0cdd57c5934921829c205d32b2b8a5-4338ede94a794c41ba16cba6ac585f9a
I20260709 12:13:13.690155  4123 tablet_bootstrap.cc:492] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:13.691213  4123 tablet_bootstrap.cc:492] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:13.693145  4123 ts_tablet_manager.cc:1403] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.005s
I20260709 12:13:13.699919  4120 ts_tablet_manager.cc:1434] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.053s	user 0.013s	sys 0.014s
I20260709 12:13:13.707348  3203 tablet_copy_source_session.cc:215] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:13.709479  3352 tablet_copy_service.cc:342] P eb49d92feeb14382b3baa49d696b6141: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-acb4310417b348518d7accdf0538e249 received from {username='slave'} at 127.0.0.1:52822
I20260709 12:13:13.710182  3352 tablet_copy_service.cc:434] P eb49d92feeb14382b3baa49d696b6141: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-acb4310417b348518d7accdf0538e249 on tablet acb4310417b348518d7accdf0538e249 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:13.713568  4123 raft_consensus.cc:359] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:13.714744  4123 raft_consensus.cc:740] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:13.715662  4123 consensus_queue.cc:260] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:13.716993  4127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4338ede94a794c41ba16cba6ac585f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:13.721727  4123 ts_tablet_manager.cc:1434] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:13:13.728196  3352 tablet_copy_service.cc:342] P eb49d92feeb14382b3baa49d696b6141: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-aa54c541b3454731ad51d4012eb0ad72 received from {username='slave'} at 127.0.0.1:52822
I20260709 12:13:13.728711  3352 tablet_copy_service.cc:434] P eb49d92feeb14382b3baa49d696b6141: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-aa54c541b3454731ad51d4012eb0ad72 on tablet aa54c541b3454731ad51d4012eb0ad72 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:13.740227  4127 tablet_copy_client.cc:806] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:13.740895  4127 tablet_copy_client.cc:670] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:13.760488  4127 tablet_copy_client.cc:538] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:13.771126  4127 tablet_bootstrap.cc:492] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:13.800782  4127 tablet_bootstrap.cc:492] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:13.801987  4127 tablet_bootstrap.cc:492] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:13.802779  4127 ts_tablet_manager.cc:1403] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.013s
I20260709 12:13:13.806107  4127 raft_consensus.cc:359] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:13.807196  4127 raft_consensus.cc:740] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:13.808040  4127 consensus_queue.cc:260] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:13.810968  4127 ts_tablet_manager.cc:1434] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:13:13.812749  3203 tablet_copy_service.cc:342] P 7ac63b674f204bc4805ab989f8c965d3: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-4338ede94a794c41ba16cba6ac585f9a received from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:13.813233  3203 tablet_copy_service.cc:434] P 7ac63b674f204bc4805ab989f8c965d3: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-4338ede94a794c41ba16cba6ac585f9a on tablet 4338ede94a794c41ba16cba6ac585f9a with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:13.826743  4127 ts_tablet_manager.cc:933] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:13.830041  4127 tablet_copy_client.cc:323] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.66:38853
I20260709 12:13:13.832295  3278 tablet_copy_service.cc:140] P 1ef05c9d901046dca7fe0e638cc693b9: Received BeginTabletCopySession request for tablet a10fd7fda53e4a8ea272336588c66980 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:40120)
I20260709 12:13:13.833099  3278 tablet_copy_service.cc:161] P 1ef05c9d901046dca7fe0e638cc693b9: Beginning new tablet copy session on tablet a10fd7fda53e4a8ea272336588c66980 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:40120: session id = 6f0cdd57c5934921829c205d32b2b8a5-a10fd7fda53e4a8ea272336588c66980
I20260709 12:13:13.844890  3278 tablet_copy_source_session.cc:215] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:13.848415  4127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10fd7fda53e4a8ea272336588c66980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:13.865175  3932 raft_consensus.cc:1217] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:13.876052  4127 tablet_copy_client.cc:806] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:13.877153  4127 tablet_copy_client.cc:670] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:13.881800  4127 tablet_copy_client.cc:538] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:13.900573  4127 tablet_bootstrap.cc:492] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:13.928162  4127 tablet_bootstrap.cc:492] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:13.929426  4127 tablet_bootstrap.cc:492] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:13.930033  4127 ts_tablet_manager.cc:1403] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.009s
I20260709 12:13:13.933578  4127 raft_consensus.cc:359] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:13.934633  4127 raft_consensus.cc:740] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:13.935734  4127 consensus_queue.cc:260] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:13.938930  4127 ts_tablet_manager.cc:1434] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:13.941232  3278 tablet_copy_service.cc:342] P 1ef05c9d901046dca7fe0e638cc693b9: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-a10fd7fda53e4a8ea272336588c66980 received from {username='slave'} at 127.0.0.1:40120
I20260709 12:13:13.941677  3278 tablet_copy_service.cc:434] P 1ef05c9d901046dca7fe0e638cc693b9: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-a10fd7fda53e4a8ea272336588c66980 on tablet a10fd7fda53e4a8ea272336588c66980 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:14.056162  3932 raft_consensus.cc:1217] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:14.197098  3932 raft_consensus.cc:1217] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:14.215701  3932 raft_consensus.cc:1217] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:14.266189  4132 raft_consensus.cc:1064] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:14.269696  4132 consensus_queue.cc:237] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:14.278326  3932 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.278811  3265 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.279094  3188 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.280512  4132 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.281774  3984 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.283126  4097 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.302596  4097 raft_consensus.cc:2955] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.305601  3932 raft_consensus.cc:2955] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.322691  3265 raft_consensus.cc:2955] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.336961  3086 catalog_manager.cc:5697] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.359164  3193 raft_consensus.cc:2955] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.389827  3338 consensus_queue.cc:237] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:14.395124  3932 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.395882  3193 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.396734  4097 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.397697  3984 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.403650  4141 raft_consensus.cc:2955] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.405341  3932 raft_consensus.cc:2955] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.421941  3090 catalog_manager.cc:5697] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.418926  3193 raft_consensus.cc:2955] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.434841  3250 tablet_service.cc:1558] Processing DeleteTablet for tablet acb4310417b348518d7accdf0538e249 with delete_type TABLET_DATA_TOMBSTONED (TS 1ef05c9d901046dca7fe0e638cc693b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:14.436844  4145 tablet_replica.cc:333] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:13:14.437497  3076 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet acb4310417b348518d7accdf0538e249 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:14.454226  4145 raft_consensus.cc:2243] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:14.454975  4145 raft_consensus.cc:2272] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:14.459364  4145 ts_tablet_manager.cc:1916] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:14.480007  4145 ts_tablet_manager.cc:1929] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:14.480429  4145 log.cc:1199] T acb4310417b348518d7accdf0538e249 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/wals/acb4310417b348518d7accdf0538e249
I20260709 12:13:14.482190  3075 catalog_manager.cc:5028] TS 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): tablet acb4310417b348518d7accdf0538e249 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:14.527209  4144 raft_consensus.cc:1064] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:14.529994  4144 consensus_queue.cc:237] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:14.537014  3263 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.537567  3932 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.538347  3984 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.539446  4141 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.541190  3193 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.547789  3984 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.552644  4141 raft_consensus.cc:2955] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.560708  3265 raft_consensus.cc:2955] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.568070  3932 raft_consensus.cc:2955] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.580056  4008 raft_consensus.cc:1064] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:14.582788  4008 consensus_queue.cc:237] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:14.584833  3090 catalog_manager.cc:5697] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.610121  4130 raft_consensus.cc:1064] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:14.613607  4130 consensus_queue.cc:237] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:14.659404  3931 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.663012  3339 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.665115  4094 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.668218  4094 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.704447  4094 raft_consensus.cc:2955] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.707193  3931 raft_consensus.cc:2955] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.709378  3265 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.750340  3932 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.752950  4117 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.759549  3338 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:13:14.761608  4153 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:13:14.763296  4130 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.785597  3086 catalog_manager.cc:5697] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:13:14.796375  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 55283.4us
I20260709 12:13:14.786836  3339 consensus_queue.cc:237] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:14.770210  3188 raft_consensus.cc:2955] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.814100  4158 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.831205  3931 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.834434  3984 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.836371  3193 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.843034  4097 raft_consensus.cc:2955] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.847517  3335 raft_consensus.cc:2955] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.852715  3931 raft_consensus.cc:2955] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.860576  4130 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.870460  4096 raft_consensus.cc:2955] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.879817  3338 raft_consensus.cc:2955] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.884725  3932 raft_consensus.cc:2955] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.892215  3090 catalog_manager.cc:5697] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.902654  3076 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa54c541b3454731ad51d4012eb0ad72 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:14.912375  3191 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.914350  3263 consensus_queue.cc:237] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:14.916556  3087 catalog_manager.cc:5697] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.913511  3265 raft_consensus.cc:2955] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.923321  3984 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.931327  3191 raft_consensus.cc:2955] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.939985  3931 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.943938  3250 tablet_service.cc:1558] Processing DeleteTablet for tablet aa54c541b3454731ad51d4012eb0ad72 with delete_type TABLET_DATA_TOMBSTONED (TS 1ef05c9d901046dca7fe0e638cc693b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:14.945036  4145 tablet_replica.cc:333] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:13:14.946168  4145 raft_consensus.cc:2243] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:14.946915  4145 raft_consensus.cc:2272] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:14.952652  4145 ts_tablet_manager.cc:1916] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:14.957847  4130 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.961474  3339 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.967377  4096 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.974269  4145 ts_tablet_manager.cc:1929] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:14.974762  4145 log.cc:1199] T aa54c541b3454731ad51d4012eb0ad72 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/wals/aa54c541b3454731ad51d4012eb0ad72
I20260709 12:13:14.977339  3075 catalog_manager.cc:5028] TS 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): tablet aa54c541b3454731ad51d4012eb0ad72 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:14.976400  4159 raft_consensus.cc:2955] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.982250  3932 raft_consensus.cc:2955] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.986603  3339 raft_consensus.cc:2955] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:14.989455  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a10fd7fda53e4a8ea272336588c66980 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:15.008949  3088 catalog_manager.cc:5697] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:15.019596  3182 tablet_service.cc:1558] Processing DeleteTablet for tablet a10fd7fda53e4a8ea272336588c66980 with delete_type TABLET_DATA_TOMBSTONED (TS 7ac63b674f204bc4805ab989f8c965d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40488
I20260709 12:13:15.030906  4166 tablet_replica.cc:333] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:13:15.032094  4166 raft_consensus.cc:2243] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:15.032567  4166 pending_rounds.cc:70] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3: Trying to abort 1 pending ops.
I20260709 12:13:15.032833  4166 pending_rounds.cc:77] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305622301130047488 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "a10fd7fda53e4a8ea272336588c66980" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } } }
I20260709 12:13:15.033776  4166 raft_consensus.cc:2917] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:13:15.034121  4166 raft_consensus.cc:2889] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:13:15.034417  4166 raft_consensus.cc:2272] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:15.037513  4166 ts_tablet_manager.cc:1916] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:15.053422  4166 ts_tablet_manager.cc:1929] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:15.053956  4166 log.cc:1199] T a10fd7fda53e4a8ea272336588c66980 P 7ac63b674f204bc4805ab989f8c965d3: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/wals/a10fd7fda53e4a8ea272336588c66980
I20260709 12:13:15.055711  3075 catalog_manager.cc:5028] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): tablet a10fd7fda53e4a8ea272336588c66980 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:15.328150  3193 consensus_queue.cc:237] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:15.333179  3263 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:15.333879  3932 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:15.335130  4164 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:15.335944  4157 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:15.342965  4094 raft_consensus.cc:2955] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:15.344894  3932 raft_consensus.cc:2955] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:15.353189  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4338ede94a794c41ba16cba6ac585f9a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:15.357856  3265 raft_consensus.cc:2955] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:15.364516  3088 catalog_manager.cc:5697] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:15.382800  3328 tablet_service.cc:1558] Processing DeleteTablet for tablet 4338ede94a794c41ba16cba6ac585f9a with delete_type TABLET_DATA_TOMBSTONED (TS eb49d92feeb14382b3baa49d696b6141 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:15.384501  4167 tablet_replica.cc:333] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:13:15.392359  4167 raft_consensus.cc:2243] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:15.393064  4167 raft_consensus.cc:2272] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:15.396224  4167 ts_tablet_manager.cc:1916] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:15.410342  4167 ts_tablet_manager.cc:1929] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:15.410815  4167 log.cc:1199] T 4338ede94a794c41ba16cba6ac585f9a P eb49d92feeb14382b3baa49d696b6141: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/wals/4338ede94a794c41ba16cba6ac585f9a
I20260709 12:13:15.412549  3076 catalog_manager.cc:5028] TS eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): tablet 4338ede94a794c41ba16cba6ac585f9a (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:16.457186  3191 consensus_queue.cc:237] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:16.463305  3263 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.463713  3339 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:16.464672  3157 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c85f3b72388e43eb9b3f81e8f5ba7385. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.465580  4164 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.466488  4158 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.474656  4172 raft_consensus.cc:2955] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:16.476284  3339 raft_consensus.cc:2955] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:16.477144  3263 raft_consensus.cc:2955] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:16.492347  3087 catalog_manager.cc:5697] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.495556  3263 consensus_queue.cc:237] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:16.514972  3338 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.515233  3191 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.516410  4130 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.517379  4170 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:16.518373  3232 consensus_peers.cc:597] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a33bf1d7b914771971f31da16c86c31. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.526903  4170 raft_consensus.cc:2955] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:16.541350  3193 raft_consensus.cc:2955] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:16.574523  3193 consensus_queue.cc:237] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:16.584239  3338 raft_consensus.cc:2955] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:16.598213  3339 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.598860  3263 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:16.599931  3157 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8939008df61a42b5ab6d01a5cc782e16. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.600389  4172 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.608328  4158 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.609498  3089 catalog_manager.cc:5697] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.623140  4172 raft_consensus.cc:2955] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:16.624814  3263 raft_consensus.cc:2955] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:16.648423  3191 consensus_queue.cc:237] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:16.649637  3338 raft_consensus.cc:2955] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:16.669345  3263 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.669131  3087 catalog_manager.cc:5697] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.670552  4158 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.669560  3338 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:16.674834  3157 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ebb8348062364c7c878da1d2999c325b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.677347  4158 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.681450  4172 raft_consensus.cc:2955] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:16.690109  3263 raft_consensus.cc:2955] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:16.693425  3339 raft_consensus.cc:2955] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:16.711191  3088 catalog_manager.cc:5697] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:17.005292  4191 ts_tablet_manager.cc:933] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:17.009250  4192 ts_tablet_manager.cc:933] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:17.009374  4191 tablet_copy_client.cc:323] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.66:38853
I20260709 12:13:17.012091  3278 tablet_copy_service.cc:140] P 1ef05c9d901046dca7fe0e638cc693b9: Received BeginTabletCopySession request for tablet 5a33bf1d7b914771971f31da16c86c31 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:40120)
I20260709 12:13:17.012662  3278 tablet_copy_service.cc:161] P 1ef05c9d901046dca7fe0e638cc693b9: Beginning new tablet copy session on tablet 5a33bf1d7b914771971f31da16c86c31 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:40120: session id = 6f0cdd57c5934921829c205d32b2b8a5-5a33bf1d7b914771971f31da16c86c31
I20260709 12:13:17.014803  4192 tablet_copy_client.cc:323] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.65:44889
I20260709 12:13:17.017423  3203 tablet_copy_service.cc:140] P 7ac63b674f204bc4805ab989f8c965d3: Received BeginTabletCopySession request for tablet c85f3b72388e43eb9b3f81e8f5ba7385 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:47276)
I20260709 12:13:17.018111  3203 tablet_copy_service.cc:161] P 7ac63b674f204bc4805ab989f8c965d3: Beginning new tablet copy session on tablet c85f3b72388e43eb9b3f81e8f5ba7385 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:47276: session id = 6f0cdd57c5934921829c205d32b2b8a5-c85f3b72388e43eb9b3f81e8f5ba7385
I20260709 12:13:17.019061  4195 ts_tablet_manager.cc:933] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:17.023463  3278 tablet_copy_source_session.cc:215] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:17.025549  3203 tablet_copy_source_session.cc:215] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:17.030268  4191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a33bf1d7b914771971f31da16c86c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:17.034715  4192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85f3b72388e43eb9b3f81e8f5ba7385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:17.055214  4192 tablet_copy_client.cc:806] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:17.055904  4192 tablet_copy_client.cc:670] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:17.059451  4195 tablet_copy_client.cc:323] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.65:44889
I20260709 12:13:17.060640  4192 tablet_copy_client.cc:538] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:17.063243  3203 tablet_copy_service.cc:140] P 7ac63b674f204bc4805ab989f8c965d3: Received BeginTabletCopySession request for tablet 8939008df61a42b5ab6d01a5cc782e16 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:47276)
I20260709 12:13:17.063818  3203 tablet_copy_service.cc:161] P 7ac63b674f204bc4805ab989f8c965d3: Beginning new tablet copy session on tablet 8939008df61a42b5ab6d01a5cc782e16 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:47276: session id = 6f0cdd57c5934921829c205d32b2b8a5-8939008df61a42b5ab6d01a5cc782e16
I20260709 12:13:17.069927  4192 tablet_bootstrap.cc:492] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:17.071664  3203 tablet_copy_source_session.cc:215] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:17.075073  4195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8939008df61a42b5ab6d01a5cc782e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:17.075810  4191 tablet_copy_client.cc:806] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:17.077719  4191 tablet_copy_client.cc:670] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:17.083678  4191 tablet_copy_client.cc:538] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:17.094159  4195 tablet_copy_client.cc:806] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:17.095789  4195 tablet_copy_client.cc:670] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:17.097985  4192 tablet_bootstrap.cc:492] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.098517  4191 tablet_bootstrap.cc:492] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:17.099476  4192 tablet_bootstrap.cc:492] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:17.099648  4195 tablet_copy_client.cc:538] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:17.102183  4192 ts_tablet_manager.cc:1403] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.032s	user 0.024s	sys 0.000s
I20260709 12:13:17.109297  4192 raft_consensus.cc:359] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:17.110206  4192 raft_consensus.cc:740] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:17.110953  4192 consensus_queue.cc:260] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:17.117966  4195 tablet_bootstrap.cc:492] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:17.123576  4192 ts_tablet_manager.cc:1434] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.008s
I20260709 12:13:17.129640  3203 tablet_copy_service.cc:342] P 7ac63b674f204bc4805ab989f8c965d3: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-c85f3b72388e43eb9b3f81e8f5ba7385 received from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:17.130143  3203 tablet_copy_service.cc:434] P 7ac63b674f204bc4805ab989f8c965d3: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-c85f3b72388e43eb9b3f81e8f5ba7385 on tablet c85f3b72388e43eb9b3f81e8f5ba7385 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:17.133998  4191 tablet_bootstrap.cc:492] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.134938  4191 tablet_bootstrap.cc:492] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:17.135743  4191 ts_tablet_manager.cc:1403] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.018s
I20260709 12:13:17.139662  4191 raft_consensus.cc:359] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:17.140563  4191 raft_consensus.cc:740] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:17.141247  4191 consensus_queue.cc:260] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:17.143688  4191 ts_tablet_manager.cc:1434] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:17.145702  3278 tablet_copy_service.cc:342] P 1ef05c9d901046dca7fe0e638cc693b9: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-5a33bf1d7b914771971f31da16c86c31 received from {username='slave'} at 127.0.0.1:40120
I20260709 12:13:17.146104  3278 tablet_copy_service.cc:434] P 1ef05c9d901046dca7fe0e638cc693b9: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-5a33bf1d7b914771971f31da16c86c31 on tablet 5a33bf1d7b914771971f31da16c86c31 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:17.166460  4195 tablet_bootstrap.cc:492] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.167603  4195 tablet_bootstrap.cc:492] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:17.168397  4195 ts_tablet_manager.cc:1403] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.008s
I20260709 12:13:17.171200  4195 raft_consensus.cc:359] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:17.171873  4195 raft_consensus.cc:740] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:17.172456  4195 consensus_queue.cc:260] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:17.174933  4195 ts_tablet_manager.cc:1434] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:13:17.176883  3203 tablet_copy_service.cc:342] P 7ac63b674f204bc4805ab989f8c965d3: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-8939008df61a42b5ab6d01a5cc782e16 received from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:17.177299  3203 tablet_copy_service.cc:434] P 7ac63b674f204bc4805ab989f8c965d3: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-8939008df61a42b5ab6d01a5cc782e16 on tablet 8939008df61a42b5ab6d01a5cc782e16 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:17.283515  4195 ts_tablet_manager.cc:933] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:17.285331  4195 tablet_copy_client.cc:323] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.65:44889
I20260709 12:13:17.286912  3203 tablet_copy_service.cc:140] P 7ac63b674f204bc4805ab989f8c965d3: Received BeginTabletCopySession request for tablet ebb8348062364c7c878da1d2999c325b from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:47276)
I20260709 12:13:17.287393  3203 tablet_copy_service.cc:161] P 7ac63b674f204bc4805ab989f8c965d3: Beginning new tablet copy session on tablet ebb8348062364c7c878da1d2999c325b from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:47276: session id = 6f0cdd57c5934921829c205d32b2b8a5-ebb8348062364c7c878da1d2999c325b
I20260709 12:13:17.293502  3203 tablet_copy_source_session.cc:215] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:17.296350  4195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb8348062364c7c878da1d2999c325b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:17.314713  4195 tablet_copy_client.cc:806] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:17.315343  4195 tablet_copy_client.cc:670] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:17.319712  4195 tablet_copy_client.cc:538] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:17.327999  4195 tablet_bootstrap.cc:492] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:17.346151  4195 tablet_bootstrap.cc:492] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.346846  4195 tablet_bootstrap.cc:492] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:17.347805  4195 ts_tablet_manager.cc:1403] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 12:13:17.350062  4195 raft_consensus.cc:359] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:17.350688  4195 raft_consensus.cc:740] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:17.351187  4195 consensus_queue.cc:260] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:17.353626  4195 ts_tablet_manager.cc:1434] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:17.355767  3203 tablet_copy_service.cc:342] P 7ac63b674f204bc4805ab989f8c965d3: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-ebb8348062364c7c878da1d2999c325b received from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:17.356240  3203 tablet_copy_service.cc:434] P 7ac63b674f204bc4805ab989f8c965d3: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-ebb8348062364c7c878da1d2999c325b on tablet ebb8348062364c7c878da1d2999c325b with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:17.438784  3931 raft_consensus.cc:1217] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:17.453078  3931 raft_consensus.cc:1217] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:17.517844  3931 raft_consensus.cc:1217] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:13:17.886360  3932 raft_consensus.cc:1217] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:17.910197  4203 raft_consensus.cc:1064] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:17.912726  4203 consensus_queue.cc:237] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:17.926571  3931 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:17.928208  3265 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:17.929036  3338 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:17.931051  4203 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:17.932085  4172 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:17.933775  4164 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:17.945533  4164 raft_consensus.cc:2955] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:17.947985  3265 raft_consensus.cc:2955] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:17.952478  3932 raft_consensus.cc:2955] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:17.969022  3338 raft_consensus.cc:2955] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:17.969673  3087 catalog_manager.cc:5697] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:17.991490  4180 raft_consensus.cc:1064] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:18.007216  4203 raft_consensus.cc:1064] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:18.010362  4203 consensus_queue.cc:237] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:18.001592  4180 consensus_queue.cc:237] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:18.037545  3932 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.040772  3338 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.042613  3932 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.044818  3191 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.045320  4213 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:18.046754  4203 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.048465  4215 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.049412  4164 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.059535  3262 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.061134  3338 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.063527  4180 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.074415  3191 consensus_queue.cc:237] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:18.079704  3930 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:18.084019  4164 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.088532  4164 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.090817  3263 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:18.089911  4179 raft_consensus.cc:2955] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.099931  4172 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.099294  3188 raft_consensus.cc:2955] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.104276  3930 raft_consensus.cc:2955] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.123739  3088 catalog_manager.cc:5697] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.139714  4158 raft_consensus.cc:2955] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.140627  4172 raft_consensus.cc:2955] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.146250  3931 raft_consensus.cc:2955] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.147882  3930 raft_consensus.cc:2955] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.188897  3336 raft_consensus.cc:2955] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.193394  3265 raft_consensus.cc:2955] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.200462  3089 catalog_manager.cc:5697] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.211192  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8939008df61a42b5ab6d01a5cc782e16 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:18.233515  3262 consensus_queue.cc:237] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:18.234619  3338 raft_consensus.cc:2955] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.241400  3930 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.243065  4213 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.235014  3088 catalog_manager.cc:5697] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.254186  4215 raft_consensus.cc:2955] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.255822  3930 raft_consensus.cc:2955] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:13:18.264935  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 74587.5us
I20260709 12:13:18.280385  3265 raft_consensus.cc:2955] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.301440  3088 catalog_manager.cc:5697] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.313359  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5a33bf1d7b914771971f31da16c86c31 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:13:18.315822  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 67100.6us
I20260709 12:13:18.327353  3182 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a33bf1d7b914771971f31da16c86c31 with delete_type TABLET_DATA_TOMBSTONED (TS 7ac63b674f204bc4805ab989f8c965d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40488
I20260709 12:13:18.327231  3191 consensus_queue.cc:237] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:18.336254  3328 tablet_service.cc:1558] Processing DeleteTablet for tablet 8939008df61a42b5ab6d01a5cc782e16 with delete_type TABLET_DATA_TOMBSTONED (TS eb49d92feeb14382b3baa49d696b6141 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:18.336901  3338 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.339756  4213 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.341192  4231 tablet_replica.cc:333] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:13:18.342393  4231 raft_consensus.cc:2243] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.343086  4231 raft_consensus.cc:2272] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.347561  4231 ts_tablet_manager.cc:1916] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:18.354835  3336 raft_consensus.cc:2955] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.354939  4230 tablet_replica.cc:333] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:13:18.360395  3339 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.363404  4226 raft_consensus.cc:1064] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:18.361171  3930 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.371711  4226 consensus_queue.cc:237] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:18.358527  4230 raft_consensus.cc:2243] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.380185  4225 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:18.382997  4223 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.383472  3930 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.385375  4224 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:18.386087  4230 raft_consensus.cc:2272] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.393396  4230 ts_tablet_manager.cc:1916] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:18.394083  3265 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.395752  4203 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.400276  4231 ts_tablet_manager.cc:1929] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:13:18.400828  4231 log.cc:1199] T 8939008df61a42b5ab6d01a5cc782e16 P eb49d92feeb14382b3baa49d696b6141: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/wals/8939008df61a42b5ab6d01a5cc782e16
I20260709 12:13:18.402700  3336 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.404491  3076 catalog_manager.cc:5028] TS eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): tablet 8939008df61a42b5ab6d01a5cc782e16 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:18.408764  4226 raft_consensus.cc:2955] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.412290  4224 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:18.415807  3336 raft_consensus.cc:2955] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.422946  3931 raft_consensus.cc:2955] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.428982  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c85f3b72388e43eb9b3f81e8f5ba7385 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:18.435734  3089 catalog_manager.cc:5697] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.482251  3250 tablet_service.cc:1558] Processing DeleteTablet for tablet c85f3b72388e43eb9b3f81e8f5ba7385 with delete_type TABLET_DATA_TOMBSTONED (TS 1ef05c9d901046dca7fe0e638cc693b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:18.501557  4230 ts_tablet_manager.cc:1929] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:18.502063  4230 log.cc:1199] T 5a33bf1d7b914771971f31da16c86c31 P 7ac63b674f204bc4805ab989f8c965d3: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/wals/5a33bf1d7b914771971f31da16c86c31
I20260709 12:13:18.505735  4203 raft_consensus.cc:2955] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.507364  3075 catalog_manager.cc:5028] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): tablet 5a33bf1d7b914771971f31da16c86c31 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:18.507201  3339 raft_consensus.cc:2955] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.513512  3265 raft_consensus.cc:2955] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.525264  4236 tablet_replica.cc:333] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:13:18.526787  4236 raft_consensus.cc:2243] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.528486  4236 raft_consensus.cc:2272] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.525295  3090 catalog_manager.cc:5697] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.528803  3931 raft_consensus.cc:2955] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.533140  4236 ts_tablet_manager.cc:1916] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:18.555995  4236 ts_tablet_manager.cc:1929] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:18.556455  4236 log.cc:1199] T c85f3b72388e43eb9b3f81e8f5ba7385 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/wals/c85f3b72388e43eb9b3f81e8f5ba7385
I20260709 12:13:18.558375  3075 catalog_manager.cc:5028] TS 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): tablet c85f3b72388e43eb9b3f81e8f5ba7385 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:18.563192  3191 consensus_queue.cc:237] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:18.570797  3265 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.571375  3931 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.573146  4226 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.575415  4226 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.583990  4224 raft_consensus.cc:2955] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.588677  3262 raft_consensus.cc:2955] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.589416  3931 raft_consensus.cc:2955] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.604883  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ebb8348062364c7c878da1d2999c325b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:18.605897  3090 catalog_manager.cc:5697] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:18.620090  3328 tablet_service.cc:1558] Processing DeleteTablet for tablet ebb8348062364c7c878da1d2999c325b with delete_type TABLET_DATA_TOMBSTONED (TS eb49d92feeb14382b3baa49d696b6141 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:18.621129  4231 tablet_replica.cc:333] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:13:18.622222  4231 raft_consensus.cc:2243] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.622882  4231 raft_consensus.cc:2272] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.626998  4231 ts_tablet_manager.cc:1916] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:18.643111  4231 ts_tablet_manager.cc:1929] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:18.643548  4231 log.cc:1199] T ebb8348062364c7c878da1d2999c325b P eb49d92feeb14382b3baa49d696b6141: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/wals/ebb8348062364c7c878da1d2999c325b
I20260709 12:13:18.645162  3076 catalog_manager.cc:5028] TS eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): tablet ebb8348062364c7c878da1d2999c325b (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
W20260709 12:13:19.690587  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 60811.9us
I20260709 12:13:19.818440  3333 consensus_queue.cc:237] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:19.824476  3262 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:19.824911  3191 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:19.825305  3306 consensus_peers.cc:597] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 53307990662b42ecae5100eb9bdb80b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:19.826156  4228 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:19.827102  4241 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.835687  4241 raft_consensus.cc:2955] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:19.837790  3191 raft_consensus.cc:2955] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:19.850479  3262 raft_consensus.cc:2955] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:19.853760  3192 consensus_queue.cc:237] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:19.863608  3088 catalog_manager.cc:5697] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.870836  3262 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:19.873121  4244 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:19.873517  3333 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:19.875450  4242 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:19.876356  3157 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21406a1677884f049da5c65f8f2ed5ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:19.887514  4242 raft_consensus.cc:2955] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:19.891649  3333 raft_consensus.cc:2955] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:19.891773  3262 raft_consensus.cc:2955] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:19.906253  3192 consensus_queue.cc:237] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:19.916035  3089 catalog_manager.cc:5697] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:19.929790  3333 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:19.930379  3262 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:19.931727  4203 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:19.932919  4242 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:19.937870  3157 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ee459e79aec45909d356d039c69e72c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:19.950655  4203 raft_consensus.cc:2955] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:19.961299  3262 raft_consensus.cc:2955] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:19.963572  3333 raft_consensus.cc:2955] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:19.970654  3265 consensus_queue.cc:237] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:19.977278  3088 catalog_manager.cc:5697] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.988785  3338 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:19.992076  4243 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:19.994972  3232 consensus_peers.cc:597] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 214d209d2c0940c1a4c43e368fff9e23. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:20.001003  3191 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:20.004958  4179 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:20.040401  4245 raft_consensus.cc:2955] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:20.041765  3192 raft_consensus.cc:2955] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:20.047816  3333 raft_consensus.cc:2955] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:20.065389  3088 catalog_manager.cc:5697] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:20.328805  4262 ts_tablet_manager.cc:933] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:20.331943  4262 tablet_copy_client.cc:323] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.65:44889
I20260709 12:13:20.334565  3203 tablet_copy_service.cc:140] P 7ac63b674f204bc4805ab989f8c965d3: Received BeginTabletCopySession request for tablet 21406a1677884f049da5c65f8f2ed5ff from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:47276)
I20260709 12:13:20.335168  3203 tablet_copy_service.cc:161] P 7ac63b674f204bc4805ab989f8c965d3: Beginning new tablet copy session on tablet 21406a1677884f049da5c65f8f2ed5ff from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:47276: session id = 6f0cdd57c5934921829c205d32b2b8a5-21406a1677884f049da5c65f8f2ed5ff
I20260709 12:13:20.342196  3203 tablet_copy_source_session.cc:215] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:20.345362  4262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21406a1677884f049da5c65f8f2ed5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:20.369091  4262 tablet_copy_client.cc:806] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:20.369783  4262 tablet_copy_client.cc:670] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:20.374249  4262 tablet_copy_client.cc:538] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:20.384756  4262 tablet_bootstrap.cc:492] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:20.402876  4264 ts_tablet_manager.cc:933] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:20.405036  4264 tablet_copy_client.cc:323] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.67:35301
I20260709 12:13:20.407109  3352 tablet_copy_service.cc:140] P eb49d92feeb14382b3baa49d696b6141: Received BeginTabletCopySession request for tablet 53307990662b42ecae5100eb9bdb80b6 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:52822)
I20260709 12:13:20.407752  3352 tablet_copy_service.cc:161] P eb49d92feeb14382b3baa49d696b6141: Beginning new tablet copy session on tablet 53307990662b42ecae5100eb9bdb80b6 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:52822: session id = 6f0cdd57c5934921829c205d32b2b8a5-53307990662b42ecae5100eb9bdb80b6
I20260709 12:13:20.413038  4262 tablet_bootstrap.cc:492] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:20.414089  4262 tablet_bootstrap.cc:492] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:20.414860  4262 ts_tablet_manager.cc:1403] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.005s
I20260709 12:13:20.422272  4262 raft_consensus.cc:359] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:20.423264  4262 raft_consensus.cc:740] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:20.424003  4262 consensus_queue.cc:260] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:20.428308  3352 tablet_copy_source_session.cc:215] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:20.428869  4267 ts_tablet_manager.cc:933] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:20.432446  4264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53307990662b42ecae5100eb9bdb80b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:20.440644  4267 tablet_copy_client.cc:323] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.65:44889
I20260709 12:13:20.442159  4262 ts_tablet_manager.cc:1434] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.007s
I20260709 12:13:20.442925  3203 tablet_copy_service.cc:140] P 7ac63b674f204bc4805ab989f8c965d3: Received BeginTabletCopySession request for tablet 9ee459e79aec45909d356d039c69e72c from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:47276)
I20260709 12:13:20.443540  3203 tablet_copy_service.cc:161] P 7ac63b674f204bc4805ab989f8c965d3: Beginning new tablet copy session on tablet 9ee459e79aec45909d356d039c69e72c from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:47276: session id = 6f0cdd57c5934921829c205d32b2b8a5-9ee459e79aec45909d356d039c69e72c
I20260709 12:13:20.450163  3202 tablet_copy_service.cc:342] P 7ac63b674f204bc4805ab989f8c965d3: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-21406a1677884f049da5c65f8f2ed5ff received from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:20.450696  3202 tablet_copy_service.cc:434] P 7ac63b674f204bc4805ab989f8c965d3: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-21406a1677884f049da5c65f8f2ed5ff on tablet 21406a1677884f049da5c65f8f2ed5ff with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:20.453537  4264 tablet_copy_client.cc:806] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:20.454625  4264 tablet_copy_client.cc:670] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:20.471071  3203 tablet_copy_source_session.cc:215] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:20.472633  4264 tablet_copy_client.cc:538] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:20.474814  4267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee459e79aec45909d356d039c69e72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:20.485502  4264 tablet_bootstrap.cc:492] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:20.491828  4267 tablet_copy_client.cc:806] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:20.492447  4267 tablet_copy_client.cc:670] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:20.497193  4267 tablet_copy_client.cc:538] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:20.512060  4267 tablet_bootstrap.cc:492] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:20.535456  4264 tablet_bootstrap.cc:492] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:20.536522  4264 tablet_bootstrap.cc:492] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:20.537206  4264 ts_tablet_manager.cc:1403] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.010s
I20260709 12:13:20.538722  4267 tablet_bootstrap.cc:492] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:20.539670  4267 tablet_bootstrap.cc:492] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:20.540349  4267 ts_tablet_manager.cc:1403] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.007s
I20260709 12:13:20.540446  4264 raft_consensus.cc:359] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:20.541337  4264 raft_consensus.cc:740] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:20.542004  4264 consensus_queue.cc:260] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:20.544893  4264 ts_tablet_manager.cc:1434] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:13:20.546896  3352 tablet_copy_service.cc:342] P eb49d92feeb14382b3baa49d696b6141: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-53307990662b42ecae5100eb9bdb80b6 received from {username='slave'} at 127.0.0.1:52822
I20260709 12:13:20.547377  3352 tablet_copy_service.cc:434] P eb49d92feeb14382b3baa49d696b6141: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-53307990662b42ecae5100eb9bdb80b6 on tablet 53307990662b42ecae5100eb9bdb80b6 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:20.546988  4267 raft_consensus.cc:359] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:20.547923  4267 raft_consensus.cc:740] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:20.550554  4267 consensus_queue.cc:260] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:20.556851  4267 ts_tablet_manager.cc:1434] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:13:20.560451  4264 ts_tablet_manager.cc:933] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:20.563494  3203 tablet_copy_service.cc:342] P 7ac63b674f204bc4805ab989f8c965d3: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-9ee459e79aec45909d356d039c69e72c received from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:20.563931  3203 tablet_copy_service.cc:434] P 7ac63b674f204bc4805ab989f8c965d3: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-9ee459e79aec45909d356d039c69e72c on tablet 9ee459e79aec45909d356d039c69e72c with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:20.591936  4264 tablet_copy_client.cc:323] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.66:38853
I20260709 12:13:20.593941  3278 tablet_copy_service.cc:140] P 1ef05c9d901046dca7fe0e638cc693b9: Received BeginTabletCopySession request for tablet 214d209d2c0940c1a4c43e368fff9e23 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:40120)
I20260709 12:13:20.594548  3278 tablet_copy_service.cc:161] P 1ef05c9d901046dca7fe0e638cc693b9: Beginning new tablet copy session on tablet 214d209d2c0940c1a4c43e368fff9e23 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:40120: session id = 6f0cdd57c5934921829c205d32b2b8a5-214d209d2c0940c1a4c43e368fff9e23
I20260709 12:13:20.602254  3278 tablet_copy_source_session.cc:215] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:20.606279  4264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214d209d2c0940c1a4c43e368fff9e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:20.626639  4264 tablet_copy_client.cc:806] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:20.627252  4264 tablet_copy_client.cc:670] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:20.631283  4264 tablet_copy_client.cc:538] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:20.641485  4264 tablet_bootstrap.cc:492] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:20.662496  4264 tablet_bootstrap.cc:492] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:20.663420  4264 tablet_bootstrap.cc:492] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:20.664116  4264 ts_tablet_manager.cc:1403] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.008s
I20260709 12:13:20.667100  4264 raft_consensus.cc:359] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:20.668035  4264 raft_consensus.cc:740] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:20.668682  4264 consensus_queue.cc:260] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:20.672124  4264 ts_tablet_manager.cc:1434] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:13:20.676019  3278 tablet_copy_service.cc:342] P 1ef05c9d901046dca7fe0e638cc693b9: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-214d209d2c0940c1a4c43e368fff9e23 received from {username='slave'} at 127.0.0.1:40120
I20260709 12:13:20.676471  3278 tablet_copy_service.cc:434] P 1ef05c9d901046dca7fe0e638cc693b9: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-214d209d2c0940c1a4c43e368fff9e23 on tablet 214d209d2c0940c1a4c43e368fff9e23 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:20.841195  3930 raft_consensus.cc:1217] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:20.891757  3930 raft_consensus.cc:1217] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:20.934626  3930 raft_consensus.cc:1217] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:21.147655  3930 raft_consensus.cc:1217] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:21.230945  4242 raft_consensus.cc:1064] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:21.234822  4242 consensus_queue.cc:237] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:21.242295  3930 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.243029  3339 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.244233  4226 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:21.245815  4242 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:21.248965  3265 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.251137  4226 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:21.266481  4242 raft_consensus.cc:2955] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.269733  3265 raft_consensus.cc:2955] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.271404  3339 raft_consensus.cc:2955] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.292063  3088 catalog_manager.cc:5697] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.313870  4141 raft_consensus.cc:1064] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:21.316674  4141 consensus_queue.cc:237] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:21.335168  3930 raft_consensus.cc:2955] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:13:21.343756  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 44908.8us
I20260709 12:13:21.349570  3191 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.356590  3265 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.401648  3931 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.415113  4281 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:21.438773  4228 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:21.441689  4278 raft_consensus.cc:1064] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:21.448541  4278 consensus_queue.cc:237] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:21.487150  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 74371.3us
I20260709 12:13:21.489233  4283 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:21.621996  4243 raft_consensus.cc:1064] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:21.622093  3188 raft_consensus.cc:2955] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.626580  3263 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.631996  3931 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.634195  4296 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:21.637364  3265 raft_consensus.cc:2955] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.639328  4226 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:21.640997  3333 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.644308  4286 raft_consensus.cc:2955] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.632354  4243 consensus_queue.cc:237] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:21.683560  3932 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.685993  4289 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:21.700601  3333 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.702306  4215 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:21.706741  3191 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.712255  4296 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:21.712317  4215 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:21.713485  3929 raft_consensus.cc:2955] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.733732  3089 catalog_manager.cc:5697] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.740748  3192 consensus_queue.cc:237] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:21.781945  3929 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:21.785665  3265 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:21.787695  4278 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:21.805194  4278 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:21.808759  4296 raft_consensus.cc:2955] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.816094  4203 raft_consensus.cc:2955] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.817164  3339 raft_consensus.cc:2955] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.818073  3262 raft_consensus.cc:2955] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:13:21.825014  4300 log.cc:927] Time spent T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:13:21.826391  4215 raft_consensus.cc:2955] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.828158  3263 raft_consensus.cc:2955] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.843853  3932 raft_consensus.cc:2955] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.847162  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9ee459e79aec45909d356d039c69e72c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:21.847855  3931 raft_consensus.cc:2955] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.866544  3929 raft_consensus.cc:2955] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.869598  3087 catalog_manager.cc:5697] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.886406  3335 raft_consensus.cc:2955] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.897989  3090 catalog_manager.cc:5697] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.904908  3328 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ee459e79aec45909d356d039c69e72c with delete_type TABLET_DATA_TOMBSTONED (TS eb49d92feeb14382b3baa49d696b6141 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:21.912142  3339 consensus_queue.cc:237] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:21.914415  3075 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 9ee459e79aec45909d356d039c69e72c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:13:21.926378  3932 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:21.917798  3191 raft_consensus.cc:2955] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.941896  3188 consensus_queue.cc:237] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:21.944022  4286 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:21.933982  3090 catalog_manager.cc:5697] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.936753  3262 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:21.929653  4305 tablet_replica.cc:333] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:13:21.949652  4305 raft_consensus.cc:2243] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.953400  4305 raft_consensus.cc:2272] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.952870  4281 raft_consensus.cc:2955] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.955143  4241 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:21.954674  3931 raft_consensus.cc:2955] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.958657  4305 ts_tablet_manager.cc:1916] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:21.968214  3076 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 53307990662b42ecae5100eb9bdb80b6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:21.970119  3929 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:21.970676  3339 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:21.972271  3262 raft_consensus.cc:2955] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.973068  4242 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:21.981909  4242 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:21.984784  4203 raft_consensus.cc:2955] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:21.991003  4305 ts_tablet_manager.cc:1929] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:21.991639  4305 log.cc:1199] T 9ee459e79aec45909d356d039c69e72c P eb49d92feeb14382b3baa49d696b6141: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/wals/9ee459e79aec45909d356d039c69e72c
I20260709 12:13:21.994213  3076 catalog_manager.cc:5028] TS eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): tablet 9ee459e79aec45909d356d039c69e72c (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:22.001492  3089 catalog_manager.cc:5697] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.998565  3263 consensus_queue.cc:237] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:22.008216  3929 raft_consensus.cc:2955] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:22.010134  3339 raft_consensus.cc:2955] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:22.014394  3931 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:22.015833  3336 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:22.015873  4243 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:22.016945  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 21406a1677884f049da5c65f8f2ed5ff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:22.018250  4243 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:22.027654  4289 raft_consensus.cc:2955] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:22.029042  3931 raft_consensus.cc:2955] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:22.027482  3090 catalog_manager.cc:5697] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New cstate: current_term: 1 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:22.040087  3336 raft_consensus.cc:2955] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:22.042326  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 214d209d2c0940c1a4c43e368fff9e23 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:22.052662  3182 tablet_service.cc:1558] Processing DeleteTablet for tablet 53307990662b42ecae5100eb9bdb80b6 with delete_type TABLET_DATA_TOMBSTONED (TS 7ac63b674f204bc4805ab989f8c965d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40488
I20260709 12:13:22.054616  4306 tablet_replica.cc:333] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:13:22.055856  4306 raft_consensus.cc:2243] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.056818  4306 raft_consensus.cc:2272] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.057554  3087 catalog_manager.cc:5697] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:22.060154  4306 ts_tablet_manager.cc:1916] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:22.063174  3250 tablet_service.cc:1558] Processing DeleteTablet for tablet 21406a1677884f049da5c65f8f2ed5ff with delete_type TABLET_DATA_TOMBSTONED (TS 1ef05c9d901046dca7fe0e638cc693b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:22.072549  3182 tablet_service.cc:1558] Processing DeleteTablet for tablet 214d209d2c0940c1a4c43e368fff9e23 with delete_type TABLET_DATA_TOMBSTONED (TS 7ac63b674f204bc4805ab989f8c965d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40488
I20260709 12:13:22.080143  4307 tablet_replica.cc:333] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:13:22.082396  4307 raft_consensus.cc:2243] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.083531  4307 raft_consensus.cc:2272] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.089697  4306 ts_tablet_manager.cc:1929] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:22.090181  4306 log.cc:1199] T 53307990662b42ecae5100eb9bdb80b6 P 7ac63b674f204bc4805ab989f8c965d3: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/wals/53307990662b42ecae5100eb9bdb80b6
I20260709 12:13:22.090919  4307 ts_tablet_manager.cc:1916] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:22.092054  4306 tablet_replica.cc:333] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:13:22.092012  3075 catalog_manager.cc:5028] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): tablet 53307990662b42ecae5100eb9bdb80b6 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:22.093389  4306 raft_consensus.cc:2243] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.094094  4306 raft_consensus.cc:2272] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.098423  4306 ts_tablet_manager.cc:1916] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:22.108613  4307 ts_tablet_manager.cc:1929] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:22.109135  4307 log.cc:1199] T 21406a1677884f049da5c65f8f2ed5ff P 1ef05c9d901046dca7fe0e638cc693b9: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/wals/21406a1677884f049da5c65f8f2ed5ff
I20260709 12:13:22.111606  3075 catalog_manager.cc:5028] TS 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): tablet 21406a1677884f049da5c65f8f2ed5ff (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:22.116943  4306 ts_tablet_manager.cc:1929] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:22.117439  4306 log.cc:1199] T 214d209d2c0940c1a4c43e368fff9e23 P 7ac63b674f204bc4805ab989f8c965d3: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/wals/214d209d2c0940c1a4c43e368fff9e23
I20260709 12:13:22.118981  3075 catalog_manager.cc:5028] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): tablet 214d209d2c0940c1a4c43e368fff9e23 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:23.152035  3339 consensus_queue.cc:237] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:13:23.159241  3306 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d7af9c2d6334c6f84aed4586a66d701. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.159538  3263 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:23.162134  4286 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.162334  3188 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:23.165035  4286 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.182174  4286 raft_consensus.cc:2955] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.188787  3263 raft_consensus.cc:2955] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.189112  3188 raft_consensus.cc:2955] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.206666  3262 consensus_queue.cc:237] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:23.219035  3087 catalog_manager.cc:5697] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:23.228082  3232 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb7809b208b14a549539330993804c34. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.228823  3191 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:23.231590  4292 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.254022  4280 raft_consensus.cc:2955] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.257505  3336 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:23.262863  4243 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.261912  3188 raft_consensus.cc:2955] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.281203  3333 raft_consensus.cc:2955] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.281471  3336 consensus_queue.cc:237] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:23.292341  3262 raft_consensus.cc:1275] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:23.292918  3188 raft_consensus.cc:1275] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:23.295064  3306 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f904cee1d1e04a36bc93a9dcf405d9a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.299893  4281 consensus_queue.cc:1048] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:23.306813  3090 catalog_manager.cc:5697] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:23.308106  4314 consensus_queue.cc:1048] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.332547  3263 raft_consensus.cc:2955] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.330576  4281 raft_consensus.cc:2955] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.337905  3188 raft_consensus.cc:2955] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.351130  3336 consensus_queue.cc:237] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:23.351465  3090 catalog_manager.cc:5697] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.364313  3262 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:23.365036  3306 consensus_peers.cc:597] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7482671d98f47899c1d11f810abadb7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.366300  4281 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.366712  3188 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:23.369828  4286 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.385234  4314 raft_consensus.cc:2955] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.387005  3191 raft_consensus.cc:2955] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.389333  3262 raft_consensus.cc:2955] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.407819  3090 catalog_manager.cc:5697] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:23.646819  4327 ts_tablet_manager.cc:933] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:23.648748  4327 tablet_copy_client.cc:323] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.66:38853
I20260709 12:13:23.650511  3278 tablet_copy_service.cc:140] P 1ef05c9d901046dca7fe0e638cc693b9: Received BeginTabletCopySession request for tablet eb7809b208b14a549539330993804c34 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:40120)
I20260709 12:13:23.651226  3278 tablet_copy_service.cc:161] P 1ef05c9d901046dca7fe0e638cc693b9: Beginning new tablet copy session on tablet eb7809b208b14a549539330993804c34 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:40120: session id = 6f0cdd57c5934921829c205d32b2b8a5-eb7809b208b14a549539330993804c34
I20260709 12:13:23.661239  3278 tablet_copy_source_session.cc:215] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:23.664539  4327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7809b208b14a549539330993804c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.677816  4327 tablet_copy_client.cc:806] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:23.678716  4327 tablet_copy_client.cc:670] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:23.682919  4327 tablet_copy_client.cc:538] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:23.689651  4327 tablet_bootstrap.cc:492] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:23.710672  4327 tablet_bootstrap.cc:492] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.711643  4327 tablet_bootstrap.cc:492] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:23.712320  4327 ts_tablet_manager.cc:1403] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 12:13:23.715497  4327 raft_consensus.cc:359] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:23.716329  4327 raft_consensus.cc:740] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:23.717002  4327 consensus_queue.cc:260] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:23.720264  4327 ts_tablet_manager.cc:1434] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:23.722286  3278 tablet_copy_service.cc:342] P 1ef05c9d901046dca7fe0e638cc693b9: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-eb7809b208b14a549539330993804c34 received from {username='slave'} at 127.0.0.1:40120
I20260709 12:13:23.722711  3278 tablet_copy_service.cc:434] P 1ef05c9d901046dca7fe0e638cc693b9: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-eb7809b208b14a549539330993804c34 on tablet eb7809b208b14a549539330993804c34 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:23.761794  4327 ts_tablet_manager.cc:933] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:23.764115  4327 tablet_copy_client.cc:323] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.67:35301
I20260709 12:13:23.765697  3352 tablet_copy_service.cc:140] P eb49d92feeb14382b3baa49d696b6141: Received BeginTabletCopySession request for tablet 4d7af9c2d6334c6f84aed4586a66d701 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:52822)
I20260709 12:13:23.766242  3352 tablet_copy_service.cc:161] P eb49d92feeb14382b3baa49d696b6141: Beginning new tablet copy session on tablet 4d7af9c2d6334c6f84aed4586a66d701 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:52822: session id = 6f0cdd57c5934921829c205d32b2b8a5-4d7af9c2d6334c6f84aed4586a66d701
I20260709 12:13:23.774855  3352 tablet_copy_source_session.cc:215] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:23.778167  4327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7af9c2d6334c6f84aed4586a66d701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.804958  4327 tablet_copy_client.cc:806] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:23.805625  4327 tablet_copy_client.cc:670] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:23.807025  4332 ts_tablet_manager.cc:933] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:23.809877  4327 tablet_copy_client.cc:538] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:23.818958  4332 tablet_copy_client.cc:323] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.67:35301
I20260709 12:13:23.820487  4327 tablet_bootstrap.cc:492] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:23.820890  3352 tablet_copy_service.cc:140] P eb49d92feeb14382b3baa49d696b6141: Received BeginTabletCopySession request for tablet c7482671d98f47899c1d11f810abadb7 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:52822)
I20260709 12:13:23.821496  3352 tablet_copy_service.cc:161] P eb49d92feeb14382b3baa49d696b6141: Beginning new tablet copy session on tablet c7482671d98f47899c1d11f810abadb7 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:52822: session id = 6f0cdd57c5934921829c205d32b2b8a5-c7482671d98f47899c1d11f810abadb7
I20260709 12:13:23.840248  3352 tablet_copy_source_session.cc:215] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:23.845979  4332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7482671d98f47899c1d11f810abadb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.856874  4327 tablet_bootstrap.cc:492] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.857827  4327 tablet_bootstrap.cc:492] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:23.858500  4327 ts_tablet_manager.cc:1403] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.020s
I20260709 12:13:23.860306  4332 tablet_copy_client.cc:806] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:23.860884  4332 tablet_copy_client.cc:670] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:23.862418  4327 raft_consensus.cc:359] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:23.864898  4327 raft_consensus.cc:740] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:23.866041  4332 tablet_copy_client.cc:538] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:23.866005  4327 consensus_queue.cc:260] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:23.868837  4327 ts_tablet_manager.cc:1434] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:13:23.870461  3352 tablet_copy_service.cc:342] P eb49d92feeb14382b3baa49d696b6141: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-4d7af9c2d6334c6f84aed4586a66d701 received from {username='slave'} at 127.0.0.1:52822
I20260709 12:13:23.870893  3352 tablet_copy_service.cc:434] P eb49d92feeb14382b3baa49d696b6141: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-4d7af9c2d6334c6f84aed4586a66d701 on tablet 4d7af9c2d6334c6f84aed4586a66d701 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:23.876897  4332 tablet_bootstrap.cc:492] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:23.896226  4332 tablet_bootstrap.cc:492] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.897186  4332 tablet_bootstrap.cc:492] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:23.897842  4332 ts_tablet_manager.cc:1403] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:13:23.900815  4332 raft_consensus.cc:359] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:23.901665  4332 raft_consensus.cc:740] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:23.902419  4332 consensus_queue.cc:260] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:23.909927  4332 ts_tablet_manager.cc:1434] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:13:23.911724  3352 tablet_copy_service.cc:342] P eb49d92feeb14382b3baa49d696b6141: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-c7482671d98f47899c1d11f810abadb7 received from {username='slave'} at 127.0.0.1:52822
I20260709 12:13:23.912225  3352 tablet_copy_service.cc:434] P eb49d92feeb14382b3baa49d696b6141: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-c7482671d98f47899c1d11f810abadb7 on tablet c7482671d98f47899c1d11f810abadb7 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:23.917065  4327 ts_tablet_manager.cc:933] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:23.919153  4327 tablet_copy_client.cc:323] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.67:35301
I20260709 12:13:23.920993  3352 tablet_copy_service.cc:140] P eb49d92feeb14382b3baa49d696b6141: Received BeginTabletCopySession request for tablet f904cee1d1e04a36bc93a9dcf405d9a8 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:52822)
I20260709 12:13:23.921491  3352 tablet_copy_service.cc:161] P eb49d92feeb14382b3baa49d696b6141: Beginning new tablet copy session on tablet f904cee1d1e04a36bc93a9dcf405d9a8 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:52822: session id = 6f0cdd57c5934921829c205d32b2b8a5-f904cee1d1e04a36bc93a9dcf405d9a8
I20260709 12:13:23.930552  3352 tablet_copy_source_session.cc:215] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:23.934703  4327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f904cee1d1e04a36bc93a9dcf405d9a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.950448  4327 tablet_copy_client.cc:806] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:23.951154  4327 tablet_copy_client.cc:670] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:23.954933  4327 tablet_copy_client.cc:538] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:23.962457  4327 tablet_bootstrap.cc:492] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:23.981000  4327 tablet_bootstrap.cc:492] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.982137  4327 tablet_bootstrap.cc:492] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:23.982882  4327 ts_tablet_manager.cc:1403] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.021s	user 0.021s	sys 0.000s
I20260709 12:13:23.985822  4327 raft_consensus.cc:359] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:23.986863  4327 raft_consensus.cc:740] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:23.987568  4327 consensus_queue.cc:260] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:23.990031  4327 ts_tablet_manager.cc:1434] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:23.992419  3352 tablet_copy_service.cc:342] P eb49d92feeb14382b3baa49d696b6141: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-f904cee1d1e04a36bc93a9dcf405d9a8 received from {username='slave'} at 127.0.0.1:52822
I20260709 12:13:23.992916  3352 tablet_copy_service.cc:434] P eb49d92feeb14382b3baa49d696b6141: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-f904cee1d1e04a36bc93a9dcf405d9a8 on tablet f904cee1d1e04a36bc93a9dcf405d9a8 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:24.122495  3929 raft_consensus.cc:1217] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:24.160511  3929 raft_consensus.cc:1217] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:24.348634  3931 raft_consensus.cc:1217] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:24.459869  3931 raft_consensus.cc:1217] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:24.617419  4312 raft_consensus.cc:1064] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:24.620164  4312 consensus_queue.cc:237] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:24.627876  3931 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:24.629061  3191 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:24.629945  4312 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:24.631090  4281 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:24.632870  3263 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:24.634334  4281 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:24.646368  4280 raft_consensus.cc:1064] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:24.648978  4280 consensus_queue.cc:237] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:24.648808  4312 raft_consensus.cc:2955] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.657214  3931 raft_consensus.cc:2955] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.666663  3929 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:24.668489  4243 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:24.680953  3089 catalog_manager.cc:5697] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.685091  3263 raft_consensus.cc:2955] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.693642  3191 raft_consensus.cc:2955] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.702232  3188 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:24.706604  4346 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:24.718668  3333 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:24.720929  4292 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:24.722738  4243 raft_consensus.cc:2955] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.728174  4281 raft_consensus.cc:1064] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:24.730654  4281 consensus_queue.cc:237] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:24.734385  3191 raft_consensus.cc:2955] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.739853  3929 raft_consensus.cc:2955] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.750234  3336 consensus_queue.cc:237] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:24.756570  3931 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:24.757069  3191 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:24.758078  4314 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:24.759971  4314 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:24.762013  3087 catalog_manager.cc:5697] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.768463  4314 raft_consensus.cc:2955] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.778728  3931 raft_consensus.cc:2955] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.778589  3191 raft_consensus.cc:2955] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.799821  3262 consensus_queue.cc:237] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:24.804639  3076 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4d7af9c2d6334c6f84aed4586a66d701 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:24.805898  3090 catalog_manager.cc:5697] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.818914  3191 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:24.821600  3250 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d7af9c2d6334c6f84aed4586a66d701 with delete_type TABLET_DATA_TOMBSTONED (TS 1ef05c9d901046dca7fe0e638cc693b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:24.822744  3932 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:24.825193  4346 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:24.834776  4292 raft_consensus.cc:2955] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.837568  3262 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:24.838539  3188 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:24.840857  3188 raft_consensus.cc:2955] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.843883  4354 tablet_replica.cc:333] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:13:24.845434  4354 raft_consensus.cc:2243] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.846655  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eb7809b208b14a549539330993804c34 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:24.847618  4281 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:24.847628  4354 raft_consensus.cc:2272] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.853513  4354 ts_tablet_manager.cc:1916] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:24.859989  4312 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:24.860533  3087 catalog_manager.cc:5697] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.862936  4314 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:24.884938  4314 raft_consensus.cc:2955] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.898327  3932 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:24.907613  3192 raft_consensus.cc:2955] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.932081  4292 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:24.937546  3328 tablet_service.cc:1558] Processing DeleteTablet for tablet eb7809b208b14a549539330993804c34 with delete_type TABLET_DATA_TOMBSTONED (TS eb49d92feeb14382b3baa49d696b6141 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:24.947372  3090 catalog_manager.cc:5697] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.954751  3929 raft_consensus.cc:2955] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.948632  3931 raft_consensus.cc:2955] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.977265  4361 tablet_replica.cc:333] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:13:24.986833  3262 raft_consensus.cc:2955] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:24.983788  4354 ts_tablet_manager.cc:1929] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:25.001605  4354 log.cc:1199] T 4d7af9c2d6334c6f84aed4586a66d701 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/wals/4d7af9c2d6334c6f84aed4586a66d701
I20260709 12:13:25.003471  3075 catalog_manager.cc:5028] TS 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): tablet 4d7af9c2d6334c6f84aed4586a66d701 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:25.008354  4361 raft_consensus.cc:2243] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.009128  4361 pending_rounds.cc:70] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141: Trying to abort 1 pending ops.
I20260709 12:13:25.009606  4361 pending_rounds.cc:77] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305622342236053504 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "eb7809b208b14a549539330993804c34" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } } }
I20260709 12:13:25.012661  4361 raft_consensus.cc:2917] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:13:25.013278  4361 raft_consensus.cc:2889] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:13:25.013725  4361 raft_consensus.cc:2272] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.018738  4361 ts_tablet_manager.cc:1916] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:25.035697  3336 consensus_queue.cc:237] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:25.045212  3929 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:25.048593  4361 ts_tablet_manager.cc:1929] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:25.049252  4361 log.cc:1199] T eb7809b208b14a549539330993804c34 P eb49d92feeb14382b3baa49d696b6141: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/wals/eb7809b208b14a549539330993804c34
I20260709 12:13:25.049021  4339 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:25.054024  3076 catalog_manager.cc:5028] TS eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): tablet eb7809b208b14a549539330993804c34 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:25.055801  3265 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:25.057430  4339 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:25.058779  4312 raft_consensus.cc:2955] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:25.060458  3931 raft_consensus.cc:2955] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:25.073275  3076 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c7482671d98f47899c1d11f810abadb7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:25.078174  3265 raft_consensus.cc:2955] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:25.081346  4281 raft_consensus.cc:1064] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:25.084158  4281 consensus_queue.cc:237] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:25.080829  3087 catalog_manager.cc:5697] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:25.115006  3182 tablet_service.cc:1558] Processing DeleteTablet for tablet c7482671d98f47899c1d11f810abadb7 with delete_type TABLET_DATA_TOMBSTONED (TS 7ac63b674f204bc4805ab989f8c965d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40488
I20260709 12:13:25.119930  4363 tablet_replica.cc:333] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:13:25.121168  4363 raft_consensus.cc:2243] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.122073  4363 raft_consensus.cc:2272] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.122345  3931 raft_consensus.cc:1275] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:25.123982  4312 consensus_queue.cc:1048] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:25.128042  3188 raft_consensus.cc:1275] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:25.129339  3265 raft_consensus.cc:1275] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:25.127228  4363 ts_tablet_manager.cc:1916] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:25.136368  4312 consensus_queue.cc:1048] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:25.137472  4358 consensus_queue.cc:1048] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:25.168320  4363 ts_tablet_manager.cc:1929] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:25.173295  4363 log.cc:1199] T c7482671d98f47899c1d11f810abadb7 P 7ac63b674f204bc4805ab989f8c965d3: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/wals/c7482671d98f47899c1d11f810abadb7
I20260709 12:13:25.175086  3075 catalog_manager.cc:5028] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): tablet c7482671d98f47899c1d11f810abadb7 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:25.175503  4281 raft_consensus.cc:2955] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:25.177347  3188 raft_consensus.cc:2955] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:25.177623  3265 raft_consensus.cc:2955] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:25.200618  3087 catalog_manager.cc:5697] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:25.213254  3931 raft_consensus.cc:2955] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:25.243851  3339 consensus_queue.cc:237] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:25.249027  3929 raft_consensus.cc:1275] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:25.249619  3188 raft_consensus.cc:1275] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:25.250530  4360 consensus_queue.cc:1048] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:25.251405  4312 consensus_queue.cc:1048] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:25.259845  4312 raft_consensus.cc:2955] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:25.266901  3931 raft_consensus.cc:2955] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:25.276242  3188 raft_consensus.cc:2955] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:25.280184  3076 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f904cee1d1e04a36bc93a9dcf405d9a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:25.286477  3087 catalog_manager.cc:5697] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:25.301885  3250 tablet_service.cc:1558] Processing DeleteTablet for tablet f904cee1d1e04a36bc93a9dcf405d9a8 with delete_type TABLET_DATA_TOMBSTONED (TS 1ef05c9d901046dca7fe0e638cc693b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:25.302925  4354 tablet_replica.cc:333] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:13:25.304519  4354 raft_consensus.cc:2243] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.305222  4354 raft_consensus.cc:2272] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.310057  4354 ts_tablet_manager.cc:1916] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:25.324364  4354 ts_tablet_manager.cc:1929] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:25.324709  4354 log.cc:1199] T f904cee1d1e04a36bc93a9dcf405d9a8 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/wals/f904cee1d1e04a36bc93a9dcf405d9a8
I20260709 12:13:25.326297  3075 catalog_manager.cc:5028] TS 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): tablet f904cee1d1e04a36bc93a9dcf405d9a8 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:25.726735  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:25.787124  3265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:25.788134  3265 raft_consensus.cc:606] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:25.791276  3262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:25.791931  3262 raft_consensus.cc:606] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Received request to transfer leadership to TS 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:25.806521  3192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:25.807080  3192 raft_consensus.cc:606] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:25.809880  3262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:25.810398  3262 raft_consensus.cc:606] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:25.813135  3262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:25.813664  3262 raft_consensus.cc:606] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:25.816052  3262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:25.816565  3262 raft_consensus.cc:606] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:25.817615  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:25.818439  4243 raft_consensus.cc:993] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:25.818899  4346 raft_consensus.cc:1081] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Signalling peer eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:25.818979  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:25.820137  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:25.820606  3339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:58568
I20260709 12:13:25.821156  3339 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:25.821506  3339 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.828025  3339 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:25.829850  3339 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:25.830446  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:25.830951  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:25.831110  3188 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.831532  3262 raft_consensus.cc:3055] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.831821  3262 raft_consensus.cc:740] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:25.832576  3262 consensus_queue.cc:260] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:25.833447  3262 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.836086  3188 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:25.837157  3305 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:25.837864  4360 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:25.838328  4360 raft_consensus.cc:697] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:25.839236  3262 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:25.839236  4360 consensus_queue.cc:237] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:25.862026  3090 catalog_manager.cc:5697] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:25.896747  4243 raft_consensus.cc:993] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:25.897293  4346 raft_consensus.cc:1081] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Signalling peer eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:25.899037  3339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:58568
I20260709 12:13:25.899612  3339 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:25.899998  3339 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.905288  3339 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:25.906754  3339 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:25.907691  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:25.907943  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:25.908231  3188 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.908522  3262 raft_consensus.cc:3055] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.908859  3262 raft_consensus.cc:740] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:25.909461  3262 consensus_queue.cc:260] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:25.910346  3262 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.913329  3188 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:25.914350  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:25.915159  4360 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:25.916414  4360 raft_consensus.cc:697] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:25.915099  3262 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:25.917698  4360 consensus_queue.cc:237] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:25.928120  3090 catalog_manager.cc:5697] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:25.947242  4292 raft_consensus.cc:993] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:25.947775  4292 raft_consensus.cc:1081] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Signalling peer eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:25.949239  3339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:58568
I20260709 12:13:25.949694  3339 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:25.951038  3339 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.961983  3339 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:25.963801  3339 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:25.964715  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:25.964761  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:25.965363  3265 raft_consensus.cc:3055] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.965713  3265 raft_consensus.cc:740] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:25.965721  3188 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.966681  3265 consensus_queue.cc:260] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:25.967849  3265 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.971339  3188 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:25.972541  3265 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:25.972705  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:25.973552  4339 raft_consensus.cc:2804] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:25.974123  4339 raft_consensus.cc:697] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:25.975023  4339 consensus_queue.cc:237] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:25.987215  3090 catalog_manager.cc:5697] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:26.160892  4203 raft_consensus.cc:993] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:26.161430  4338 raft_consensus.cc:1081] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:26.163091  3265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:56758
I20260709 12:13:26.163654  3265 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:26.164001  3265 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.170037  3265 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:26.171836  3265 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:26.172616  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:26.173352  3188 raft_consensus.cc:3055] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.173700  3188 raft_consensus.cc:740] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:26.174324  3188 consensus_queue.cc:260] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:26.172729  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:26.175549  3188 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.175806  3336 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.181119  3336 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:26.181962  3188 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:26.183275  3232 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:26.184365  4346 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:26.184859  4346 raft_consensus.cc:697] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:26.185793  4346 consensus_queue.cc:237] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:26.192206  4243 raft_consensus.cc:993] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:26.192624  4292 raft_consensus.cc:1081] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Signalling peer eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:26.195562  3336 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:58568
I20260709 12:13:26.196252  3336 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:26.196619  3336 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.200676  3090 catalog_manager.cc:5697] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.201833  3336 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:26.203709  3336 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:26.204809  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:26.204674  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:26.205363  3265 raft_consensus.cc:3055] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.205394  3191 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.205912  3265 raft_consensus.cc:740] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:26.206756  3265 consensus_queue.cc:260] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:26.207891  3265 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.215215  3265 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:26.216554  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:26.217356  4339 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:26.217911  4339 raft_consensus.cc:697] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:26.218010  3191 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:26.218964  4339 consensus_queue.cc:237] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:26.232738  3191 raft_consensus.cc:1275] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.233160  3090 catalog_manager.cc:5697] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:26.233867  4339 consensus_queue.cc:1048] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.250519  4292 raft_consensus.cc:993] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:26.250562  3265 raft_consensus.cc:1275] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.251132  4292 raft_consensus.cc:1081] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Signalling peer 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:26.252758  3929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:55426
I20260709 12:13:26.253319  3929 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:26.253628  3929 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.255616  4281 consensus_queue.cc:1048] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.262002  3929 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:26.269878  3929 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:26.270558  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:26.271519  3262 raft_consensus.cc:3055] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.274564  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:26.275528  3336 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.277160  3262 raft_consensus.cc:740] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:26.278046  3262 consensus_queue.cc:260] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:26.279918  3262 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.282580  3336 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:26.284083  3896 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:26.289429  3262 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:26.289564  4385 raft_consensus.cc:2804] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:26.292496  4385 raft_consensus.cc:697] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:26.293349  4385 consensus_queue.cc:237] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:26.301465  3090 catalog_manager.cc:5697] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:26.327270  3262 raft_consensus.cc:1275] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.328840  4339 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.333768  3191 raft_consensus.cc:1275] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.335129  4339 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.378216  3262 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.379483  4281 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.390614  3188 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.393340  4281 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.403324  3336 consensus_queue.cc:237] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:13:26.413313  3306 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b974e8909e0b47e2bd4e0d28fbafe975. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:26.416960  3265 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:26.417390  3191 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:26.418859  4339 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.420346  4281 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.428304  4339 raft_consensus.cc:2955] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:26.432864  3265 raft_consensus.cc:2955] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
W20260709 12:13:26.442718  3139 auto_rebalancer.cc:629] Failed to schedule move for tablet 68838261f2ca456f9b5583e60f9f3d2c: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:26.446171  3089 catalog_manager.cc:5697] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.448861  3191 raft_consensus.cc:2955] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:26.454522  3265 consensus_queue.cc:237] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:26.472745  3191 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:26.473536  3232 consensus_peers.cc:597] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cab3ecc4f0b34068a804b174b02b9a16. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:26.473582  3336 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:26.476387  4346 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.480137  4292 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.508129  4346 raft_consensus.cc:2955] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:26.514288  3188 raft_consensus.cc:2955] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:26.520181  3336 raft_consensus.cc:2955] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:26.526813  3089 catalog_manager.cc:5697] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.529294  3339 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:13:26.562064  3306 consensus_peers.cc:597] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea1a64c911894ce08c1622f9307ed513. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:26.563629  3265 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.564836  4360 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.565243  3188 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.566605  4360 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.575928  4339 raft_consensus.cc:2955] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:26.580056  3188 raft_consensus.cc:2955] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:26.586251  3263 raft_consensus.cc:2955] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:26.602046  3089 catalog_manager.cc:5697] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:26.612653  3336 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.614099  4243 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.630107  3188 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.631397  4292 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.678969  3191 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.680328  4339 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.698351  3336 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:26.698390  3265 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:26.701840  4385 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:26.703926  3265 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.704995  4386 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:26.707127  4281 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.878234  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:26.886533  4410 ts_tablet_manager.cc:933] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:26.889418  4410 tablet_copy_client.cc:323] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.66:38853
I20260709 12:13:26.891023  3278 tablet_copy_service.cc:140] P 1ef05c9d901046dca7fe0e638cc693b9: Received BeginTabletCopySession request for tablet cab3ecc4f0b34068a804b174b02b9a16 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:40120)
I20260709 12:13:26.891543  3278 tablet_copy_service.cc:161] P 1ef05c9d901046dca7fe0e638cc693b9: Beginning new tablet copy session on tablet cab3ecc4f0b34068a804b174b02b9a16 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:40120: session id = 6f0cdd57c5934921829c205d32b2b8a5-cab3ecc4f0b34068a804b174b02b9a16
I20260709 12:13:26.899293  3278 tablet_copy_source_session.cc:215] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:26.902837  4410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab3ecc4f0b34068a804b174b02b9a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:26.922874  4410 tablet_copy_client.cc:806] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:26.923524  4410 tablet_copy_client.cc:670] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:26.933840  4410 tablet_copy_client.cc:538] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:26.941411  3262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:26.941943  4410 tablet_bootstrap.cc:492] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:26.942111  3262 raft_consensus.cc:606] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Received request to transfer leadership to TS 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:26.946746  3191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:26.947408  3191 raft_consensus.cc:606] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:26.952520  3262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:26.953130  3262 raft_consensus.cc:606] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Received request to transfer leadership to TS 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:26.984567  4410 tablet_bootstrap.cc:492] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:26.985530  4410 tablet_bootstrap.cc:492] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:26.986178  4410 ts_tablet_manager.cc:1403] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.006s
I20260709 12:13:26.989197  4410 raft_consensus.cc:359] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:26.990200  4410 raft_consensus.cc:740] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:26.990862  4410 consensus_queue.cc:260] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:27.005018  4410 ts_tablet_manager.cc:1434] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 12:13:27.008400  3278 tablet_copy_service.cc:342] P 1ef05c9d901046dca7fe0e638cc693b9: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-cab3ecc4f0b34068a804b174b02b9a16 received from {username='slave'} at 127.0.0.1:40120
I20260709 12:13:27.008896  3278 tablet_copy_service.cc:434] P 1ef05c9d901046dca7fe0e638cc693b9: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-cab3ecc4f0b34068a804b174b02b9a16 on tablet cab3ecc4f0b34068a804b174b02b9a16 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:27.012020  4410 ts_tablet_manager.cc:933] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:27.027896  4416 raft_consensus.cc:993] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:27.028479  4416 raft_consensus.cc:1081] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:27.031354  3263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:56758
I20260709 12:13:27.031984  3263 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.032332  3263 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.037690  3336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:46076
I20260709 12:13:27.038302  3336 raft_consensus.cc:606] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:27.038926  3263 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:27.045845  3265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:27.046403  3265 raft_consensus.cc:606] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Received request to transfer leadership to TS 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:27.048713  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:27.049329  3192 raft_consensus.cc:3055] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.049665  3192 raft_consensus.cc:740] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:27.049918  3188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:27.050952  3188 raft_consensus.cc:606] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Received request to transfer leadership to TS 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:27.050513  3192 consensus_queue.cc:260] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:27.059387  3192 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.052763  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:27.052969  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:27.060662  3336 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.061794  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:27.064656  4410 tablet_copy_client.cc:323] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.67:35301
I20260709 12:13:27.065965  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:27.066694  3352 tablet_copy_service.cc:140] P eb49d92feeb14382b3baa49d696b6141: Received BeginTabletCopySession request for tablet ea1a64c911894ce08c1622f9307ed513 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:52822)
I20260709 12:13:27.067401  3352 tablet_copy_service.cc:161] P eb49d92feeb14382b3baa49d696b6141: Beginning new tablet copy session on tablet ea1a64c911894ce08c1622f9307ed513 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:52822: session id = 6f0cdd57c5934921829c205d32b2b8a5-ea1a64c911894ce08c1622f9307ed513
I20260709 12:13:27.068967  3336 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:27.052009  3263 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:27.071895  3232 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:27.075131  4346 raft_consensus.cc:2804] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.075842  4346 raft_consensus.cc:697] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:27.076489  3192 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:27.077075  4346 consensus_queue.cc:237] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:27.086400  4415 ts_tablet_manager.cc:933] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:27.102059  3352 tablet_copy_source_session.cc:215] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:27.116328  4410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea1a64c911894ce08c1622f9307ed513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:27.114063  4415 tablet_copy_client.cc:323] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.67:35301
I20260709 12:13:27.126940  3352 tablet_copy_service.cc:140] P eb49d92feeb14382b3baa49d696b6141: Received BeginTabletCopySession request for tablet b974e8909e0b47e2bd4e0d28fbafe975 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:52822)
I20260709 12:13:27.129317  3352 tablet_copy_service.cc:161] P eb49d92feeb14382b3baa49d696b6141: Beginning new tablet copy session on tablet b974e8909e0b47e2bd4e0d28fbafe975 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:52822: session id = 6f0cdd57c5934921829c205d32b2b8a5-b974e8909e0b47e2bd4e0d28fbafe975
I20260709 12:13:27.141309  3088 catalog_manager.cc:5697] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.145874  3352 tablet_copy_source_session.cc:215] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:27.150530  4415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b974e8909e0b47e2bd4e0d28fbafe975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:27.153980  4410 tablet_copy_client.cc:806] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:27.154670  4410 tablet_copy_client.cc:670] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:27.158939  4410 tablet_copy_client.cc:538] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:27.168258  4410 tablet_bootstrap.cc:492] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:27.184388  4415 tablet_copy_client.cc:806] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:27.185037  4415 tablet_copy_client.cc:670] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:27.189615  4415 tablet_copy_client.cc:538] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:27.196893  4410 tablet_bootstrap.cc:492] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:27.198487  4410 tablet_bootstrap.cc:492] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:27.199239  4410 ts_tablet_manager.cc:1403] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.031s	user 0.025s	sys 0.001s
I20260709 12:13:27.202484  4410 raft_consensus.cc:359] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:27.203526  4410 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:27.204236  4410 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:27.207103  4410 ts_tablet_manager.cc:1434] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:27.209556  3352 tablet_copy_service.cc:342] P eb49d92feeb14382b3baa49d696b6141: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-ea1a64c911894ce08c1622f9307ed513 received from {username='slave'} at 127.0.0.1:52822
I20260709 12:13:27.210002  3352 tablet_copy_service.cc:434] P eb49d92feeb14382b3baa49d696b6141: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-ea1a64c911894ce08c1622f9307ed513 on tablet ea1a64c911894ce08c1622f9307ed513 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:27.210170  4415 tablet_bootstrap.cc:492] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:27.231112  4399 raft_consensus.cc:993] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3: : Instructing follower 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:27.231755  4399 raft_consensus.cc:1081] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Signalling peer 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:27.233486  3929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:55438
I20260709 12:13:27.234069  3929 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.234591  3929 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.239308  3929 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.242004  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:27.242588  3192 raft_consensus.cc:3055] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.242707  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:27.243553  3192 raft_consensus.cc:740] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:27.243860  3339 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.244370  3192 consensus_queue.cc:260] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.245432  3192 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.243525  3929 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:27.241243  4415 tablet_bootstrap.cc:492] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:27.250586  3339 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:27.253015  4415 tablet_bootstrap.cc:492] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:27.253909  4415 ts_tablet_manager.cc:1403] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.044s	user 0.023s	sys 0.006s
I20260709 12:13:27.253728  3896 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:27.254789  4409 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.255264  4409 raft_consensus.cc:697] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:27.261797  4409 consensus_queue.cc:237] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.258607  3192 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:27.263188  4346 raft_consensus.cc:993] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:27.265964  4346 raft_consensus.cc:1081] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Signalling peer 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:27.267657  3929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:55426
I20260709 12:13:27.268216  3929 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.268532  3929 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.270560  4415 raft_consensus.cc:359] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:27.271405  4415 raft_consensus.cc:740] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:27.278609  4425 raft_consensus.cc:993] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:27.272136  4415 consensus_queue.cc:260] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:27.279211  4292 raft_consensus.cc:1081] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Signalling peer 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:27.282188  4425 raft_consensus.cc:993] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:27.282205  3931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:55426
I20260709 12:13:27.282764  4292 raft_consensus.cc:1081] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Signalling peer 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:27.282900  3931 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.283403  3931 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.289793  3932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:55426
I20260709 12:13:27.290351  3932 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.290778  3932 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.293448  3087 catalog_manager.cc:5697] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.301719  3931 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.305847  3932 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.306818  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:27.308188  3932 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:27.309290  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:27.309888  3338 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.312245  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:27.312937  3263 raft_consensus.cc:3055] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.313231  3263 raft_consensus.cc:740] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:27.314009  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:27.314545  3262 raft_consensus.cc:3055] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.314814  3262 raft_consensus.cc:740] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:27.315280  3263 consensus_queue.cc:260] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.315622  3262 consensus_queue.cc:260] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.316254  3263 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.316679  3262 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.317898  3929 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.321322  3929 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:27.321797  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:27.322374  3335 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.330312  3263 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:27.331601  3895 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:27.332628  4409 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.334354  4409 raft_consensus.cc:697] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:27.335284  4409 consensus_queue.cc:237] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.336340  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:27.336881  3263 raft_consensus.cc:3055] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.337165  3263 raft_consensus.cc:740] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:27.337869  3263 consensus_queue.cc:260] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.307525  3336 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.284757  4415 ts_tablet_manager.cc:1434] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.007s
I20260709 12:13:27.346544  3352 tablet_copy_service.cc:342] P eb49d92feeb14382b3baa49d696b6141: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-b974e8909e0b47e2bd4e0d28fbafe975 received from {username='slave'} at 127.0.0.1:52822
I20260709 12:13:27.347098  3352 tablet_copy_service.cc:434] P eb49d92feeb14382b3baa49d696b6141: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-b974e8909e0b47e2bd4e0d28fbafe975 on tablet b974e8909e0b47e2bd4e0d28fbafe975 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:27.349236  3929 raft_consensus.cc:1217] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:13:27.355350  3335 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:27.356587  3896 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:27.358693  3263 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.359091  3929 raft_consensus.cc:1217] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:27.359876  4386 raft_consensus.cc:2804] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.364554  3088 catalog_manager.cc:5697] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.374765  3931 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:27.393301  3263 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:27.393918  3262 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:27.398633  3895 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:27.398775  3336 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:27.399611  3333 raft_consensus.cc:1240] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:27.400768  4409 raft_consensus.cc:2804] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.401347  4409 raft_consensus.cc:697] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:27.402487  4409 consensus_queue.cc:237] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.406704  3338 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:27.412952  4386 raft_consensus.cc:697] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:27.415019  4386 consensus_queue.cc:237] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.430457  3088 catalog_manager.cc:5697] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.447023  3088 catalog_manager.cc:5697] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.457192  4339 raft_consensus.cc:993] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:27.457783  4339 raft_consensus.cc:1081] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:27.459244  3931 raft_consensus.cc:1217] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:27.459903  3262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:56754
I20260709 12:13:27.460490  3262 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.460891  3262 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.468760  3262 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:27.473681  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:27.473810  3262 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:27.474303  3192 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.474357  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:27.474965  3338 raft_consensus.cc:3055] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:27.475311  3338 raft_consensus.cc:740] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:27.476068  3338 consensus_queue.cc:260] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:27.477217  3338 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.480822  3192 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:27.482152  3231 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:27.483032  4292 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:27.483616  4292 raft_consensus.cc:697] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:27.484125  3338 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:27.484474  4292 consensus_queue.cc:237] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:27.498476  3087 catalog_manager.cc:5697] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 2 to 3, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 3 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.614876  3338 raft_consensus.cc:1275] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.616314  4292 consensus_queue.cc:1048] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:27.628266  3192 raft_consensus.cc:1275] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.629923  4425 consensus_queue.cc:1048] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:27.728658  4360 raft_consensus.cc:1064] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:27.730782  4360 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.737244  3931 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:27.737788  3262 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:27.738945  3188 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:27.738677  4360 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:27.741179  4281 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:27.743527  4339 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:27.749468  3188 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:27.750792  4386 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:27.805092  4339 raft_consensus.cc:2955] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:27.806632  3338 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:27.808105  4409 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:27.811734  3263 raft_consensus.cc:2955] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:27.816124  3262 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:27.820161  4428 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:27.833842  3931 raft_consensus.cc:2955] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:27.837080  4243 raft_consensus.cc:1064] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:27.849574  4243 consensus_queue.cc:237] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.870486  3333 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:27.872089  4409 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:27.885807  3338 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:27.886390  3932 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:27.885797  3192 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:27.887493  4243 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:27.888923  4292 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:27.890897  3263 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:27.891439  3262 raft_consensus.cc:1275] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:27.899875  4409 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:27.903798  3338 raft_consensus.cc:1275] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:27.914945  3089 catalog_manager.cc:5697] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.918336  4386 consensus_queue.cc:1048] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:27.923146  4428 consensus_queue.cc:1048] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:27.939669  3333 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:27.953284  3188 raft_consensus.cc:2955] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:27.975554  3193 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:27.990927  3338 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:28.002266  4409 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:28.015479  3267 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:28.025704  4292 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:28.029247  4339 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:28.042449  4292 raft_consensus.cc:2955] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.052266  4243 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:28.057325  3932 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:28.062403  3333 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:28.063643  4339 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:28.065763  4281 raft_consensus.cc:1064] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:28.066358  4243 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:28.068253  4281 consensus_queue.cc:237] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.080688  4360 raft_consensus.cc:2955] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.081681  3335 raft_consensus.cc:2955] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.101608  3931 raft_consensus.cc:2955] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.129617  3076 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ea1a64c911894ce08c1622f9307ed513 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:28.143759  3089 catalog_manager.cc:5697] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.147492  3089 catalog_manager.cc:5697] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:28.152036  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 53090.2us
I20260709 12:13:28.157600  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:28.166270  3929 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.168793  3188 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.169716  4339 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:28.170907  4281 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:28.181543  3932 raft_consensus.cc:2955] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:13:28.193754  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 107620us
I20260709 12:13:28.210099  3193 raft_consensus.cc:2955] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.211769  4281 raft_consensus.cc:2955] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.229846  3262 raft_consensus.cc:2955] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.246389  3263 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.237524  3188 raft_consensus.cc:2955] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.254102  4339 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:28.214576  3929 raft_consensus.cc:2955] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.263751  3182 tablet_service.cc:1558] Processing DeleteTablet for tablet ea1a64c911894ce08c1622f9307ed513 with delete_type TABLET_DATA_TOMBSTONED (TS 7ac63b674f204bc4805ab989f8c965d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40488
I20260709 12:13:28.272648  4465 tablet_replica.cc:333] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:13:28.283749  3262 raft_consensus.cc:2955] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.305284  4465 raft_consensus.cc:2243] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:28.306161  4465 raft_consensus.cc:2272] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:28.325222  4465 ts_tablet_manager.cc:1916] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:28.330238  3087 catalog_manager.cc:5697] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.371526  4465 ts_tablet_manager.cc:1929] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:13:28.372066  4465 log.cc:1199] T ea1a64c911894ce08c1622f9307ed513 P 7ac63b674f204bc4805ab989f8c965d3: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/wals/ea1a64c911894ce08c1622f9307ed513
I20260709 12:13:28.373864  3075 catalog_manager.cc:5028] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): tablet ea1a64c911894ce08c1622f9307ed513 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:28.377038  3335 consensus_queue.cc:237] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.383337  3932 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:28.385188  4360 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:28.386072  3188 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:28.387557  4339 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:28.391817  4339 raft_consensus.cc:2955] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.407773  3929 raft_consensus.cc:2955] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.424062  3188 raft_consensus.cc:2955] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.432489  3076 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b974e8909e0b47e2bd4e0d28fbafe975 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:28.442605  3089 catalog_manager.cc:5697] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index 3 to 4, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:28.453876  3250 tablet_service.cc:1558] Processing DeleteTablet for tablet b974e8909e0b47e2bd4e0d28fbafe975 with delete_type TABLET_DATA_TOMBSTONED (TS 1ef05c9d901046dca7fe0e638cc693b9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:28.464130  4469 tablet_replica.cc:333] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:13:28.466370  4469 raft_consensus.cc:2243] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:28.468833  4469 raft_consensus.cc:2272] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:28.475618  4469 ts_tablet_manager.cc:1916] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:28.505774  4469 ts_tablet_manager.cc:1929] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:28.506280  4469 log.cc:1199] T b974e8909e0b47e2bd4e0d28fbafe975 P 1ef05c9d901046dca7fe0e638cc693b9: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/wals/b974e8909e0b47e2bd4e0d28fbafe975
I20260709 12:13:28.518076  3188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:28.518709  3188 raft_consensus.cc:606] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:28.523115  3188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:28.523707  3188 raft_consensus.cc:606] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Received request to transfer leadership to TS 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:28.527174  3335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
new_leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:46076
I20260709 12:13:28.527740  3335 raft_consensus.cc:606] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Received request to transfer leadership to TS 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:28.530584  3262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:28.531124  3262 raft_consensus.cc:606] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Received request to transfer leadership to TS 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:28.535144  3193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:28.535630  3193 raft_consensus.cc:606] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:28.537518  3075 catalog_manager.cc:5028] TS 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): tablet b974e8909e0b47e2bd4e0d28fbafe975 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:28.538225  3262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:28.538820  3262 raft_consensus.cc:606] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Received request to transfer leadership to TS 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:28.540231  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:28.544283  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:28.545426  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:28.669371  3075 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 3 similar messages]
I20260709 12:13:28.669945  4462 raft_consensus.cc:993] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:28.670452  4462 raft_consensus.cc:1081] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Signalling peer 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:28.673095  3929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:55426
I20260709 12:13:28.673807  3929 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.674263  3929 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.684741  3929 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.688943  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:28.689282  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:28.689599  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:28.689968  3262 raft_consensus.cc:3055] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:28.690114  3335 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.690301  3262 raft_consensus.cc:740] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:28.689625  3193 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.691120  3262 consensus_queue.cc:260] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.698269  3262 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.705701  3262 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:28.719580  4243 raft_consensus.cc:993] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:28.720192  4243 raft_consensus.cc:1081] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Signalling peer 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:28.721915  4467 raft_consensus.cc:993] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:28.726300  4467 raft_consensus.cc:1081] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:28.728843  3262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:56758
I20260709 12:13:28.729346  3262 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.729671  3262 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.726920  3931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:55426
I20260709 12:13:28.732242  3931 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.735905  3931 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.742383  3335 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:28.733237  3193 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
W20260709 12:13:28.734081  3075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 64742.3us
I20260709 12:13:28.743834  3896 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:28.746348  3262 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:28.746645  3075 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet cab3ecc4f0b34068a804b174b02b9a16 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1ef05c9d901046dca7fe0e638cc693b9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:28.746348  4386 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:28.747993  4386 raft_consensus.cc:697] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:28.748349  3262 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:28.735260  3929 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:28.748471  3931 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.748867  4386 consensus_queue.cc:237] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.752133  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:28.752720  3335 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.748896  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:28.754365  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:28.755035  3265 raft_consensus.cc:3055] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:28.755302  3265 raft_consensus.cc:740] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:28.756182  3265 consensus_queue.cc:260] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.757221  3265 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.760807  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:28.761350  3335 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:28.761667  3333 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.762565  3896 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:28.763485  4409 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:28.764000  4409 raft_consensus.cc:697] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:28.764875  4409 consensus_queue.cc:237] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.768010  3193 raft_consensus.cc:3055] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:28.768544  3193 raft_consensus.cc:740] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:28.769629  3193 consensus_queue.cc:260] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:28.770361  3333 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:28.769629  3931 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:28.772274  3232 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:28.771581  3193 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.773186  4462 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:28.774353  3265 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:28.774369  4462 raft_consensus.cc:697] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:28.776077  4462 consensus_queue.cc:237] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:28.776907  3088 catalog_manager.cc:5697] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:28.783087  3193 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:28.794054  3088 catalog_manager.cc:5697] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.794924  3090 catalog_manager.cc:5697] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:28.853222  4339 raft_consensus.cc:993] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: : Instructing follower 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:28.853755  4360 raft_consensus.cc:1081] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Signalling peer 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:28.855636  3929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:37962
I20260709 12:13:28.856225  3929 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.856590  3929 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.866952  3929 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.872346  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:28.872918  3265 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.873157  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:28.873737  3333 raft_consensus.cc:3055] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:28.874045  3333 raft_consensus.cc:740] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:28.874962  3333 consensus_queue.cc:260] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.876147  3333 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.879837  3265 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:28.881359  3895 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:28.882280  4428 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:28.882750  4428 raft_consensus.cc:697] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:28.883581  4428 consensus_queue.cc:237] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.887403  3929 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:28.889125  3333 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:28.894451  4338 raft_consensus.cc:993] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:28.894915  4338 raft_consensus.cc:1081] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:28.895726  3090 catalog_manager.cc:5697] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:28.896457  3265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:56758
I20260709 12:13:28.903745  3265 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.904215  3265 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.911031  3265 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:28.913439  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:28.913370  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:28.914103  3333 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.914165  3193 raft_consensus.cc:3055] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:28.914566  3193 raft_consensus.cc:740] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:28.915313  3193 consensus_queue.cc:260] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:28.916395  3193 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.912985  3265 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:28.920889  3333 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:28.924890  3232 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:28.926782  4243 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:28.927245  4243 raft_consensus.cc:697] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:28.928264  4467 raft_consensus.cc:993] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3: : Instructing follower 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:28.928087  4243 consensus_queue.cc:237] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:28.928751  4467 raft_consensus.cc:1081] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Signalling peer 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:28.930684  3931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:55438
I20260709 12:13:28.931259  3931 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.931646  3931 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.943130  3193 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:28.941054  3931 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.948105  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:28.948787  3193 raft_consensus.cc:3055] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:28.949188  3193 raft_consensus.cc:740] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:28.949283  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:28.948838  3090 catalog_manager.cc:5697] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.949873  3333 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.950270  3193 consensus_queue.cc:260] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.951494  3193 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.951676  3931 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:28.957487  3333 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:28.958571  3193 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:28.959962  3896 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:28.960829  4409 raft_consensus.cc:2804] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:28.961293  4409 raft_consensus.cc:697] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:28.962599  4409 consensus_queue.cc:237] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:28.972765  3090 catalog_manager.cc:5697] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.206966  3193 raft_consensus.cc:1275] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:29.208705  4243 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:29.221716  3333 raft_consensus.cc:1275] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:29.223126  4460 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:29.234186  3265 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.238302  4428 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:29.234351  3193 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:29.244585  4428 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:29.265614  3262 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:29.267141  4386 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:29.286243  3335 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.302942  3335 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:29.305290  4428 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.311980  4428 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:29.329145  3262 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.333823  4409 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.368773  3335 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.376983  4409 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.388257  3931 consensus_queue.cc:237] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:29.401147  3262 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.403522  4487 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.409883  3193 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.409794  4409 raft_consensus.cc:2955] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:29.426707  4386 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:29.434988  3076 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cab3ecc4f0b34068a804b174b02b9a16 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 6)
I20260709 12:13:29.423611  3262 raft_consensus.cc:2955] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:29.439246  3088 catalog_manager.cc:5697] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 3 to 5, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.450536  3328 tablet_service.cc:1558] Processing DeleteTablet for tablet cab3ecc4f0b34068a804b174b02b9a16 with delete_type TABLET_DATA_TOMBSTONED (TS eb49d92feeb14382b3baa49d696b6141 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:29.458427  3193 raft_consensus.cc:2955] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:29.466848  3192 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.466974  3188 raft_consensus.cc:1275] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:29.470726  4386 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.476733  4243 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:29.482381  4492 tablet_replica.cc:333] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:13:29.483736  4492 raft_consensus.cc:2243] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:29.484382  4492 raft_consensus.cc:2272] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:29.489789  4492 ts_tablet_manager.cc:1916] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:29.505651  3333 raft_consensus.cc:1275] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:29.507136  4462 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:29.515555  4492 ts_tablet_manager.cc:1929] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:13:29.516216  4492 log.cc:1199] T cab3ecc4f0b34068a804b174b02b9a16 P eb49d92feeb14382b3baa49d696b6141: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/wals/cab3ecc4f0b34068a804b174b02b9a16
I20260709 12:13:29.519500  3338 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.521008  4386 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.523993  3076 catalog_manager.cc:5028] TS eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): tablet cab3ecc4f0b34068a804b174b02b9a16 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:29.602725  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:29.640434  3193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:29.640949  3193 raft_consensus.cc:606] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:29.643848  3262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "7ac63b674f204bc4805ab989f8c965d3"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:29.644315  3262 raft_consensus.cc:606] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Received request to transfer leadership to TS 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:29.647029  3338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
new_leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:46076
I20260709 12:13:29.647581  3338 raft_consensus.cc:606] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Received request to transfer leadership to TS 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:29.650074  3338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
new_leader_uuid: "7ac63b674f204bc4805ab989f8c965d3"
 from {username='slave'} at 127.0.0.1:46076
I20260709 12:13:29.650516  3338 raft_consensus.cc:606] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Received request to transfer leadership to TS 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:29.651485  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:29.652638  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:29.653190  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:29.724449  4360 raft_consensus.cc:993] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: : Instructing follower 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:29.726138  4495 raft_consensus.cc:1081] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Signalling peer 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:29.729975  3929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:37962
I20260709 12:13:29.731031  3929 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:29.731616  3929 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.766631  3929 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:29.769608  3929 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:29.771991  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:29.778483  3267 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.787344  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:29.788070  3338 raft_consensus.cc:3055] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:29.788398  3338 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:29.789757  3267 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:29.789405  3338 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:29.791491  3895 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:29.791643  3338 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.792475  4409 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:29.792966  4409 raft_consensus.cc:697] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:29.794188  4409 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:29.814635  3338 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:29.818987  3088 catalog_manager.cc:5697] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 3, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 3 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.942433  4500 raft_consensus.cc:993] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141: : Instructing follower 7ac63b674f204bc4805ab989f8c965d3 to start an election
I20260709 12:13:29.943078  4495 raft_consensus.cc:1081] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Signalling peer 7ac63b674f204bc4805ab989f8c965d3 to start an election
I20260709 12:13:29.944921  3193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
 from {username='slave'} at 127.0.0.1:40494
I20260709 12:13:29.945475  3193 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:29.945812  3193 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.953078  3193 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:29.955952  3193 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:29.956861  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:29.957444  3265 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.957638  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:29.958189  3338 raft_consensus.cc:3055] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:29.958510  3338 raft_consensus.cc:740] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:29.959501  3338 consensus_queue.cc:260] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:29.960814  3338 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.966476  3265 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:29.969797  3156 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:29.970109  3338 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:29.970853  4338 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:29.971292  4338 raft_consensus.cc:697] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:29.972213  4338 consensus_queue.cc:237] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:29.983608  3088 catalog_manager.cc:5697] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 1 to 2, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.002321  4338 raft_consensus.cc:993] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:30.003144  4468 raft_consensus.cc:1081] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:30.004874  3265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:56758
I20260709 12:13:30.005474  3265 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:30.005935  3265 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.011808  3265 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:30.013437  3265 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:30.014544  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:30.015219  3193 raft_consensus.cc:3055] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:30.015532  3193 raft_consensus.cc:740] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:30.016361  3193 consensus_queue.cc:260] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:30.017292  3193 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.014447  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:30.020125  3338 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.027767  3338 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:30.028903  3232 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:30.029923  4462 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:30.030494  4462 raft_consensus.cc:697] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:30.031549  4462 consensus_queue.cc:237] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:30.036100  3193 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:30.048311  3088 catalog_manager.cc:5697] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.215093  4496 raft_consensus.cc:993] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower 7ac63b674f204bc4805ab989f8c965d3 to start an election
I20260709 12:13:30.215603  4462 raft_consensus.cc:1081] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Signalling peer 7ac63b674f204bc4805ab989f8c965d3 to start an election
I20260709 12:13:30.217126  3192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
 from {username='slave'} at 127.0.0.1:40510
I20260709 12:13:30.217609  3192 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:30.217926  3192 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.223676  3192 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:30.225369  3192 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:30.226188  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:30.226475  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:30.226924  3267 raft_consensus.cc:3055] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:30.227277  3338 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.227329  3267 raft_consensus.cc:740] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:30.228307  3267 consensus_queue.cc:260] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:30.229535  3267 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.233191  3338 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:30.234525  3157 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:30.234966  3267 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:30.235201  4468 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:30.236012  4468 raft_consensus.cc:697] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:30.236900  4468 consensus_queue.cc:237] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:30.249128  3088 catalog_manager.cc:5697] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 2 to 3, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.264660  3338 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:30.266239  4428 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:30.277592  3265 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:30.279559  4386 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:30.365306  3333 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.366554  4468 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:30.379892  3265 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.382952  4468 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:30.476753  3192 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.478181  4243 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:30.501088  3333 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.505955  4496 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:30.559072  3193 consensus_queue.cc:237] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:13:30.565750  3157 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f0fc559f70f94ad8b2da50624147942a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:30.565874  3262 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:30.567313  3333 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:30.567348  4468 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:30.568845  4515 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:30.575583  4468 raft_consensus.cc:2955] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.576592  3338 raft_consensus.cc:2955] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.578409  3262 raft_consensus.cc:2955] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.595959  3087 catalog_manager.cc:5697] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 3, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.598764  3338 consensus_queue.cc:237] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:13:30.612426  3306 consensus_peers.cc:597] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49089e729c0f4f37b66d40abf2e3cfe6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:30.613710  3262 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:30.615283  4500 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:30.619690  3193 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:30.626122  4517 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:30.638051  4495 raft_consensus.cc:2955] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.639765  3262 raft_consensus.cc:2955] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.643327  3193 raft_consensus.cc:2955] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.653115  3265 consensus_queue.cc:237] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:30.655670  3088 catalog_manager.cc:5697] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.672443  3338 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:30.672909  3193 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:30.673808  4496 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:30.675958  4496 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:30.686290  3232 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72176593f52b48c28602984ef9c8ee6b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:30.696907  4243 raft_consensus.cc:2955] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.700560  3192 raft_consensus.cc:2955] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.706106  3333 raft_consensus.cc:2955] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.717128  3338 consensus_queue.cc:237] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:30.724651  3090 catalog_manager.cc:5697] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:30.731024  3306 consensus_peers.cc:597] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e285af011d44cfc91bcd6499aa4c9f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:30.731868  3265 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:30.732178  3192 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:30.733341  4495 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:30.734175  4517 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:30.745215  4517 raft_consensus.cc:2955] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.747931  3262 raft_consensus.cc:2955] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.752146  3192 raft_consensus.cc:2955] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.765642  3089 catalog_manager.cc:5697] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:30.824440  3333 raft_consensus.cc:1275] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:30.824896  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:30.827147  4468 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:30.864670  3262 raft_consensus.cc:1275] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:30.866314  4515 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:30.899399  3262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:30.900115  3262 raft_consensus.cc:606] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:30.903200  3192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:30.903791  3192 raft_consensus.cc:606] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:30.906917  3192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:30.907534  3192 raft_consensus.cc:606] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:30.910573  3262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:30.911089  3262 raft_consensus.cc:606] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:30.912233  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:30.913448  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:30.914659  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:31.160962  4460 raft_consensus.cc:993] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:31.161576  4460 raft_consensus.cc:1081] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Signalling peer eb49d92feeb14382b3baa49d696b6141 to start an election
W20260709 12:13:31.195226  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 47795.1us
I20260709 12:13:31.268522  3338 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:58568
I20260709 12:13:31.269420  3338 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.269944  3338 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:31.333168  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 43608.9us
I20260709 12:13:31.391462  4529 ts_tablet_manager.cc:933] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:31.406287  4529 tablet_copy_client.cc:323] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.67:35301
I20260709 12:13:31.306748  3338 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:31.418169  3338 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:31.420614  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:31.428575  3262 raft_consensus.cc:3055] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.429123  3262 raft_consensus.cc:740] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:31.430305  3262 consensus_queue.cc:260] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:31.599198  4534 ts_tablet_manager.cc:933] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:31.626895  4530 ts_tablet_manager.cc:933] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:31.637077  3352 tablet_copy_service.cc:140] P eb49d92feeb14382b3baa49d696b6141: Received BeginTabletCopySession request for tablet 5e285af011d44cfc91bcd6499aa4c9f8 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:52822)
I20260709 12:13:31.760540  3352 tablet_copy_service.cc:161] P eb49d92feeb14382b3baa49d696b6141: Beginning new tablet copy session on tablet 5e285af011d44cfc91bcd6499aa4c9f8 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:52822: session id = 6f0cdd57c5934921829c205d32b2b8a5-5e285af011d44cfc91bcd6499aa4c9f8
I20260709 12:13:31.766986  4542 raft_consensus.cc:993] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:31.767563  4542 raft_consensus.cc:1081] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:31.772200  3352 tablet_copy_source_session.cc:215] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:31.776957  4529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e285af011d44cfc91bcd6499aa4c9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:31.802223  4535 raft_consensus.cc:993] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:31.802889  4460 raft_consensus.cc:1081] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Signalling peer eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:31.837677  3260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:56758
I20260709 12:13:31.838339  3260 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.838729  3260 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.845350  3262 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.837872  3335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:58568
I20260709 12:13:31.848325  3335 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.849020  3335 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.876489  4534 tablet_copy_client.cc:323] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.66:38853
I20260709 12:13:31.881182  3260 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:31.885038  3260 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:31.893909  4542 raft_consensus.cc:993] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:31.894743  4544 raft_consensus.cc:1081] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:31.896453  4530 tablet_copy_client.cc:323] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.67:35301
I20260709 12:13:31.905759  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:31.905781  3264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:56758
I20260709 12:13:31.906584  3193 raft_consensus.cc:3055] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.906641  3264 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.906980  3193 raft_consensus.cc:740] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:31.907092  3264 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.907825  3193 consensus_queue.cc:260] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:31.909106  3193 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.915211  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:31.915880  3192 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.923072  3192 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:31.941223  4529 tablet_copy_client.cc:806] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:31.948331  4529 tablet_copy_client.cc:670] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:31.953465  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:31.954241  3193 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:31.954522  4554 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:31.955528  4554 raft_consensus.cc:697] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:31.956158  3231 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:31.956475  4554 consensus_queue.cc:237] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:31.957232  4528 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:31.957790  4528 raft_consensus.cc:697] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:31.958812  4528 consensus_queue.cc:237] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:31.973531  3264 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:31.986397  3264 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:32.017577  3352 tablet_copy_service.cc:140] P eb49d92feeb14382b3baa49d696b6141: Received BeginTabletCopySession request for tablet 49089e729c0f4f37b66d40abf2e3cfe6 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:52822)
I20260709 12:13:32.018172  3352 tablet_copy_service.cc:161] P eb49d92feeb14382b3baa49d696b6141: Beginning new tablet copy session on tablet 49089e729c0f4f37b66d40abf2e3cfe6 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:52822: session id = 6f0cdd57c5934921829c205d32b2b8a5-49089e729c0f4f37b66d40abf2e3cfe6
I20260709 12:13:31.984288  4531 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:31.982877  3262 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:31.994076  4537 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:32.023941  4531 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:32.024097  4537 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:32.028723  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:32.029151  4531 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:32.029373  3188 raft_consensus.cc:3055] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.029662  3188 raft_consensus.cc:740] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:32.030422  3188 consensus_queue.cc:260] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:32.039660  4537 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:13:32.041229  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 142962us
I20260709 12:13:32.041800  3188 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.049172  3278 tablet_copy_service.cc:140] P 1ef05c9d901046dca7fe0e638cc693b9: Received BeginTabletCopySession request for tablet 72176593f52b48c28602984ef9c8ee6b from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:40120)
I20260709 12:13:32.049785  3278 tablet_copy_service.cc:161] P 1ef05c9d901046dca7fe0e638cc693b9: Beginning new tablet copy session on tablet 72176593f52b48c28602984ef9c8ee6b from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:40120: session id = 6f0cdd57c5934921829c205d32b2b8a5-72176593f52b48c28602984ef9c8ee6b
I20260709 12:13:32.050884  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:32.051484  3338 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.057564  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:32.058270  3340 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.059756  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:32.073195  4529 tablet_copy_client.cc:538] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:32.073823  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:32.077078  3335 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:32.086588  3335 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:32.093869  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:32.100392  3338 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:32.103850  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:32.109190  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:32.112612  3193 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.113559  3188 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:32.123564  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:32.164511  3193 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:32.168349  3192 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:32.135042  3264 raft_consensus.cc:3055] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.175494  3352 tablet_copy_source_session.cc:215] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:32.175756  3264 raft_consensus.cc:740] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:32.177304  3264 consensus_queue.cc:260] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:32.179144  3264 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.181178  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:32.182051  4495 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:32.182121  3895 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:32.128756  3278 tablet_copy_source_session.cc:215] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:32.184386  4495 raft_consensus.cc:697] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:32.185519  4495 consensus_queue.cc:237] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:32.186045  4428 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:32.191900  4530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49089e729c0f4f37b66d40abf2e3cfe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:32.192703  3231 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:32.198328  4547 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:32.175494  4529 tablet_bootstrap.cc:492] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:32.213097  4547 raft_consensus.cc:697] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:32.219925  4547 consensus_queue.cc:237] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:32.219375  3090 catalog_manager.cc:5697] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.236279  3895 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:32.238821  4557 ts_tablet_manager.cc:933] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:32.229281  3087 catalog_manager.cc:5697] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 2 to 3, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.240271  4534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72176593f52b48c28602984ef9c8ee6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:32.239181  4531 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:32.264681  3340 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:32.309530  4530 tablet_copy_client.cc:806] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:32.322093  4557 tablet_copy_client.cc:323] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.65:44889
I20260709 12:13:32.312582  4530 tablet_copy_client.cc:670] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:32.328528  3203 tablet_copy_service.cc:140] P 7ac63b674f204bc4805ab989f8c965d3: Received BeginTabletCopySession request for tablet f0fc559f70f94ad8b2da50624147942a from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:47276)
I20260709 12:13:32.329133  3203 tablet_copy_service.cc:161] P 7ac63b674f204bc4805ab989f8c965d3: Beginning new tablet copy session on tablet f0fc559f70f94ad8b2da50624147942a from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:47276: session id = 6f0cdd57c5934921829c205d32b2b8a5-f0fc559f70f94ad8b2da50624147942a
I20260709 12:13:32.331698  4530 tablet_copy_client.cc:538] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:32.336946  3264 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:32.337664  4534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55426 (request call id 256) took 1025 ms. Trace:
I20260709 12:13:32.338207  4534 rpcz_store.cc:276] 0709 12:13:31.312776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.312967 (+   191us) service_pool.cc:224] Handling call
0709 12:13:31.759783 (+446816us) ts_tablet_manager.cc:934] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
0709 12:13:32.238941 (+479158us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:13:32.312739 (+ 73798us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:32.320740 (+  8001us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:13:32.336928 (+ 16188us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:13:32.337227 (+   299us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:32.337539 (+   312us) ts_tablet_manager.cc:989] Replica registered.
0709 12:13:32.337602 (+    63us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":273,"spinlock_wait_cycles":1362176,"tablet-copy.queue_time_us":267977,"thread_start_us":261194,"threads_started":2}
I20260709 12:13:32.340420  4534 tablet_copy_client.cc:806] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:32.340983  4534 tablet_copy_client.cc:670] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:32.351325  3203 tablet_copy_source_session.cc:215] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:32.353592  4534 tablet_copy_client.cc:538] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:32.361797  4530 tablet_bootstrap.cc:492] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:32.362457  4557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0fc559f70f94ad8b2da50624147942a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:32.384508  4534 tablet_bootstrap.cc:492] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:32.389557  3264 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.394313  3338 raft_consensus.cc:1275] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.396937  4495 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:13:32.397534  4496 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:13:32.403800  4557 tablet_copy_client.cc:806] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:32.404500  4557 tablet_copy_client.cc:670] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:32.451643  4557 tablet_copy_client.cc:538] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:32.451920  4529 tablet_bootstrap.cc:492] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:32.452975  4529 tablet_bootstrap.cc:492] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:32.455595  4529 ts_tablet_manager.cc:1403] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.280s	user 0.019s	sys 0.017s
I20260709 12:13:32.484503  3090 catalog_manager.cc:5697] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.479328  3087 catalog_manager.cc:5697] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.497464  4557 tablet_bootstrap.cc:492] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:32.519016  3192 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.566442  3185 raft_consensus.cc:1275] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.575155  4528 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:32.580217  4529 raft_consensus.cc:359] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:32.588994  4529 raft_consensus.cc:740] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:32.589844  4529 consensus_queue.cc:260] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:32.595584  4559 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:32.600761  4529 ts_tablet_manager.cc:1434] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.110s	user 0.005s	sys 0.004s
I20260709 12:13:32.602840  3352 tablet_copy_service.cc:342] P eb49d92feeb14382b3baa49d696b6141: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-5e285af011d44cfc91bcd6499aa4c9f8 received from {username='slave'} at 127.0.0.1:52822
I20260709 12:13:32.606788  3352 tablet_copy_service.cc:434] P eb49d92feeb14382b3baa49d696b6141: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-5e285af011d44cfc91bcd6499aa4c9f8 on tablet 5e285af011d44cfc91bcd6499aa4c9f8 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:32.665515  4530 tablet_bootstrap.cc:492] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:32.666544  4530 tablet_bootstrap.cc:492] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:32.667263  4530 ts_tablet_manager.cc:1403] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.306s	user 0.027s	sys 0.013s
I20260709 12:13:32.693193  3192 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.696424  4496 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.700366  4557 tablet_bootstrap.cc:492] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:32.704214  4530 raft_consensus.cc:359] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:32.701475  4557 tablet_bootstrap.cc:492] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:32.715145  4530 raft_consensus.cc:740] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:32.716391  4557 ts_tablet_manager.cc:1403] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.219s	user 0.022s	sys 0.010s
I20260709 12:13:32.719870  4557 raft_consensus.cc:359] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:32.716132  4530 consensus_queue.cc:260] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:32.720804  4557 raft_consensus.cc:740] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:32.721958  4557 consensus_queue.cc:260] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:32.726151  4557 ts_tablet_manager.cc:1434] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:13:32.728672  3203 tablet_copy_service.cc:342] P 7ac63b674f204bc4805ab989f8c965d3: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-f0fc559f70f94ad8b2da50624147942a received from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:32.729194  3203 tablet_copy_service.cc:434] P 7ac63b674f204bc4805ab989f8c965d3: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-f0fc559f70f94ad8b2da50624147942a on tablet f0fc559f70f94ad8b2da50624147942a with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:32.730876  4530 ts_tablet_manager.cc:1434] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:13:32.733938  3352 tablet_copy_service.cc:342] P eb49d92feeb14382b3baa49d696b6141: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-49089e729c0f4f37b66d40abf2e3cfe6 received from {username='slave'} at 127.0.0.1:52822
I20260709 12:13:32.734378  3352 tablet_copy_service.cc:434] P eb49d92feeb14382b3baa49d696b6141: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-49089e729c0f4f37b66d40abf2e3cfe6 on tablet 49089e729c0f4f37b66d40abf2e3cfe6 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:32.740021  3338 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.755787  3188 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.757542  4540 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:32.748281  4496 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:13:32.851135  3264 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.856789  4517 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:32.860162  4534 tablet_bootstrap.cc:492] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:13:32.868963  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 126458us
I20260709 12:13:32.861150  4534 tablet_bootstrap.cc:492] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:32.885954  3929 raft_consensus.cc:1217] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:13:32.876500  3289 debug-util.cc:398] Leaking SignalData structure 0x7b0800193fa0 after lost signal to thread 2020
W20260709 12:13:32.891777  3289 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6700 after lost signal to thread 3125
I20260709 12:13:32.891920  4534 ts_tablet_manager.cc:1403] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.508s	user 0.029s	sys 0.012s
W20260709 12:13:32.896488  3289 debug-util.cc:398] Leaking SignalData structure 0x7b08000580e0 after lost signal to thread 3217
I20260709 12:13:32.900089  4534 raft_consensus.cc:359] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:13:32.907892  3289 debug-util.cc:398] Leaking SignalData structure 0x7b08002f56e0 after lost signal to thread 3292
W20260709 12:13:32.909116  3289 debug-util.cc:398] Leaking SignalData structure 0x7b0800318320 after lost signal to thread 3366
W20260709 12:13:32.910256  3289 debug-util.cc:398] Leaking SignalData structure 0x7b0800347800 after lost signal to thread 3956
I20260709 12:13:32.901017  4534 raft_consensus.cc:740] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:32.913703  4534 consensus_queue.cc:260] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:32.917066  4534 ts_tablet_manager.cc:1434] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:13:32.947594  3278 tablet_copy_service.cc:342] P 1ef05c9d901046dca7fe0e638cc693b9: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-72176593f52b48c28602984ef9c8ee6b received from {username='slave'} at 127.0.0.1:40120
I20260709 12:13:32.948145  3278 tablet_copy_service.cc:434] P 1ef05c9d901046dca7fe0e638cc693b9: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-72176593f52b48c28602984ef9c8ee6b on tablet 72176593f52b48c28602984ef9c8ee6b with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:32.951694  3930 raft_consensus.cc:1217] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:33.027290  3929 raft_consensus.cc:1217] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:33.100240  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:33.183671  3929 raft_consensus.cc:1217] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:33.248663  3338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:46076
I20260709 12:13:33.249284  3338 raft_consensus.cc:606] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:33.252363  3264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "7ac63b674f204bc4805ab989f8c965d3"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:33.252921  3264 raft_consensus.cc:606] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Received request to transfer leadership to TS 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:33.256000  3264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "7ac63b674f204bc4805ab989f8c965d3"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:33.256549  3264 raft_consensus.cc:606] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Received request to transfer leadership to TS 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:33.259539  3338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:46076
I20260709 12:13:33.260155  3338 raft_consensus.cc:606] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:33.262698  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:33.264967  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:33.265877  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:33.322640  4495 raft_consensus.cc:1064] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:33.325414  4495 consensus_queue.cc:237] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:33.494793  3929 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:33.500033  4533 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:33.554474  3264 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:33.559615  4517 raft_consensus.cc:993] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:33.560194  4517 raft_consensus.cc:1081] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:33.560621  4583 raft_consensus.cc:1064] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:33.565454  4583 consensus_queue.cc:237] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:33.569166  4495 raft_consensus.cc:993] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:33.569698  4495 raft_consensus.cc:1081] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:33.587673  4559 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:33.591463  3192 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:33.595638  3263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:56754
I20260709 12:13:33.596232  3263 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.596624  3263 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.598243  4496 raft_consensus.cc:993] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower 7ac63b674f204bc4805ab989f8c965d3 to start an election
I20260709 12:13:33.598865  4496 raft_consensus.cc:993] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower 7ac63b674f204bc4805ab989f8c965d3 to start an election
I20260709 12:13:33.599584  4586 raft_consensus.cc:1081] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Signalling peer 7ac63b674f204bc4805ab989f8c965d3 to start an election
I20260709 12:13:33.604811  3263 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:33.605985  4495 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:33.606871  3263 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:33.609771  3267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:56754
I20260709 12:13:33.611349  3267 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.611765  3267 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.623541  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:33.624308  3340 raft_consensus.cc:3055] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:33.624847  3340 raft_consensus.cc:740] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:33.626502  3267 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:33.599375  4496 raft_consensus.cc:1081] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Signalling peer 7ac63b674f204bc4805ab989f8c965d3 to start an election
I20260709 12:13:33.632856  4533 raft_consensus.cc:1064] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:33.635486  4533 consensus_queue.cc:237] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:33.625753  3340 consensus_queue.cc:260] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:33.645908  3340 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.650192  3185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
 from {username='slave'} at 127.0.0.1:40510
I20260709 12:13:33.650876  3185 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.651296  3185 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.651371  3267 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:33.659638  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:33.660320  3192 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.662562  3193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
 from {username='slave'} at 127.0.0.1:40510
I20260709 12:13:33.663211  3193 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.663614  3193 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.666735  3185 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:33.669023  3929 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:33.671447  3930 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:33.670709  4495 raft_consensus.cc:2955] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:33.697515  3340 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:33.672732  3336 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:33.700484  4583 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:33.701730  4559 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:33.675143  3267 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:33.676934  3188 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:33.708083  4558 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:33.677131  3193 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:33.710350  4558 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:33.711051  3193 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:33.677883  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:33.712093  3338 raft_consensus.cc:3055] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:33.712453  3338 raft_consensus.cc:740] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:33.713270  3338 consensus_queue.cc:260] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:33.714519  3338 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.677996  3186 raft_consensus.cc:2955] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:33.679937  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:33.681879  3263 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:33.720050  3191 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.687011  3260 raft_consensus.cc:2955] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:33.689103  3192 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:33.729140  4543 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:33.733315  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:33.734001  3335 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.735806  4541 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:33.742805  3231 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:33.743695  4496 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:33.744213  4496 raft_consensus.cc:697] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:33.745194  4496 consensus_queue.cc:237] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:33.749994  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:33.750643  3267 raft_consensus.cc:3055] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:33.750973  3267 raft_consensus.cc:740] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:33.752808  3267 consensus_queue.cc:260] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:33.754495  3267 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.757011  3087 catalog_manager.cc:5697] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:33.761704  3191 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:33.766747  3335 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:33.781395  4547 raft_consensus.cc:1064] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:33.815403  4547 consensus_queue.cc:237] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:33.775993  3929 raft_consensus.cc:2955] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:33.803668  4583 raft_consensus.cc:2955] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:33.809295  3264 raft_consensus.cc:2955] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:33.829742  3231 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:33.830922  4592 raft_consensus.cc:2804] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.831475  4592 raft_consensus.cc:697] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:33.832489  4592 consensus_queue.cc:237] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:33.846742  3157 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:33.847770  4541 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.849150  4541 raft_consensus.cc:697] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:33.850114  4541 consensus_queue.cc:237] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:33.883440  3185 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:33.898259  3088 catalog_manager.cc:5697] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 2 to 3, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.909711  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:33.910723  3340 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.898259  3338 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
W20260709 12:13:33.923703  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 49870.2us
I20260709 12:13:33.934134  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:33.934872  3265 raft_consensus.cc:3055] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:33.935281  3265 raft_consensus.cc:740] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:33.936475  3265 consensus_queue.cc:260] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:33.937741  3265 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.959540  3336 raft_consensus.cc:2955] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:33.959967  4533 raft_consensus.cc:2955] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:13:33.961591  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:33.966421  3930 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:33.970841  3338 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:33.976989  3265 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:33.859031  3267 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:33.994350  4592 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:13:33.996601  3193 raft_consensus.cc:2955] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.002213  4528 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:34.011482  3186 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:34.031031  3931 raft_consensus.cc:2955] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.047101  3156 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:34.049479  4583 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:34.048709  3932 raft_consensus.cc:2955] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.050247  4583 raft_consensus.cc:697] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:34.052594  4583 consensus_queue.cc:237] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:34.059513  3340 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:34.075989  4586 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:34.094300  3264 raft_consensus.cc:2955] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.178211  3191 raft_consensus.cc:2955] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.157104  4496 raft_consensus.cc:2955] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.192584  3340 raft_consensus.cc:2955] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.207145  3930 raft_consensus.cc:2955] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.215571  3338 consensus_queue.cc:237] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:34.227176  3090 catalog_manager.cc:5697] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 1 to 2, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:34.230388  3090 catalog_manager.cc:5697] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:34.236528  3931 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:34.244179  3336 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:34.246054  4592 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:34.246263  4517 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:34.268893  3260 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:34.277446  4558 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:34.284121  4610 raft_consensus.cc:2955] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.292243  3931 raft_consensus.cc:2955] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.244601  3090 catalog_manager.cc:5697] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 2 to 3, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 3 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:34.299991  3191 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.298774  3090 catalog_manager.cc:5697] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 3 to 4, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.305328  3090 catalog_manager.cc:5697] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 2 to 3, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.306221  3260 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.313670  3336 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.316401  3260 raft_consensus.cc:2955] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.319162  4542 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:34.320292  4592 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:34.322484  4592 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:34.363752  3191 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:34.377175  3088 catalog_manager.cc:5697] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 2 to 3, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:34.380180  4592 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:34.388850  3336 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.391942  4541 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:34.415256  3191 consensus_queue.cc:237] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:34.410233  3336 consensus_queue.cc:237] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:34.436792  3338 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:34.440690  3090 catalog_manager.cc:5697] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.444355  4583 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:34.420244  3260 consensus_queue.cc:237] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:34.456894  4541 raft_consensus.cc:2955] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.469349  3335 raft_consensus.cc:2955] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.474498  3182 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e285af011d44cfc91bcd6499aa4c9f8 with delete_type TABLET_DATA_TOMBSTONED (TS 7ac63b674f204bc4805ab989f8c965d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40488
I20260709 12:13:34.478449  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:34.461129  3931 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:34.480507  4542 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:34.488014  3930 raft_consensus.cc:2955] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.525785  3076 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5e285af011d44cfc91bcd6499aa4c9f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:34.553434  3087 catalog_manager.cc:5697] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 4 to 5, VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) evicted. New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:34.594283  3339 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:13:34.597211  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 46160.1us
I20260709 12:13:34.598819  3185 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:34.605321  4632 tablet_replica.cc:333] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
W20260709 12:13:34.656483  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 48854.2us
I20260709 12:13:34.664201  3930 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:34.667464  4586 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:13:34.766860  4632 raft_consensus.cc:2243] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.767715  4632 raft_consensus.cc:2272] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.746623  3260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "132b388f4bf24fd482334847aadc601a"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:34.771920  3260 raft_consensus.cc:606] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:34.808264  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 222685us
W20260709 12:13:34.816836  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 238003us
I20260709 12:13:34.836371  3193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:34.837165  3193 raft_consensus.cc:606] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Received request to transfer leadership to TS 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:34.852141  3930 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:34.865836  4610 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:13:34.880743  4632 ts_tablet_manager.cc:1916] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:34.865082  4542 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:13:34.869369  4592 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 12:13:34.908878  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 239525us
I20260709 12:13:34.962020  3267 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:34.972033  3250 tablet_service.cc:1558] Processing DeleteTablet for tablet f0fc559f70f94ad8b2da50624147942a with delete_type TABLET_DATA_TOMBSTONED (TS 1ef05c9d901046dca7fe0e638cc693b9 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:35.013403  3264 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:13:35.038232  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 191301us
W20260709 12:13:35.042820  4611 log.cc:927] Time spent T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:13:35.031378  4644 raft_consensus.cc:2955] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:35.056836  4637 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:13:35.091683  4495 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:35.069494  4517 raft_consensus.cc:2955] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:35.111860  4649 tablet_replica.cc:333] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
W20260709 12:13:35.124171  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 99125.9us
I20260709 12:13:35.127065  3930 raft_consensus.cc:2955] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:13:35.131675  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 107842us
I20260709 12:13:35.142952  3191 raft_consensus.cc:2955] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:35.171315  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f0fc559f70f94ad8b2da50624147942a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:35.182890  3929 raft_consensus.cc:2955] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:35.186334  3262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:35.186982  3262 raft_consensus.cc:606] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:35.197757  4649 raft_consensus.cc:2243] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.242883  3090 catalog_manager.cc:5697] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New cstate: current_term: 1 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:35.257225  4649 raft_consensus.cc:2272] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.285254  4637 raft_consensus.cc:993] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: : Instructing follower 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:35.292984  4637 raft_consensus.cc:1081] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Signalling peer 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:13:35.311757  4645 raft_consensus.cc:993] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower eb49d92feeb14382b3baa49d696b6141 to start an election
W20260709 12:13:35.324414  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 102983us
I20260709 12:13:35.335143  3262 raft_consensus.cc:2955] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:35.380203  4641 raft_consensus.cc:1081] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Signalling peer eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:36.182601  4632 ts_tablet_manager.cc:1929] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:36.452114  4632 log.cc:1199] T 5e285af011d44cfc91bcd6499aa4c9f8 P 7ac63b674f204bc4805ab989f8c965d3: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/wals/5e285af011d44cfc91bcd6499aa4c9f8
I20260709 12:13:36.454022  4632 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40488 (request call id 81) took 1980 ms. Trace:
I20260709 12:13:36.454567  4632 rpcz_store.cc:276] 0709 12:13:34.474061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.474195 (+   134us) service_pool.cc:224] Handling call
0709 12:13:34.604896 (+130701us) ts_tablet_manager.cc:1151] Deleting tablet 5e285af011d44cfc91bcd6499aa4c9f8
0709 12:13:34.604983 (+    87us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:13:35.147781 (+542798us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:36.182425 (+1034644us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:36.453882 (+271457us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79813,"tablet-delete.queue_time_us":120492,"thread_start_us":72783,"threads_started":1}
I20260709 12:13:36.183784  4649 ts_tablet_manager.cc:1916] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:36.459884  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1144) took 1263 ms. Trace:
W20260709 12:13:36.256058  3233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.013s	sys 0.000s
I20260709 12:13:36.259531  3263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1540) took 1056 ms. Trace:
W20260709 12:13:36.460625  3233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.013s	sys 0.000s
I20260709 12:13:36.460759  3263 rpcz_store.cc:276] 0709 12:13:35.202931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.204212 (+  1281us) service_pool.cc:224] Handling call
0709 12:13:35.204520 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:35.204832 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.204858 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:35.219500 (+ 14642us) log.cc:844] Serialized 26 byte log entry
0709 12:13:35.668344 (+448844us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:35.668416 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.668532 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:36.259136 (+590604us) raft_consensus.cc:1685] finished
0709 12:13:36.259163 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:36.259359 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11195,"raft.queue_time_us":8969,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":17728,"thread_start_us":408777,"threads_started":1,"wal-append.queue_time_us":1021432}
W20260709 12:13:36.259860  3308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.000s	sys 0.002s
I20260709 12:13:36.461779  3262 rpcz_store.cc:276] 0709 12:13:35.196191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.197021 (+   830us) service_pool.cc:224] Handling call
0709 12:13:35.214017 (+ 16996us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:35.214361 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.214393 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:35.229044 (+ 14651us) log.cc:844] Serialized 494 byte log entry
0709 12:13:35.334612 (+105568us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:36.459274 (+1124662us) log.cc:844] Serialized 14 byte log entry
0709 12:13:36.459549 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.459624 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:36.459667 (+    43us) raft_consensus.cc:1685] finished
0709 12:13:36.459687 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:36.459820 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3149,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"thread_start_us":105278,"threads_started":1,"wal-append.queue_time_us":871605}
W20260709 12:13:36.265771  3306 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.001s	sys 0.005s
W20260709 12:13:36.463881  3306 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.001s	sys 0.005s
W20260709 12:13:36.263713  3232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.010s	sys 0.037s
W20260709 12:13:36.269403  3895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.007s	sys 0.015s
W20260709 12:13:36.464280  3232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.189s	user 0.011s	sys 0.037s
W20260709 12:13:36.464524  3895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.007s	sys 0.015s
I20260709 12:13:36.282789  4660 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:36.465269  4660 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:36.265164  3898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.007s	sys 0.003s
W20260709 12:13:36.395396  3897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.008s	sys 0.010s
I20260709 12:13:36.443041  4667 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:13:36.254638  3896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.010s	sys 0.011s
W20260709 12:13:36.463389  3308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.000s	sys 0.002s
W20260709 12:13:36.467593  3896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.011s	sys 0.011s
W20260709 12:13:36.464619  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 1.19538e+06us
I20260709 12:13:36.468400  4667 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.435943  3075 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 72176593f52b48c28602984ef9c8ee6b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:13:36.467010  3898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.008s	sys 0.003s
I20260709 12:13:36.475616  4660 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.476576  4668 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.477458  4616 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.477190  4668 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.478034  4616 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.479594  4531 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.480007  4653 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.480408  4616 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.480232  4531 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.480602  4653 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.481817  4664 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.481959  4652 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.482676  4531 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.424436  4596 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.482365  4664 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.482625  4652 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.483867  4635 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.484472  4635 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.484952  4664 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.485215  4652 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.485800  4652 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.486332  4652 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.486939  4635 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.487354  4664 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.487658  4596 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.487944  4664 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.490121  4596 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.490705  4664 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.471015  4667 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.493976  4558 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.494580  4558 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.497306  4558 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:36.498157  3897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.009s	sys 0.010s
I20260709 12:13:36.498015  4558 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:36.499588  4636 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:36.500396  4636 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.505110  4636 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.506124  4668 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.506784  4668 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.507038  4588 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.507510  4668 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.507625  4588 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.516935  4588 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.533586  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:36.536257  4674 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.536511  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:36.536849  4674 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.539091  4674 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.540745  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:36.543857  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:36.545598  3336 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 1.
I20260709 12:13:36.512696  4558 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.550187  4558 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.551564  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:36.552433  4596 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:36.553176  4596 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.532302  4588 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.548141  4651 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:13:36.540311  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 89000.2us
I20260709 12:13:36.556102  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:36.556854  4675 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:36.557458  4588 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.558578  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:36.579119  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:36.559746  4653 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.564884  4668 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.565948  4652 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.577903  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:36.582558  3262 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:36.574836  4528 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.591013  4596 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.591629  4528 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.582743  4649 ts_tablet_manager.cc:1929] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:13:36.593587  4588 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.593817  4649 log.cc:1199] T f0fc559f70f94ad8b2da50624147942a P 1ef05c9d901046dca7fe0e638cc693b9: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/wals/f0fc559f70f94ad8b2da50624147942a
I20260709 12:13:36.566725  4651 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.584195  4496 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.593601  4528 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.596819  4674 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.595026  4649 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56750 (request call id 79) took 1664 ms. Trace:
I20260709 12:13:36.583585  4675 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.608805  4649 rpcz_store.cc:276] 0709 12:13:34.942066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.959478 (+ 17412us) service_pool.cc:224] Handling call
0709 12:13:35.049165 (+ 89687us) ts_tablet_manager.cc:1151] Deleting tablet f0fc559f70f94ad8b2da50624147942a
0709 12:13:35.049228 (+    63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:13:36.513608 (+1464380us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:36.580517 (+ 66909us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:36.594941 (+ 14424us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81605,"tablet-delete.queue_time_us":76445,"thread_start_us":76562,"threads_started":1}
I20260709 12:13:36.609964  4653 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.600323  4496 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.607364  4676 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.608161  4586 raft_consensus.cc:993] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9: : Instructing follower eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:36.608129  4651 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.616161  4558 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.616248  4665 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.614259  4636 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.610801  3075 catalog_manager.cc:5028] TS 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): tablet f0fc559f70f94ad8b2da50624147942a (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:36.615623  4495 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.617343  4495 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.612396  4653 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.616781  4558 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.597388  4674 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.619077  4495 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.619812  4653 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.619948  4558 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.620265  4674 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.615163  3076 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 49089e729c0f4f37b66d40abf2e3cfe6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:36.616920  3896 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:36.618430  4665 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.621085  4636 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.624873  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:36.625530  3263 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 1.
I20260709 12:13:36.625778  4675 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.624884  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:36.627571  4663 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.627985  4663 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.628356  4663 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.629084  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:36.629305  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:36.622217  4651 raft_consensus.cc:1081] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Signalling peer eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:36.630605  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:36.630597  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:36.630875  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:36.622758  4678 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.631964  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:36.628937  4664 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.631505  4588 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.638595  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:36.639547  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:36.634724  4496 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.626740  4676 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.647606  4588 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.649385  4676 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.650193  4588 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.653537  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:36.646513  4664 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.656889  4636 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.635039  4678 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.663476  4664 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.639345  4665 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.660869  4678 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.667990  4678 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:36.668515  4678 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.670709  4663 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.674623  4674 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.675125  4679 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.676017  4674 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.676970  4679 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.685016  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:36.685765  4679 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.686295  4679 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.678311  4673 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.689718  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:36.689198  4679 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.691131  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:36.691779  3185 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 1.
I20260709 12:13:36.688089  4678 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.693127  4674 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:36.693151  3157 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.436s	user 0.015s	sys 0.011s
W20260709 12:13:36.700521  3157 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.444s	user 0.016s	sys 0.011s
W20260709 12:13:36.700961  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 1.44432e+06us
I20260709 12:13:36.702907  3075 catalog_manager.cc:5028] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): tablet 5e285af011d44cfc91bcd6499aa4c9f8 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:36.704378  3088 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48778 (request call id 273) took 1513 ms. Trace:
I20260709 12:13:36.704816  3088 rpcz_store.cc:276] 0709 12:13:35.190990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.191166 (+   176us) service_pool.cc:224] Handling call
0709 12:13:36.704291 (+1513125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":512,"reported_tablets":1}
I20260709 12:13:36.693811  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:36.694887  4663 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.707382  4663 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.707629  4678 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.707888  4663 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.708307  4678 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.708907  4674 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.709442  4674 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.710271  4663 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.710783  4663 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.710809  4678 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.696645  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:36.712293  3188 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 1.
I20260709 12:13:36.711971  4663 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.689785  4673 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.699290  4664 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.693151  4679 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.711597  4674 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.694346  4682 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.723345  4674 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.714802  4663 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.724215  4674 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.770220  4678 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.723356  4682 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.714931  4673 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.773999  4678 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.776800  4674 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.776899  4686 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.767820  4679 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.777541  4686 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.768584  4664 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.781399  4685 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.780205  4679 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.782560  4685 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.789151  4664 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.790686  4679 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.791399  4682 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.791999  4676 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.792618  4676 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.794898  4676 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.795419  4676 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.795918  4676 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.798090  4676 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.798584  4676 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.799319  4676 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.801081  4686 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.801478  4676 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.802335  4685 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:36.804086  4676 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.804629  4676 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.806671  4676 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.806721  3188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9796736c241b42c283a7f6a433742bed"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:36.807483  3188 raft_consensus.cc:606] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:36.811353  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:36.825466  4676 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.826018  4676 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.828135  4676 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.828286  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:36.838191  3186 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.554s	user 0.018s	sys 0.018s
W20260709 12:13:36.839500  3186 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.559s	user 0.020s	sys 0.018s
I20260709 12:13:36.845315  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:36.848038  3192 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 1.
I20260709 12:13:36.851648  3186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40510 (request call id 1542) took 1652 ms. Trace:
I20260709 12:13:36.852151  3186 rpcz_store.cc:276] 0709 12:13:35.199765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.201397 (+  1632us) service_pool.cc:224] Handling call
0709 12:13:35.228732 (+ 27335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.240536 (+ 11804us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:36.839989 (+1599453us) log.cc:844] Serialized 14 byte log entry
0709 12:13:36.851171 (+ 11182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:36.851233 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:36.851284 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.851364 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:36.851521 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1012221,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":119,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"thread_start_us":1571725,"threads_started":2,"wal-append.queue_time_us":9817}
I20260709 12:13:36.878549  4687 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.879390  4687 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.881122  4673 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.881948  4673 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.894358  4687 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.894912  4685 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.895200  4687 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.895553  4685 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.895901  4687 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.897073  4674 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.897657  4674 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.899187  4687 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.899669  4650 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.899804  4687 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.900847  4642 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.881230  4686 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.901430  4642 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.899588  4679 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.914636  4679 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.908800  4650 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.904597  4674 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.902012  4665 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.920571  4665 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.909955  4686 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.910698  4687 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.927901  4685 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.923374  4665 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.931335  4650 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.939105  4650 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:36.940025  4650 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.930084  4642 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.932433  4665 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:36.941577  4665 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:36.943871  4665 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.947175  4673 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.945763  4650 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:36.948035  4687 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.972287  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:36.973569  4664 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:36.978421  4664 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:36.980801  4664 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:36.982159  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:36.990832  3895 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:36.992853  4664 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.009783  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.011188  3895 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:37.012223  4664 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.012647  4664 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:37.013047  4664 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.017207  4678 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:37.018493  3895 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:37.021754  4663 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.023293  3895 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:37.032267  4610 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:37.032851  4610 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.033421  4591 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:37.033998  4591 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.035000  4610 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:37.035519  4610 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:37.036090  4591 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:37.036192  4610 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.038372  4610 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:37.039247  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.046357  3263 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 1.
I20260709 12:13:37.048089  4663 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.048564  4663 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:37.048959  4663 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.064019  3895 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:37.065219  4668 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.065631  4668 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:37.065553  4663 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.066112  4668 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.067920  4663 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:37.069478  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.070127  3189 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 1.
I20260709 12:13:37.075644  4664 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.077800  4664 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:37.074609  4668 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.079917  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.080116  4668 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:37.080621  3189 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 1.
I20260709 12:13:37.081837  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:37.082444  3189 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.089519  3090 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34704 (request call id 172) took 1917 ms. Trace:
I20260709 12:13:37.092327  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:37.093144  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:37.093912  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:37.095902  3182 tablet_service.cc:1558] Processing DeleteTablet for tablet 49089e729c0f4f37b66d40abf2e3cfe6 with delete_type TABLET_DATA_TOMBSTONED (TS 7ac63b674f204bc4805ab989f8c965d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40488
I20260709 12:13:37.096092  3193 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.104209  4496 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:37.105123  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:37.104861  4496 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.105669  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:37.106511  3088 catalog_manager.cc:5697] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 3 to 4, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.107349  4496 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:37.108168  4619 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:37.108450  4676 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:37.116854  4619 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.108029  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:37.110368  4592 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:37.118393  4592 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.119019  4619 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:37.110810  4528 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:37.119697  4528 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.121570  3089 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48764 (request call id 290) took 1979 ms. Trace:
I20260709 12:13:37.121814  4528 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:37.111073  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.111131  4679 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:37.111244  4675 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:37.124217  3262 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 1.
I20260709 12:13:37.124415  4675 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.125347  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.121942  3089 rpcz_store.cc:276] 0709 12:13:35.142227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.142349 (+   122us) service_pool.cc:224] Handling call
0709 12:13:37.121504 (+1979155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92397,"reported_tablets":3}
I20260709 12:13:37.126583  4675 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:37.112812  4651 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:37.127305  4651 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.129561  4651 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:37.114049  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.130275  3264 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:37.114161  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:37.114787  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.136571  3267 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:37.105749  3931 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:13:37.137022  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:37.089948  3090 rpcz_store.cc:276] 0709 12:13:35.172365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.172490 (+   125us) service_pool.cc:224] Handling call
0709 12:13:37.089448 (+1916958us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:36.611609 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:36.613456 (+  1847us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:36.613502 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:13:36.613520 (+    18us) tablet.cc:662] Decoding operations
0709 12:13:36.613851 (+   331us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:36.613922 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:36.613955 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:36.614173 (+   218us) tablet.cc:701] Row locks acquired
0709 12:13:36.614191 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:13:36.614342 (+   151us) write_op.cc:270] Start()
0709 12:13:36.614441 (+    99us) write_op.cc:276] Timestamp: P: 1783599216614290 usec, L: 0
0709 12:13:36.614462 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:13:36.616304 (+  1842us) log.cc:844] Serialized 533 byte log entry
0709 12:13:36.691747 (+ 75443us) op_driver.cc:464] REPLICATION: finished
0709 12:13:36.716743 (+ 24996us) write_op.cc:301] APPLY: starting
0709 12:13:36.716835 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:36.716943 (+   108us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:36.717079 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:36.717286 (+   207us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:36.717442 (+   156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:36.717501 (+    59us) write_op.cc:312] APPLY: finished
0709 12:13:36.772452 (+ 54951us) log.cc:844] Serialized 23 byte log entry
0709 12:13:36.778131 (+  5679us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:36.778851 (+   720us) write_op.cc:454] Released schema lock
0709 12:13:36.779899 (+  1048us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:36.786209 (+  6310us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:36.786248 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8365,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":24736,"apply.run_cpu_time_us":2075,"apply.run_wall_time_us":67262,"num_ops":1,"prepare.queue_time_us":113121,"prepare.run_cpu_time_us":19026,"prepare.run_wall_time_us":60010,"raft.queue_time_us":14968,"raft.run_cpu_time_us":4950,"raft.run_wall_time_us":25187,"replication_time_us":76924,"thread_start_us":167263,"threads_started":4,"wal-append.queue_time_us":54266}]]}
I20260709 12:13:37.116940  4676 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.137728  3929 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:13:37.108623  4547 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:37.139719  4676 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:37.139575  4547 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.140658  4592 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:37.141865  4547 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:37.138763  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:37.144065  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:37.144682  3186 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.145650  3932 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.147805  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.147981  3232 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:37.149813  3232 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:37.150583  4592 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.151140  4592 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:37.138684  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:37.151678  4592 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.151978  3930 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:13:37.160298  4676 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.160729  4676 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:37.161120  4676 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.160900  4646 consensus_queue.cc:1059] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:37.162307  4547 raft_consensus.cc:3055] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:37.162691  4547 raft_consensus.cc:740] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:37.163595  4547 consensus_queue.cc:260] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.168112  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.169687  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.168190  4687 raft_consensus.cc:993] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:37.171159  4687 raft_consensus.cc:1081] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:37.171273  3232 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:37.170819  4676 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.174680  4646 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.176663  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.178694  4592 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.180521  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.181331  3187 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:37.182513  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.182637  4646 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:37.182981  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:37.183343  4646 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.183800  3932 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.178392  3156 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:37.174552  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.175122  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.177438  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.177999  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:37.177723  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.188341  3188 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:37.175303  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.188210  3930 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.192456  4558 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:37.193030  4558 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.194150  4652 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:37.194659  4652 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.195256  4558 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:37.195573  4517 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:37.195816  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.196131  4517 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.197286  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.197644  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.198206  4517 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:37.198580  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.198863  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:37.199020  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.199249  3339 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:37.176247  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.178234  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.198953  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.202493  3333 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:37.201395  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.203405  3335 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:37.203768  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.203958  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.204402  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.204852  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.204502  3336 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:37.206982  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.202780  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.208370  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.209175  3336 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:37.211227  4652 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:37.211925  3339 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:37.212077  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.214556  3930 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:37.217808  3932 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:37.219880  3263 raft_consensus.cc:1240] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.221913  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.223985  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.204450  3342 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:37.227020  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.227810  3335 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:37.176457  4676 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:37.253532  3232 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:37.252377  4679 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.271601  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.265138  3232 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:37.173592  4547 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.258648  3895 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:37.277632  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:37.253573  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.247124  4592 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:37.309895  3193 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:37.302824  3189 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:37.319345  3192 raft_consensus.cc:1240] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.283360  4679 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:37.321146  4679 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.292780  4588 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.271508  4643 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:37.293272  4645 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:37.322963  4588 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:37.327770  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.302624  4546 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:13:37.378216  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 100698us
I20260709 12:13:37.385475  3895 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:37.303936  4668 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.375177  4664 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:37.374914  4666 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:37.319483  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.397570  3193 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:37.387405  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.399047  3333 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:37.394170  3157 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:37.328576  4645 raft_consensus.cc:697] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:37.390239  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.378080  4643 raft_consensus.cc:697] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:37.389825  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.396034  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.396086  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.388263  3895 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:37.360587  4588 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.403605  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.403918  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.402567  3157 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:37.405241  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:37.407188  3335 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:37.410591  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.410952  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:37.411741  3335 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.396852  4655 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.409464  3157 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:37.408344  3895 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:37.416836  3895 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:37.415402  3157 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:37.418454  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.419245  3157 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:37.400067  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.405733  4646 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.395746  4546 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.402423  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.441421  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.405278  4638 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.424278  3157 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:37.441504  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.450708  3930 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:55438
I20260709 12:13:37.451797  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.409308  4687 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.453495  4643 consensus_queue.cc:237] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.454177  4687 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:37.454710  4687 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.456418  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.457690  3932 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.399850  4666 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.421314  4673 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.416776  4668 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.463115  3931 raft_consensus.cc:1240] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.463289  3267 raft_consensus.cc:1813] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Handling vote request from an unknown peer 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:37.466001  3267 raft_consensus.cc:2393] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 2: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:37.466575  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.400326  4664 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.475557  4664 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:37.459393  4674 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.442484  4685 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.477811  4674 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:37.477990  4685 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:37.478266  4674 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.478397  4685 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.435523  4663 raft_consensus.cc:2764] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:13:37.423100  4678 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.484251  3930 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:37.484966  3930 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.485893  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.422837  4670 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.448213  4686 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:37.472218  4646 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:37.502049  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:37.417903  4655 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:37.490314  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:37.461519  4558 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:37.441015  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:37.513827  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:37.502352  3335 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:37.461581  4620 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:37.462134  4673 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:37.514504  3929 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:37.463816  4638 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:37.473786  4546 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:37.464969  4668 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:37.484494  4678 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
W20260709 12:13:37.512244  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 63632.8us
I20260709 12:13:37.506582  4655 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.497243  4670 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:37.518983  3930 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.525017  3157 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:37.481559  3186 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:37.531222  3932 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.533257  3157 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:37.512475  4650 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:37.521044  4691 tablet_replica.cc:333] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:13:37.439879  4645 consensus_queue.cc:237] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.537529  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.538420  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.539326  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.529367  3928 raft_consensus.cc:1240] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.519618  4673 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.534358  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:37.504268  4592 consensus_queue.cc:1059] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:13:37.520063  4638 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.535653  4546 raft_consensus.cc:2804] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:37.515375  4558 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.525362  4668 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.548022  3338 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:37.551187  3339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:58568
I20260709 12:13:37.531595  4678 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.533282  4670 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.555742  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:37.559814  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 136179us
I20260709 12:13:37.560020  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.561290  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.467324  4679 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.570779  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.516239  4620 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.582883  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.584832  3895 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:37.585697  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.589186  3895 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:37.557729  4666 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:37.556636  4686 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.560019  4546 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:37.547837  4650 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:37.556131  4588 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:37.573577  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:37.830821  4691 raft_consensus.cc:2243] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.832098  4691 raft_consensus.cc:2272] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.832610  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:37.835065  4691 ts_tablet_manager.cc:1916] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:13:37.837809  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 248723us
I20260709 12:13:37.838896  3895 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:37.831112  4686 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:37.647840  3336 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.840147  3895 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:37.841493  3188 raft_consensus.cc:1240] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:37.623865  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 90702.8us
I20260709 12:13:37.636286  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:37.682073  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.627528  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.852664  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.851979  3263 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:37.680333  4592 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:37.863382  3268 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.852497  4640 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.842092  4546 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:37.596169  4663 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:37.685094  3214 debug-util.cc:398] Leaking SignalData structure 0x7b08001ed260 after lost signal to thread 2020
I20260709 12:13:37.838625  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.843134  4686 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.859828  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:37.663870  4620 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:37.621862  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.873723  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.622557  4697 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.874217  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:37.860234  4531 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:37.876552  4588 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:37.888193  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.873260  4640 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:37.994724  3267 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:37.896025  3263 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:37.897430  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.998672  3262 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:37.899029  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.049587  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:37.862957  4592 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:38.046015  4697 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:38.057268  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:38.062328  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.021849  4640 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:38.066051  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 225953us
I20260709 12:13:38.066926  3895 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:38.067236  3262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9796736c241b42c283a7f6a433742bed"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:56758
W20260709 12:13:38.056839  3214 debug-util.cc:398] Leaking SignalData structure 0x7b0800128860 after lost signal to thread 3125
I20260709 12:13:38.047920  4531 raft_consensus.cc:697] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:38.071758  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:37.892004  4685 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:38.076165  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.068127  3262 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:38.073935  3895 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:38.089164  3262 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.092244  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:38.092151  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 249400us
W20260709 12:13:38.136926  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 44314.6us
I20260709 12:13:38.079591  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:38.138101  3264 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:38.143342  3157 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:38.060806  4697 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.158313  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:38.159106  3264 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.163724  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:38.164752  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:38.152021  4687 consensus_meta.cc:287] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.697s	user 0.011s	sys 0.001s
I20260709 12:13:38.194442  3895 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:38.142683  4620 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:38.136471  4694 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:38.088574  3342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "132b388f4bf24fd482334847aadc601a"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:58568
W20260709 12:13:38.198158  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 307906us
I20260709 12:13:38.140772  4679 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:38.207492  4706 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.155303  4645 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:13:38.233129  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 75620.5us
I20260709 12:13:38.196098  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:38.252099  4650 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:38.196209  4710 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:38.196152  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:38.254422  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:38.232838  3214 debug-util.cc:398] Leaking SignalData structure 0x7b0800318e40 after lost signal to thread 3217
I20260709 12:13:38.253280  3189 raft_consensus.cc:2393] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:38.263463  4531 consensus_queue.cc:237] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:38.236756  3342 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:38.264516  4710 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:38.303645  4700 log.cc:927] Time spent T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:13:38.283027  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.304833  3337 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:38.305509  3337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58564 (request call id 1439) took 1080 ms. Trace:
I20260709 12:13:38.305907  3337 rpcz_store.cc:276] 0709 12:13:37.224820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.252835 (+ 28015us) service_pool.cc:224] Handling call
0709 12:13:38.048162 (+795327us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5800042698. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:13:38.305412 (+257250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33012608}
W20260709 12:13:38.265691  4673 consensus_meta.cc:287] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.701s	user 0.006s	sys 0.005s
I20260709 12:13:38.213915  4687 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:38.265283  4679 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.333455  4679 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:38.333963  4679 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:38.387815  3156 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.638s (SENT)
I20260709 12:13:38.289186  3342 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.247030  4645 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:38.441032  4708 log.cc:927] Time spent T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:13:38.444190  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:38.450567  4558 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:38.340793  4673 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:38.456375  4699 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:38.457034  4699 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:38.462018  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:38.465565  3189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40494 (request call id 1263) took 1254 ms. Trace:
I20260709 12:13:38.466104  3189 rpcz_store.cc:276] 0709 12:13:37.211097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.320488 (+109391us) service_pool.cc:224] Handling call
0709 12:13:38.465255 (+1144767us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54000bed54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:38.465466 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1721423744}
I20260709 12:13:38.450925  4687 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:38.486754  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 266866us
I20260709 12:13:38.487697  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:38.488376  3265 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.490518  3896 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:38.492753  3896 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:38.493757  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.507472  3264 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:38.511637  3265 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:38.550040  3927 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:38.526376  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:38.527191  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 390235us
I20260709 12:13:38.509285  4673 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:38.531634  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 337250us
I20260709 12:13:38.551927  3157 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:38.551954  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:38.534401  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:38.552846  3333 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.509187  4685 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:38.551054  3262 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:38.525316  3214 debug-util.cc:398] Leaking SignalData structure 0x7b0800376c60 after lost signal to thread 3292
I20260709 12:13:38.525363  4588 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.542749  3930 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:38.560190  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:55438 (request call id 519) took 1109 ms. Trace:
I20260709 12:13:38.560287  3262 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:38.560545  3930 rpcz_store.cc:276] 0709 12:13:37.450297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.450588 (+   291us) service_pool.cc:224] Handling call
0709 12:13:38.528763 (+1078175us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b5400373f54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5c4a3d 00007f1af3594cd0 00007f1aecb19254 00007f1aecb191e2 00007f1aecb19111 00007f1aecb1908c 00007f1aecb18342 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:38.560109 (+ 31346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75557120}
I20260709 12:13:38.561555  3333 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
W20260709 12:13:38.568406  4668 consensus_meta.cc:287] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.990s	user 0.009s	sys 0.002s
I20260709 12:13:38.568859  4668 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:38.569345  4678 consensus_meta.cc:287] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.983s	user 0.011s	sys 0.003s
I20260709 12:13:38.569752  4678 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:38.563535  4694 raft_consensus.cc:697] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:38.571023  4668 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:38.571676  4694 consensus_queue.cc:237] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:38.572762  4670 consensus_meta.cc:287] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.978s	user 0.004s	sys 0.017s
I20260709 12:13:38.573398  4670 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:38.575009  3932 raft_consensus.cc:1240] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.568455  4696 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:38.576812  4696 raft_consensus.cc:697] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:38.577513  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.578195  3188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1252) took 1377 ms. Trace:
I20260709 12:13:38.531744  4620 raft_consensus.cc:697] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:38.583488  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.585664  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.578544  3188 rpcz_store.cc:276] 0709 12:13:37.200343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.240617 (+ 40274us) service_pool.cc:224] Handling call
0709 12:13:37.253134 (+ 12517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.841947 (+588813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.577963 (+736016us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54000be354. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:38.578135 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":888593152}
I20260709 12:13:38.537277  4687 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:38.588198  3930 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:38.584391  4697 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:38.587884  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 93598us
I20260709 12:13:38.614761  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:38.617863  3926 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.621605  3157 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:38.625828  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 238066us
I20260709 12:13:38.628834  3185 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.630252  3188 raft_consensus.cc:1240] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.632063  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:38.632736  3185 raft_consensus.cc:3055] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.633100  3185 raft_consensus.cc:740] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:38.623258  3157 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:38.640657  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.641034  3895 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:38.635869  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:38.657577  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:38.581411  4645 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:38.617151  3214 debug-util.cc:398] Leaking SignalData structure 0x7b08002dae80 after lost signal to thread 3366
I20260709 12:13:38.585286  4685 raft_consensus.cc:2804] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.654740  3929 raft_consensus.cc:1240] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.655009  3895 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:38.656929  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:38.633883  3185 consensus_queue.cc:260] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:38.624454  4687 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:38.588778  4699 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:38.662940  3328 tablet_service.cc:1558] Processing DeleteTablet for tablet 72176593f52b48c28602984ef9c8ee6b with delete_type TABLET_DATA_TOMBSTONED (TS eb49d92feeb14382b3baa49d696b6141 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:38.639704  4673 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.669348  3305 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:38.670518  4620 consensus_queue.cc:237] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:38.671550  4670 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:38.702785  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:38.703361  3188 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:13:38.672312  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.704375  3335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58568 (request call id 1721) took 1149 ms. Trace:
I20260709 12:13:38.704732  3335 rpcz_store.cc:276] 0709 12:13:37.554924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.555109 (+   185us) service_pool.cc:224] Handling call
0709 12:13:38.672161 (+1117052us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5800042698. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:13:38.704311 (+ 32150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4532608}
I20260709 12:13:38.705853  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.577925  4696 consensus_queue.cc:237] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:38.692768  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:38.663903  4547 consensus_meta.cc:287] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 1.371s	user 0.009s	sys 0.078s
I20260709 12:13:38.693727  3185 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.695168  4685 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:38.664354  4678 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:38.698132  4704 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:13:38.699723  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 44790us
I20260709 12:13:38.700961  3305 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:38.699014  4673 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:38.702279  4652 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.724540  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:38.700932  4655 consensus_meta.cc:287] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 1.160s	user 0.002s	sys 0.012s
I20260709 12:13:38.712863  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:38.712906  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.734946  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:38.662292  4705 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.699788  4695 consensus_queue.cc:1059] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:13:38.697805  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:38.702271  4663 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.723476  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:38.743029  3185 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:38.707906  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:38.725752  4697 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:38.744740  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.745318  4592 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:38.745990  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:13:38.746438  4686 consensus_meta.cc:287] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.008s
I20260709 12:13:38.725905  4704 raft_consensus.cc:697] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:38.726686  4650 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.729833  4673 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.760710  4704 consensus_queue.cc:237] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:38.735524  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:38.668359  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 325505us
I20260709 12:13:38.763818  3231 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:38.765108  3231 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:38.765298  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:38.766448  3231 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:38.766673  4547 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.736261  4653 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.768455  3231 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:38.769861  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:38.724356  3214 debug-util.cc:398] Leaking SignalData structure 0x7b080036e120 after lost signal to thread 3956
I20260709 12:13:38.740379  4678 raft_consensus.cc:3055] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:13:38.742908  4674 consensus_meta.cc:287] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 1.264s	user 0.013s	sys 0.003s
I20260709 12:13:38.746662  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.747654  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:13:38.748142  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 50479.1us
I20260709 12:13:38.783484  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:38.783660  3231 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:38.748354  3895 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:38.748862  4671 raft_consensus.cc:3055] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.752154  3342 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:38.735831  4645 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.755053  3923 raft_consensus.cc:1240] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.759647  4695 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.760969  4687 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:38.767308  4592 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.771662  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:38.767760  4653 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:38.774315  4705 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:38.773488  4643 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.773772  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:38.776335  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:38.730858  4702 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:38.835700  3268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1567) took 1332 ms. Trace:
I20260709 12:13:38.737555  3305 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:38.836107  3268 rpcz_store.cc:276] 0709 12:13:37.503957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.504137 (+   180us) service_pool.cc:224] Handling call
0709 12:13:37.518889 (+ 14752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.863866 (+344977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.835468 (+971602us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54003f07d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:38.835634 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791832320}
I20260709 12:13:38.716897  4685 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.787941  4712 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.785880  3231 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:38.804598  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:38.746860  4686 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:38.808765  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:38.772481  4718 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.777438  4678 raft_consensus.cc:740] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:38.817251  4653 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.819262  3342 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:38.804260  4697 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:38.854089  4697 raft_consensus.cc:697] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:38.787112  4671 raft_consensus.cc:740] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:38.823609  4701 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:38.825814  3336 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.828687  3261 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:38.829160  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:38.832719  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 292) took 1090 ms. Trace:
W20260709 12:13:38.833173  4640 consensus_meta.cc:287] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.689s	user 0.015s	sys 0.000s
I20260709 12:13:38.833475  4723 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:38.836529  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 99582.9us
I20260709 12:13:38.858512  4701 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:38.802878  3157 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:38.788594  4716 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:38.838276  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 52513.1us
I20260709 12:13:38.738096  4655 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:38.871866  4716 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:38.872483  4716 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.843921  4591 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.835752  4702 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:38.801086  4674 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:38.849946  3262 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.801375  4646 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.850553  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:38.851845  4643 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:38.852756  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 67309.5us
I20260709 12:13:38.838737  4705 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.865091  3928 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.857605  4678 consensus_queue.cc:260] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:38.859522  3929 rpcz_store.cc:276] 0709 12:13:37.742018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.142161 (+400143us) service_pool.cc:224] Handling call
0709 12:13:38.142439 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.693207 (+550768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.832458 (+139251us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b5400679154. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:38.832654 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177766656}
I20260709 12:13:38.872381  3231 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:38.774031  4547 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:13:38.875995  3931 raft_consensus.cc:2393] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 2: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:38.857471  4644 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.881726  4558 consensus_queue.cc:1059] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:38.868250  4701 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:38.887897  3895 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:38.888056  4591 consensus_queue.cc:1059] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:38.890058  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:13:38.882740  3157 raft_consensus.cc:2686] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:13:38.911675  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 108865us
I20260709 12:13:38.912642  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:38.913816  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:38.879743  4652 consensus_queue.cc:1059] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:13:38.891741  3927 raft_consensus.cc:1240] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.855145  4697 consensus_queue.cc:237] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:38.899019  4686 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:38.899252  4650 consensus_queue.cc:1059] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:38.888901  3190 raft_consensus.cc:2393] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:38.899780  4718 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.883126  4646 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:38.874317  4640 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:38.908478  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:38.920096  4678 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.889804  4713 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 12:13:38.883948  3305 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:38.888818  4655 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:38.922221  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:38.925832  3262 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:38.882061  4671 consensus_queue.cc:260] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:38.936870  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:38.908962  4696 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:13:38.947647  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 63793.5us
I20260709 12:13:38.942899  3268 raft_consensus.cc:2393] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 2: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:38.926554  4695 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.890103  4674 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:38.944332  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 530) took 1365 ms. Trace:
I20260709 12:13:38.944697  3340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 1722) took 1384 ms. Trace:
I20260709 12:13:38.913406  4702 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:38.914979  4679 consensus_meta.cc:287] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.581s	user 0.017s	sys 0.001s
I20260709 12:13:38.931609  4699 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.950877  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:38.902606  4644 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:38.954276  3932 rpcz_store.cc:276] 0709 12:13:37.575001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.857352 (+282351us) service_pool.cc:224] Handling call
0709 12:13:37.857781 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.575462 (+717681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.940166 (+364704us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54006063d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:38.940367 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1648627072}
W20260709 12:13:39.006795  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 53413.4us
I20260709 12:13:38.942574  4646 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.936055  4718 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:38.955340  3340 rpcz_store.cc:276] 0709 12:13:37.556833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.557850 (+  1017us) service_pool.cc:224] Handling call
0709 12:13:38.939149 (+1381299us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b5800042698. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:13:38.939400 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.939662 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:38.939700 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.939757 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:38.939802 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.939875 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.940011 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14475648}
I20260709 12:13:38.947751  4642 raft_consensus.cc:3055] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.016561  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.027565  3265 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:39.017115  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.029332  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.017329  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.017398  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.023106  4691 ts_tablet_manager.cc:1929] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:39.033703  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.034765  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.036149  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:39.021925  4546 consensus_meta.cc:287] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 1.135s	user 0.000s	sys 0.027s
I20260709 12:13:39.025564  4718 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:39.047860  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.045519  4546 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.038688  4691 log.cc:1199] T 49089e729c0f4f37b66d40abf2e3cfe6 P 7ac63b674f204bc4805ab989f8c965d3: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/wals/49089e729c0f4f37b66d40abf2e3cfe6
I20260709 12:13:39.033398  4712 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:39.070222  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.008492  4676 consensus_queue.cc:1059] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:13:39.027316  4642 raft_consensus.cc:740] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:13:39.077551  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.069491  3266 raft_consensus.cc:1240] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:39.085561  4546 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:39.090355  3186 raft_consensus.cc:2393] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:39.090837  3339 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:39.041915  3924 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.012610  4679 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.032686  4709 consensus_queue.cc:1059] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:13:39.115329  3339 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.121469  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:39.149758  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.150673  3265 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:13:39.151870  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.152778  3265 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:13:39.153851  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.162635  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:39.126727  4712 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:39.171350  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.169183  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.176529  4679 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:39.180585  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.158463  4546 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.169858  4710 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:39.202107  4712 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:39.202973  4726 tablet_replica.cc:333] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:13:39.145159  4642 consensus_queue.cc:260] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:39.214558  4642 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.167456  4686 consensus_queue.cc:1059] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:13:39.226959  3184 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
W20260709 12:13:39.232779  3261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40120 (request call id 174) took 2121 ms (client timeout 1796 ms). Trace:
W20260709 12:13:39.233451  3261 rpcz_store.cc:269] 0709 12:13:37.111251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.198560 (+ 87309us) service_pool.cc:224] Handling call
0709 12:13:39.232469 (+2033909us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400261e54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:39.232640 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3497895168}
I20260709 12:13:39.240648  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.188478  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.170078  3189 raft_consensus.cc:2393] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 2: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:13:39.247388  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 295977us
I20260709 12:13:39.246272  3339 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.252353  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:39.253476  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:39.253722  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:39.254271  3338 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:39.234582  4640 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:39.242306  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:39.262873  3339 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:13:39.257933  4638 consensus_meta.cc:287] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 1.690s	user 0.013s	sys 0.013s
I20260709 12:13:39.242281  4716 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:39.219219  4673 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.271252  3339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:58568 (request call id 1720) took 1716 ms. Trace:
I20260709 12:13:39.271834  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:39.285084  3335 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:39.234897  4546 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:39.249660  3190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40494 (request call id 1266) took 1869 ms (client timeout 2104 ms). Trace:
I20260709 12:13:39.286406  3339 rpcz_store.cc:276] 0709 12:13:37.550865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.551033 (+   168us) service_pool.cc:224] Handling call
0709 12:13:38.469968 (+918935us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b5800042698. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a9a40 00007f1af35951e9 00007f1af3594c85 00007f1aecb19254
0709 12:13:39.090456 (+620488us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b5800042698. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8e9c 00007f1aeb4a8a5b 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a9a40 00007f1af35951e9 00007f1af3594c85 00007f1aecb19254
0709 12:13:39.266912 (+176456us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":225,"spinlock_wait_cycles":65102464}
I20260709 12:13:39.250427  4705 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:39.290971  3931 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55426 (request call id 297) took 1801 ms (client timeout 1624 ms). Trace:
W20260709 12:13:39.291563  3931 rpcz_store.cc:269] 0709 12:13:37.489659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.489966 (+   307us) service_pool.cc:224] Handling call
0709 12:13:39.290592 (+1800626us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54005ba754. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:39.290861 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3151615744}
I20260709 12:13:39.356732  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.272603  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:39.412643  3188 raft_consensus.cc:2393] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 2: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:39.271921  3261 raft_consensus.cc:3055] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.277942  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:39.406823  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 184) took 1316 ms. Trace:
I20260709 12:13:39.407334  4653 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.425343  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:39.459595  3157 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.065s	sys 0.164s
W20260709 12:13:39.462289  3157 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.065s	sys 0.164s
W20260709 12:13:39.452080  4732 log.cc:927] Time spent T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.407s	user 0.002s	sys 0.000s
W20260709 12:13:39.463397  3156 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.015s	sys 0.020s
I20260709 12:13:39.292822  4638 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.449182  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:13:39.465462  3156 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.016s	sys 0.020s
I20260709 12:13:39.452677  4650 raft_consensus.cc:3055] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:13:39.292593  3190 rpcz_store.cc:269] 0709 12:13:37.380640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.477194 (+ 96554us) service_pool.cc:224] Handling call
0709 12:13:38.672955 (+1195761us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b5800002a98. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8e9c 00007f1aeb4a8a5b 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:13:39.246097 (+573142us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54002436d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:39.248702 (+  2605us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403003264}
W20260709 12:13:39.475562  4685 consensus_meta.cc:287] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.001s
I20260709 12:13:39.476558  3925 raft_consensus.cc:1240] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.424093  3261 raft_consensus.cc:740] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:39.465116  4736 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.474956  4650 raft_consensus.cc:740] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:13:39.499806  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:39.462759  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 527406us
I20260709 12:13:39.523669  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:39.524607  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.525439  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:39.525476  3265 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:39.529362  3305 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:39.532402  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:39.503113  3189 raft_consensus.cc:2393] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 2: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:39.497720  4674 raft_consensus.cc:3055] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.534684  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:39.539896  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:39.533883  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:39.555550  3336 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 3: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:39.487543  4705 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:39.497287  4736 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:39.493039  3334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58568 (request call id 1736) took 1084 ms. Trace:
W20260709 12:13:39.472414  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 537580us
I20260709 12:13:39.497452  4704 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.445458  3260 rpcz_store.cc:276] 0709 12:13:38.090839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.149257 (+ 58418us) service_pool.cc:224] Handling call
0709 12:13:38.200761 (+ 51504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.441305 (+240544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:38.441382 (+    77us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.441458 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:38.441514 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:39.289954 (+848440us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54003aa7d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:39.290012 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:39.303731 (+ 13719us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531984128}
I20260709 12:13:39.491660  4685 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.559942  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:39.560873  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:13:39.536972  4591 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.012s	sys 0.041s
I20260709 12:13:39.558789  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:39.564558  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:39.564754  4691 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40488 (request call id 82) took 2469 ms. Trace:
I20260709 12:13:39.567737  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:39.568061  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:13:39.569242  4738 log.cc:927] Time spent T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:13:39.583334  3928 consensus_meta.cc:287] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.003s
I20260709 12:13:39.630115  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.649709  3928 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:39.650068  3266 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:39.654040  4704 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:39.654856  4546 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:39.655655  3335 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:39.620362  3186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40494 (request call id 1279) took 2072 ms (client timeout 2115 ms). Trace:
I20260709 12:13:39.656214  4704 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:39.601437  4716 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:39.656423  3186 rpcz_store.cc:269] 0709 12:13:37.548239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.570364 (+ 22125us) service_pool.cc:224] Handling call
0709 12:13:38.443927 (+873563us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b5800002a98. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:13:39.620064 (+1176137us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b54002de6d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:39.620278 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1483842688}
I20260709 12:13:39.657696  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.561519  4736 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.658838  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:39.622879  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 296) took 1004 ms. Trace:
I20260709 12:13:39.556778  4674 raft_consensus.cc:740] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:39.659662  3927 rpcz_store.cc:276] 0709 12:13:38.618316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.618907 (+   591us) service_pool.cc:224] Handling call
0709 12:13:38.641286 (+ 22379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.923526 (+282240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:39.622557 (+699031us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400660154. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:39.622804 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542393856}
I20260709 12:13:39.660282  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.660423  4674 consensus_queue.cc:260] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:39.660905  3264 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:39.616906  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:39.661913  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:39.662549  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.662940  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.663282  3259 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:39.664057  4638 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:39.664461  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.579756  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:39.539529  4702 consensus_queue.cc:1059] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:13:39.674952  4702 raft_consensus.cc:3055] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:39.675350  4702 raft_consensus.cc:740] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:39.675802  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:39.676602  3333 raft_consensus.cc:2393] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 2: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:39.676226  4702 consensus_queue.cc:260] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:39.677207  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:39.675763  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.677631  4702 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.677840  3341 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.679886  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:39.680106  4699 consensus_queue.cc:1175] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1ef05c9d901046dca7fe0e638cc693b9" responder_term: 2 status { last_received { term: 2 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 2 index: 4 } }
I20260709 12:13:39.651510  4691 rpcz_store.cc:276] 0709 12:13:37.095521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.095701 (+   180us) service_pool.cc:224] Handling call
0709 12:13:37.462803 (+367102us) ts_tablet_manager.cc:1151] Deleting tablet 49089e729c0f4f37b66d40abf2e3cfe6
0709 12:13:37.480564 (+ 17761us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:13:38.714680 (+1234116us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:39.014818 (+300138us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:39.564658 (+549840us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192867,"tablet-delete.queue_time_us":350122,"thread_start_us":236268,"threads_started":1}
I20260709 12:13:39.648604  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 522) took 2184 ms. Trace:
I20260709 12:13:39.681268  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.681665  3926 rpcz_store.cc:276] 0709 12:13:37.464186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.466071 (+  1885us) service_pool.cc:224] Handling call
0709 12:13:37.499919 (+ 33848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.618564 (+1118645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:39.648314 (+1029750us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400570154. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:39.648498 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2481614208}
W20260709 12:13:39.683346  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.584365  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.684230  3075 catalog_manager.cc:5028] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): tablet 49089e729c0f4f37b66d40abf2e3cfe6 (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
I20260709 12:13:39.681875  3266 raft_consensus.cc:1813] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Handling vote request from an unknown peer 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:39.653146  3337 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.653288  3187 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 2: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:39.568781  3261 consensus_queue.cc:260] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:39.591588  4646 consensus_meta.cc:287] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.562s	user 0.004s	sys 0.008s
I20260709 12:13:39.588241  4653 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:39.591943  4650 consensus_queue.cc:260] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:39.577502  4745 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.633665  4673 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:39.665330  4591 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.013s	sys 0.042s
I20260709 12:13:39.608695  4644 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:39.610044  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 289) took 2085 ms. Trace:
I20260709 12:13:39.562353  3334 rpcz_store.cc:276] 0709 12:13:38.404801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.425290 (+ 20489us) service_pool.cc:224] Handling call
0709 12:13:39.412726 (+987436us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b5800042698. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:13:39.489167 (+ 76441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156508416}
I20260709 12:13:39.620630  4663 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:39.704432  4663 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:39.704980  4558 raft_consensus.cc:3055] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.705404  4558 raft_consensus.cc:740] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:39.665840  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:39.723344  3260 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:13:39.659358  3262 raft_consensus.cc:3055] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.576118  3156 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:39.666819  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:39.667922  4655 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:39.706154  4558 consensus_queue.cc:260] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:39.728664  4673 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.728806  4655 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:39.729806  4745 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.729161  4558 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.731076  4655 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:39.668416  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:39.731679  3342 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.668857  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:39.669844  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:39.676143  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:39.668445  3896 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:39.736313  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 67943us
I20260709 12:13:39.670866  4685 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:39.671386  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:39.648819  4718 consensus_meta.cc:287] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.004s
I20260709 12:13:39.622239  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:39.673957  3335 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:39.685369  3265 raft_consensus.cc:1240] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.686826  3187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40494 (request call id 1281) took 1073 ms. Trace:
I20260709 12:13:39.690742  4646 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.687158  3261 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.697602  3341 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:39.716902  3087 catalog_manager.cc:5697] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:39.745829  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.747121  3087 catalog_manager.cc:5697] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.722559  4663 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:39.727362  3262 raft_consensus.cc:740] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:39.703955  3925 rpcz_store.cc:276] 0709 12:13:37.524406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.534495 (+ 10089us) service_pool.cc:224] Handling call
0709 12:13:39.415252 (+1880757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:39.521091 (+105839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:39.609734 (+ 88643us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54005ba750. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:39.609961 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4028952960}
W20260709 12:13:39.728142  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 152130us
I20260709 12:13:39.728346  3929 raft_consensus.cc:2393] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 2: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:39.753029  3156 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:39.754895  3156 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:39.729136  4673 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:39.685721  3266 raft_consensus.cc:2393] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 2: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:39.761559  3156 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:39.592664  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 291) took 2017 ms. Trace:
I20260709 12:13:39.745126  4718 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:39.733044  3232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.027s	sys 0.060s
W20260709 12:13:39.766742  3232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.027s	sys 0.060s
W20260709 12:13:39.767107  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 728113us
I20260709 12:13:39.661924  4674 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.742179  3157 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:39.771396  3268 raft_consensus.cc:1240] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.771704  3157 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:39.750994  3342 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:39.760005  3262 consensus_queue.cc:260] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.761845  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:39.762549  3340 raft_consensus.cc:3055] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:13:39.763615  3306 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.000s	sys 0.029s
I20260709 12:13:39.636583  4671 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.770243  3263 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:39.780623  3333 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:13:39.808943  3306 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.000s	sys 0.029s
I20260709 12:13:39.739939  4704 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:13:39.811215  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.811311  3262 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.779990  3232 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:39.833762  3340 raft_consensus.cc:740] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:39.838471  3157 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:39.838876  3156 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:39.840932  3340 consensus_queue.cc:260] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:39.763477  4673 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.768558  4638 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.857239  3340 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.768220  4687 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.769786  4716 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.769134  4650 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.872861  3262 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:39.808760  4685 raft_consensus.cc:2804] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:39.765985  3924 rpcz_store.cc:276] 0709 12:13:37.575529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.880800 (+305271us) service_pool.cc:224] Handling call
0709 12:13:38.021458 (+140658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:39.120340 (+1098882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:39.592294 (+471954us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b54004bd2d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:39.592574 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2258925952}
I20260709 12:13:39.813491  4546 raft_consensus.cc:2804] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.836732  3260 raft_consensus.cc:1240] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.837803  3259 raft_consensus.cc:1240] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:39.842324  4678 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.887495  4644 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:39.888068  4644 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:39.890091  3336 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:39.894101  3337 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:39.890156  4644 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:39.858017  4676 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:39.810328  4709 consensus_queue.cc:1059] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:13:39.861668  4638 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:13:39.876673  4642 consensus_meta.cc:287] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.005s
I20260709 12:13:39.905929  3339 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:39.872428  4687 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:39.901286  4718 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:39.857275  4736 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.879663  4716 raft_consensus.cc:697] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:39.881965  4685 raft_consensus.cc:697] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:39.872836  4741 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.899885  4678 raft_consensus.cc:697] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:39.910597  4687 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.901878  4546 raft_consensus.cc:697] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:39.908288  4638 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.908149  4644 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.906011  4676 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:39.927533  4747 log.cc:927] Time spent T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:13:39.929993  4736 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:39.745406  3187 rpcz_store.cc:276] 0709 12:13:38.613468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.619876 (+  6408us) service_pool.cc:224] Handling call
0709 12:13:39.564397 (+944521us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b5800002a98. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8eee 000000000036eb39 00007f1af351c1e0 00007f1af35e50c4 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:13:39.686761 (+122364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11414784}
W20260709 12:13:39.956300  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 407665us
I20260709 12:13:39.968353  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:39.970345  4676 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:39.923933  4644 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:39.972132  3156 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:39.973889  4736 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.964843  4546 consensus_queue.cc:237] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.972211  4644 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.982493  4646 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:39.926966  4678 consensus_queue.cc:237] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.987728  4736 consensus_queue.cc:1059] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:39.988346  4685 consensus_queue.cc:237] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.989370  4736 raft_consensus.cc:3055] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.989907  4736 raft_consensus.cc:740] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:39.992193  4736 consensus_queue.cc:260] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:39.994004  4736 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.998036  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:40.000126  4695 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.986976  4716 consensus_queue.cc:237] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:39.999956  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:39.989167  3261 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:40.024607  3927 raft_consensus.cc:1240] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.025993  4699 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:40.023064  4652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.087s	user 0.025s	sys 0.062s
I20260709 12:13:40.027401  3924 raft_consensus.cc:1240] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:40.028965  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.032441  4704 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:40.038879  4744 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.027076  4699 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:40.048100  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 48930.9us
W20260709 12:13:40.043715  4652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.027s	sys 0.062s
I20260709 12:13:40.062839  3157 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:40.069546  4704 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.071292  4699 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.071790  4744 consensus_queue.cc:1059] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:40.073607  4744 raft_consensus.cc:3055] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.074131  4744 raft_consensus.cc:740] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:40.077450  4642 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:40.085825  4620 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:40.086557  4620 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.086941  4642 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.088043  4679 raft_consensus.cc:3055] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.088608  4679 raft_consensus.cc:740] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:40.088729  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1180) took 1037 ms. Trace:
I20260709 12:13:40.089926  4642 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.082608  3156 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.093225  4721 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:40.093935  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.096556  4620 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:40.089226  3260 rpcz_store.cc:276] 0709 12:13:39.050786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.726030 (+675244us) service_pool.cc:224] Handling call
0709 12:13:39.772376 (+ 46346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:39.957351 (+184975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.088255 (+130904us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b540046f0d0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:40.088543 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96345856}
W20260709 12:13:40.099233  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 47702.3us
I20260709 12:13:40.100466  4620 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:40.079914  4744 consensus_queue.cc:260] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:40.104818  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 334041us
I20260709 12:13:40.105355  3156 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.106304  4702 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.106693  3232 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.106985  4702 raft_consensus.cc:697] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:40.108040  4667 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.107810  4679 consensus_queue.cc:260] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.108870  3232 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.110020  4667 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:40.099849  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 100138us
I20260709 12:13:40.107132  3156 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.110314  4679 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.115094  4741 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.117604  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:40.119575  4699 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:40.120033  4699 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.120425  4699 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.121825  4702 consensus_queue.cc:237] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:40.123692  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.131683  4546 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.132479  3156 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.131759  4704 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:40.134474  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.134570  3156 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.135673  4741 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.136786  4733 raft_consensus.cc:3055] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.137248  4733 raft_consensus.cc:740] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:40.138479  4733 consensus_queue.cc:260] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.140203  4733 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.152446  4744 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.156306  3305 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:40.157312  4716 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:40.157967  4678 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.158052  4716 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:40.157879  3156 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.178326  4716 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.171540  3232 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:40.176949  3924 raft_consensus.cc:1240] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.180574  3156 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.180752  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.160909  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:40.186581  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.179136  4678 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.195779  4752 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.200982  4752 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.186278  4674 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.196877  4687 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.203967  3340 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:40.207865  4699 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.210394  4699 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.211591  4671 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:40.212260  4671 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:40.212838  4671 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:40.215837  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 59759.5us
W20260709 12:13:40.216841  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 45579.6us
I20260709 12:13:40.200121  4650 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:40.205857  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.206732  4687 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:40.199154  4644 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.230396  4667 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.231227  4667 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.233963  4644 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:40.207129  4752 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.218796  3895 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:40.222479  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.225652  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.236011  3924 raft_consensus.cc:2393] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:40.236795  4721 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.237251  3305 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:40.239038  4650 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.239387  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:40.234206  4667 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.245574  4638 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.250560  4638 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:40.256481  4758 log.cc:927] Time spent T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:13:40.258155  4687 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.258991  4733 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.261050  3305 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:13:40.261674  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:40.262499  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.264870  4673 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:40.266654  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 86215.2us
I20260709 12:13:40.268648  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.270330  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.270725  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.271385  3187 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
W20260709 12:13:40.271302  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 113862us
W20260709 12:13:40.275962  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.258911  4716 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.286158  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.286415  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.273636  4733 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:40.287153  3188 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 2: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:40.287263  4733 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:40.288090  4733 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.286229  3895 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:40.293036  4673 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:40.282958  4667 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:40.296641  4667 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.272185  4687 consensus_queue.cc:1059] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:13:40.299752  4667 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.299738  4687 raft_consensus.cc:3055] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.302819  4687 raft_consensus.cc:740] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:40.304108  4687 consensus_queue.cc:260] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.307806  4726 raft_consensus.cc:2243] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:40.309485  4726 raft_consensus.cc:2272] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.305790  4687 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.315105  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.316275  4673 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.317934  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.318825  3924 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:13:40.328447  4721 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.332268  3186 raft_consensus.cc:2393] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:13:40.332566  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 52642.8us
I20260709 12:13:40.333025  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.333838  3188 raft_consensus.cc:2393] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 2: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:40.335151  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:40.345680  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:40.345959  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.346376  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.327623  4620 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:13:40.347189  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:40.347908  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:40.327445  4671 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.332649  4721 raft_consensus.cc:697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:40.347075  3928 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
W20260709 12:13:40.354420  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 93578.2us
I20260709 12:13:40.357385  3186 raft_consensus.cc:1240] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.357831  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:40.365741  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:40.368228  4721 consensus_queue.cc:237] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.378432  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.382777  3188 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:40.385102  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:40.382777  4638 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.388386  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:40.391153  3192 raft_consensus.cc:1240] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.392318  3190 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:40.392585  3187 raft_consensus.cc:1240] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.391281  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.395174  3305 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:40.401008  4716 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:40.409889  3192 raft_consensus.cc:1240] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.410514  3186 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.412629  3190 raft_consensus.cc:1240] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.413722  3192 raft_consensus.cc:1240] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.414363  4591 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:40.414737  3189 raft_consensus.cc:1240] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.414791  4591 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:40.415365  4591 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.351886  4726 ts_tablet_manager.cc:1916] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:40.420012  3089 catalog_manager.cc:5697] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 3 to 4, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 4 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.421289  3186 raft_consensus.cc:1240] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.426137  4591 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.421828  3188 raft_consensus.cc:1240] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.423251  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:40.440762  3089 catalog_manager.cc:5697] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 2 to 3, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:40.448539  4763 log.cc:927] Time spent T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:13:40.448426  3188 raft_consensus.cc:1240] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.449290  3089 catalog_manager.cc:5697] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.451637  3089 catalog_manager.cc:5697] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 2 to 3, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.453761  3089 catalog_manager.cc:5697] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 2 to 3, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:40.456144  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 66262.7us
I20260709 12:13:40.457415  3305 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:40.465992  4671 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.478705  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.479483  3342 raft_consensus.cc:1240] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.479533  3188 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:40.480857  4650 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.438884  4733 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:40.499301  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 123572us
I20260709 12:13:40.489646  4664 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:40.508144  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.515175  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:40.515825  4664 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.516290  3188 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.518040  4664 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:13:40.519023  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.520926  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:40.521916  3187 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:40.523005  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.524611  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.524905  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:40.525525  3190 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:40.526962  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.528008  3260 raft_consensus.cc:2393] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:40.529800  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.532795  4733 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:40.495872  4687 consensus_queue.cc:1059] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:13:40.540685  3305 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:40.540930  4591 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:40.555285  4638 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:40.555605  4664 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:40.556039  4638 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.558072  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.558233  4638 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.558736  3261 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:40.559882  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.559788  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.560739  3263 raft_consensus.cc:2393] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 2: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:40.561753  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:40.562106  4687 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:40.562775  4687 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:40.564998  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 54049.2us
I20260709 12:13:40.566583  3305 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:40.566919  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.567499  4591 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.568015  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:40.568608  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.569073  4733 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:40.554566  4652 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:40.569623  4652 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:40.569624  4733 raft_consensus.cc:697] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:40.570019  4652 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.571954  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.572278  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.572808  3188 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:40.573581  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:40.574877  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.556332  4664 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.570897  4733 consensus_queue.cc:237] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.582717  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.583976  3337 raft_consensus.cc:1275] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:40.584533  3087 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48778 (request call id 275) took 2038 ms. Trace:
I20260709 12:13:40.592450  3088 catalog_manager.cc:5697] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.594719  4752 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:40.595292  4752 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.597738  4752 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.594435  3088 catalog_manager.cc:5697] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.607990  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.608585  3342 raft_consensus.cc:1275] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:40.610033  4674 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.610456  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:40.610702  4716 raft_consensus.cc:3055] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.611117  4716 raft_consensus.cc:740] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:40.611934  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:40.612118  4716 consensus_queue.cc:260] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.612788  3263 raft_consensus.cc:2393] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 2: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:40.612149  4699 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:40.613418  4716 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.614144  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:40.614025  4699 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.614434  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:40.605019  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:40.616109  4699 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.616369  4664 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:40.617995  3184 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:40.619827  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.565222  4687 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.623031  4667 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:40.623162  4752 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.623690  4667 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.623867  4752 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.624459  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.624667  4679 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.625749  4667 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.626178  4752 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:40.627383  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:40.628189  3338 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:40.628340  3340 raft_consensus.cc:1275] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:40.631686  3335 raft_consensus.cc:1275] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.631731  4752 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:40.632612  4752 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.618022  4652 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.632905  3088 catalog_manager.cc:5697] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.634285  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.634841  4752 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.584874  3087 rpcz_store.cc:276] 0709 12:13:38.546313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.546491 (+   178us) service_pool.cc:224] Handling call
0709 12:13:40.584286 (+2037795us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:39.928874 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:39.929637 (+   763us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:39.929661 (+    24us) write_op.cc:435] Acquired schema lock
0709 12:13:39.929672 (+    11us) tablet.cc:662] Decoding operations
0709 12:13:39.929955 (+   283us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:39.930006 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:39.930025 (+    19us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:13:39.930232 (+   207us) tablet.cc:701] Row locks acquired
0709 12:13:39.930273 (+    41us) write_op.cc:260] PREPARE: finished
0709 12:13:39.930419 (+   146us) write_op.cc:270] Start()
0709 12:13:39.930499 (+    80us) write_op.cc:276] Timestamp: P: 1783599219930374 usec, L: 0
0709 12:13:39.930513 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:13:39.931235 (+   722us) log.cc:844] Serialized 913 byte log entry
0709 12:13:40.335110 (+403875us) op_driver.cc:464] REPLICATION: finished
0709 12:13:40.459705 (+124595us) write_op.cc:301] APPLY: starting
0709 12:13:40.459856 (+   151us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:40.460081 (+   225us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:40.460260 (+   179us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:40.463789 (+  3529us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:40.464107 (+   318us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:13:40.464195 (+    88us) write_op.cc:312] APPLY: finished
0709 12:13:40.464670 (+   475us) log.cc:844] Serialized 29 byte log entry
0709 12:13:40.464956 (+   286us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:40.465120 (+   164us) write_op.cc:454] Released schema lock
0709 12:13:40.465291 (+   171us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:40.478560 (+ 13269us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:40.478587 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":108966,"apply.run_cpu_time_us":3533,"apply.run_wall_time_us":18873,"num_ops":2,"prepare.queue_time_us":175848,"prepare.run_cpu_time_us":3182,"prepare.run_wall_time_us":3534,"raft.queue_time_us":164561,"raft.run_cpu_time_us":3240,"raft.run_wall_time_us":51676,"replication_time_us":404386,"thread_start_us":364318,"threads_started":4,"wal-append.queue_time_us":995}]]}
I20260709 12:13:40.634930  3263 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:40.635576  4652 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:40.636916  3088 catalog_manager.cc:5697] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.639820  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.640395  4674 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.641089  3925 raft_consensus.cc:2393] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 2: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:40.639012  3088 catalog_manager.cc:5697] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.636844  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:40.658179  3232 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:40.661389  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:40.640887  3264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:40.662192  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:40.655212  3088 catalog_manager.cc:5697] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.667742  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.669154  3263 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.662277  3264 raft_consensus.cc:606] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.669251  4752 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:40.670475  4638 consensus_queue.cc:1048] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:40.671022  4752 raft_consensus.cc:697] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:40.672387  4702 consensus_queue.cc:1048] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.665867  4674 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.669936  4699 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:40.673424  4674 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.674031  4699 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:40.674470  4699 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.676086  4652 consensus_queue.cc:1059] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:40.677889  4652 raft_consensus.cc:3055] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.678278  4652 raft_consensus.cc:740] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:13:40.682724  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.683416  4674 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.682185  4652 consensus_queue.cc:260] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.690781  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:40.691035  3305 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:40.690872  4591 consensus_queue.cc:1059] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:40.692597  4591 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:40.693704  4650 raft_consensus.cc:3055] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.694221  4650 raft_consensus.cc:740] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:40.695586  4650 consensus_queue.cc:260] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.697155  3184 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.697589  4591 raft_consensus.cc:697] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:40.697839  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:40.698709  3188 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:40.698770  4591 consensus_queue.cc:237] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.693727  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:40.692714  3262 raft_consensus.cc:3055] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.696692  4752 consensus_queue.cc:237] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.704958  3262 raft_consensus.cc:740] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:40.706054  3262 consensus_queue.cc:260] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.697187  4650 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.708564  4726 ts_tablet_manager.cc:1929] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:40.709160  4726 log.cc:1199] T 72176593f52b48c28602984ef9c8ee6b P eb49d92feeb14382b3baa49d696b6141: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/wals/72176593f52b48c28602984ef9c8ee6b
I20260709 12:13:40.710023  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:40.710672  4726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58550 (request call id 78) took 2048 ms. Trace:
I20260709 12:13:40.712335  4546 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:40.713310  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 45692us
I20260709 12:13:40.707285  3262 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.715066  3259 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:13:40.718078  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.718439  3263 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:40.725967  3340 raft_consensus.cc:1240] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:40.730320  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.730621  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.734565  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:40.739975  3231 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.711040  4726 rpcz_store.cc:276] 0709 12:13:38.662209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.662672 (+   463us) service_pool.cc:224] Handling call
0709 12:13:38.817590 (+154918us) ts_tablet_manager.cc:1151] Deleting tablet 72176593f52b48c28602984ef9c8ee6b
0709 12:13:39.108902 (+291312us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:13:40.561054 (+1452152us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:40.708394 (+147340us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:40.710563 (+  2169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1102652,"tablet-delete.queue_time_us":118559,"thread_start_us":16754,"threads_started":1}
I20260709 12:13:40.752949  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:40.766429  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.765733  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.768276  3192 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:40.764771  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.759130  4638 consensus_queue.cc:1059] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:13:40.779817  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.781369  3156 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.765192  4671 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:40.786640  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:40.788973  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 67076.6us
I20260709 12:13:40.789479  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.789916  3231 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.790313  3192 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:40.791291  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.791934  3191 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:40.792380  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.793100  3191 raft_consensus.cc:1240] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.793757  3192 raft_consensus.cc:1240] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.795622  3188 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.786682  3232 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:40.789541  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:40.820693  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 51921.3us
I20260709 12:13:40.775398  4652 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.789510  4638 raft_consensus.cc:3055] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.824146  4638 raft_consensus.cc:740] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:40.824414  3232 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:13:40.823741  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 45852us
I20260709 12:13:40.782932  4674 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.827030  3262 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:40.839378  4699 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.825071  4638 consensus_queue.cc:260] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.834455  4667 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:40.839608  3193 raft_consensus.cc:1240] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.833159  3190 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:40.836838  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:40.821976  4752 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.832154  3231 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.856025  3156 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:40.787933  4671 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:40.823566  4673 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:40.862990  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.868340  3342 raft_consensus.cc:1240] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:40.844661  4778 log.cc:927] Time spent T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:13:40.875411  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 51063.6us
I20260709 12:13:40.845384  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:40.862831  4667 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:40.868928  4671 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.882097  4667 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.884688  3187 raft_consensus.cc:2393] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 2: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:40.879151  4687 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:40.889052  3185 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:40.889385  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 62802.7us
I20260709 12:13:40.889894  4638 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.913407  3185 raft_consensus.cc:1240] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.901613  4752 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.922041  4699 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.926004  4667 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.931982  3263 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:13:40.931857  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 99837.7us
I20260709 12:13:40.932116  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:40.941037  4785 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:40.941435  3185 raft_consensus.cc:1240] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.941816  4785 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:40.944782  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:40.948297  3231 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.956729  4687 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:40.957001  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:40.957319  4687 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.957926  4591 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:40.958560  4591 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:40.960167  3261 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:40.960891  4591 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:40.963696  3265 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.964847  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.965236  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.966197  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:40.966502  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.967204  3260 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:40.968773  3262 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:40.969630  3265 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:13:40.971769  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.972675  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.973021  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.974167  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:40.975258  4667 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.972772  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.976126  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:40.965242  3156 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:40.979394  3185 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:40.986730  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.988126  4785 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:40.988571  4674 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.980453  4644 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.008083  3156 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:13:41.009097  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 68267.1us
I20260709 12:13:41.010023  3231 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.011603  4790 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.011785  4667 consensus_queue.cc:1059] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:13:41.013197  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 130216us
I20260709 12:13:41.026615  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:41.036810  4706 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:13:41.037997  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.042335  4706 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:41.019536  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:40.980186  4671 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:41.054363  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 46374.6us
I20260709 12:13:41.053289  4638 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:41.058019  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 105466us
I20260709 12:13:41.059693  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:41.064360  3185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:41.064968  3185 raft_consensus.cc:606] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Received request to transfer leadership to TS 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:41.065246  3185 raft_consensus.cc:614] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:41.057880  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:41.063468  4673 consensus_queue.cc:1059] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:13:41.072978  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:41.073863  3927 raft_consensus.cc:2393] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 2: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:41.073997  4673 raft_consensus.cc:3055] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.074548  4673 raft_consensus.cc:740] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:41.075121  4644 raft_consensus.cc:3055] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:41.075575  4644 raft_consensus.cc:740] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:41.076501  4644 consensus_queue.cc:260] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.077776  4644 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.080243  3190 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:41.086544  4687 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:41.087823  4671 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:41.088305  3339 raft_consensus.cc:1240] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:41.089452  3928 raft_consensus.cc:2393] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 2: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:41.090487  4687 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:41.091197  4785 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:41.092655  4785 consensus_queue.cc:1059] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:41.070489  4652 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:41.092300  4667 consensus_queue.cc:1059] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:41.093626  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:41.093595  4652 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.094182  4752 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.094419  4667 raft_consensus.cc:3055] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:41.094842  4667 raft_consensus.cc:740] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:41.094913  4752 raft_consensus.cc:3055] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.095366  4752 raft_consensus.cc:740] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:41.095775  4667 consensus_queue.cc:260] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.096275  4752 consensus_queue.cc:260] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.097528  4752 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.099571  4652 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:41.089438  4671 consensus_queue.cc:1059] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:13:41.100533  4673 consensus_queue.cc:260] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.101251  4671 consensus_queue.cc:1243] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer 7ac63b674f204bc4805ab989f8c965d3 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:13:41.106257  3342 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
W20260709 12:13:41.107277  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 43582.6us
I20260709 12:13:41.107885  3895 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:41.110651  3156 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.061573  4706 consensus_queue.cc:1059] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:13:41.115288  4673 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.116691  3336 raft_consensus.cc:1240] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:41.119244  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:41.111194  4671 raft_consensus.cc:3055] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.121507  4671 raft_consensus.cc:740] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:41.122355  4671 consensus_queue.cc:260] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.123618  4671 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.116209  4721 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:41.126343  4721 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.126682  4721 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.127107  3339 raft_consensus.cc:1240] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:41.129112  3232 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.140674  3342 raft_consensus.cc:1240] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:41.144686  3342 raft_consensus.cc:1240] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:41.146380  3156 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.133093  4790 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.149078  4800 consensus_queue.cc:1059] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:41.171700  4800 consensus_queue.cc:1243] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer 7ac63b674f204bc4805ab989f8c965d3 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:13:41.172194  4800 raft_consensus.cc:3055] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:41.172526  4800 raft_consensus.cc:740] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:41.159566  4789 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.133975  4796 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.183792  3088 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34704 (request call id 174) took 1154 ms. Trace:
I20260709 12:13:41.188647  4796 raft_consensus.cc:697] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:41.189710  4796 consensus_queue.cc:237] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:41.135031  4716 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.173766  4699 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.173928  4800 consensus_queue.cc:260] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.196393  4800 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.172917  4704 raft_consensus.cc:3055] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:41.196924  4704 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:41.197800  4704 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:41.199105  4704 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.188865  3088 rpcz_store.cc:276] 0709 12:13:40.030273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.030737 (+   464us) service_pool.cc:224] Handling call
0709 12:13:41.183712 (+1152975us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:40.909919 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:40.925674 (+ 15755us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:40.925713 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:13:40.925734 (+    21us) tablet.cc:662] Decoding operations
0709 12:13:40.926533 (+   799us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:40.926589 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:40.926617 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:13:40.927106 (+   489us) tablet.cc:701] Row locks acquired
0709 12:13:40.927123 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:13:40.927267 (+   144us) write_op.cc:270] Start()
0709 12:13:40.927375 (+   108us) write_op.cc:276] Timestamp: P: 1783599220927225 usec, L: 0
0709 12:13:40.927397 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:13:40.947887 (+ 20490us) log.cc:844] Serialized 2434 byte log entry
0709 12:13:41.160019 (+212132us) op_driver.cc:464] REPLICATION: finished
0709 12:13:41.160375 (+   356us) write_op.cc:301] APPLY: starting
0709 12:13:41.160452 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:41.160619 (+   167us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:41.160703 (+    84us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:41.161575 (+   872us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:41.161775 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:13:41.161838 (+    63us) write_op.cc:312] APPLY: finished
0709 12:13:41.162231 (+   393us) log.cc:844] Serialized 53 byte log entry
0709 12:13:41.162409 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:41.162607 (+   198us) write_op.cc:454] Released schema lock
0709 12:13:41.162662 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:41.163072 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:41.163115 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49495,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":144,"apply.run_cpu_time_us":2617,"apply.run_wall_time_us":2616,"num_ops":6,"prepare.queue_time_us":121965,"prepare.run_cpu_time_us":3967,"prepare.run_wall_time_us":42212,"replication_time_us":232474}]]}
I20260709 12:13:41.212095  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:41.212960  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:41.213367  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:41.214496  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:41.214996  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:41.215893  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:41.216318  3334 raft_consensus.cc:1240] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:41.217389  3337 raft_consensus.cc:1240] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:41.217569  3333 raft_consensus.cc:1240] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:41.219329  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:41.220397  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.209128  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:41.209393  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:41.210457  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:41.210748  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:41.217648  3334 raft_consensus.cc:1240] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:41.207940  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 87829.7us
I20260709 12:13:41.231925  3339 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:41.236037  4721 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:41.238375  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.239709  3232 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.243865  4721 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:41.244810  3340 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:41.245294  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:41.247818  4650 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.247558  3088 catalog_manager.cc:5697] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:41.248582  4667 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:41.251528  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.255909  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:41.256523  3265 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.243551  3156 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:41.258474  3232 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.259701  3264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:56778
I20260709 12:13:41.260310  3264 raft_consensus.cc:606] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.260128  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:41.260730  3264 raft_consensus.cc:614] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:41.262959  3260 consensus_queue.cc:237] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:41.257442  4752 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.275729  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:41.259336  4721 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:13:41.276983  4652 consensus_queue.cc:1059] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:13:41.280735  4652 raft_consensus.cc:3055] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:41.281139  4652 raft_consensus.cc:740] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:41.282119  4652 consensus_queue.cc:260] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.271111  4673 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.257375  4704 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:13:41.303788  3089 catalog_manager.cc:5697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 3, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 3 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.294155  4673 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.273937  4789 consensus_queue.cc:1059] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:13:41.300614  4790 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.319656  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:41.313980  4652 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.325464  4789 raft_consensus.cc:3055] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:41.325554  3924 raft_consensus.cc:1275] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:41.334858  4721 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:41.335587  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.336723  4806 consensus_queue.cc:1059] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:41.326323  4802 consensus_queue.cc:1059] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:41.316197  4673 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.330593  4591 consensus_queue.cc:1059] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:41.348775  3895 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.350666  3895 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:41.329739  4789 raft_consensus.cc:740] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:13:41.364270  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.367127  3185 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:41.370564  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:41.371294  3189 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.342913  3190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:41.373423  3190 raft_consensus.cc:606] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:41.378113  4650 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.378918  4650 raft_consensus.cc:3055] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.384932  4790 raft_consensus.cc:3055] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.385149  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:41.385403  4790 raft_consensus.cc:740] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:41.386344  4790 consensus_queue.cc:260] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.387835  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:41.389333  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:41.370918  4789 consensus_queue.cc:260] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.397914  4789 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.398828  3340 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:41.402025  3265 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
W20260709 12:13:41.402982  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 52424.6us
W20260709 12:13:41.403107  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 87427.5us
I20260709 12:13:41.382754  3088 catalog_manager.cc:5697] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 1 to 2, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:41.408990  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.409415  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.409747  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.379264  4650 raft_consensus.cc:740] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:41.402047  4704 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.413604  4640 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.411283  3895 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.383236  3189 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
W20260709 12:13:41.430096  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 99772us
I20260709 12:13:41.431324  3231 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:41.431911  4687 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:41.433207  3231 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:13:41.434676  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.415839  4640 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:41.450248  4644 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:41.436887  4704 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.455920  4640 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.458735  4802 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.459185  4802 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:41.459578  4802 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.437922  4667 raft_consensus.cc:2764] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:13:41.422979  4591 raft_consensus.cc:3055] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.466336  4591 raft_consensus.cc:740] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:13:41.473476  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 62316.1us
I20260709 12:13:41.466866  4673 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:41.437366  4790 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.477072  3231 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:41.478880  4650 consensus_queue.cc:260] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.484069  3090 catalog_manager.cc:5697] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.485263  4650 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:41.485376  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.487062  3090 catalog_manager.cc:5697] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.487967  4721 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:13:41.488442  4810 log.cc:927] Time spent T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:13:41.488402  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:41.489603  4721 consensus_queue.cc:1059] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:41.490352  4664 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.492043  3895 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:41.478415  3305 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:41.496637  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 61351.5us
I20260709 12:13:41.497623  4785 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:41.498179  4785 raft_consensus.cc:697] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:41.499863  3305 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:41.492818  4706 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.500713  4652 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:41.515110  4807 raft_consensus.cc:3055] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:41.515823  4807 raft_consensus.cc:740] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:41.515903  4809 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:41.516953  4809 raft_consensus.cc:697] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:41.501377  4785 consensus_queue.cc:237] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.437986  4752 consensus_queue.cc:1059] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
W20260709 12:13:41.511497  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.512272  3231 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:41.519061  3076 catalog_manager.cc:5028] TS eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): tablet 72176593f52b48c28602984ef9c8ee6b (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
W20260709 12:13:41.526222  3232 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a85351bf981e43bea61620452a2c7b3a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:41.521104  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:41.521579  3895 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.534861  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:41.535841  3190 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 2: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:41.536175  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:41.470355  4591 consensus_queue.cc:260] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:41.540030  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.524416  4652 raft_consensus.cc:697] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:41.542214  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:41.537588  4721 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.517167  4807 consensus_queue.cc:260] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:41.543789  4704 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:41.544607  4673 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:41.544090  4652 consensus_queue.cc:237] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.543164  4670 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:41.545282  3189 raft_consensus.cc:1275] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.546929  3895 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:41.519179  4809 consensus_queue.cc:237] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.548179  4670 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:41.548666  4670 raft_consensus.cc:697] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:41.548676  3232 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.550758  4800 consensus_queue.cc:1059] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:41.551759  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:41.553328  4671 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.551733  3232 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.554337  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:41.533500  4789 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.558059  3339 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:41.549537  4670 consensus_queue.cc:237] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:41.560390  3189 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.560763  3232 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.561487  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:41.562446  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.578042  3185 raft_consensus.cc:1240] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:13:41.579319  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.580437  4785 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.581275  4785 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.576071  4789 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.578024  4650 consensus_queue.cc:1048] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:13:41.629621  4807 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.597983  4664 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.636695  4809 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.651098  4809 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.633301  4808 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.601557  4812 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:13:41.658196  4640 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:41.644555  4664 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:41.700906  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 172827us
I20260709 12:13:41.709095  3924 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:41.713965  3156 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.715773  3156 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.722038  3156 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:41.726192  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 163821us
I20260709 12:13:41.726946  3232 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.728509  3232 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.729183  3156 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.731110  4789 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.732453  4789 raft_consensus.cc:2749] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.732618  4664 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:41.734923  4752 consensus_queue.cc:1059] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:41.736011  4809 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:41.736124  4789 raft_consensus.cc:3055] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.737952  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.739631  3263 raft_consensus.cc:1240] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:41.739495  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.740157  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:41.740782  3339 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:41.741019  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:41.743127  3264 raft_consensus.cc:1275] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:41.745371  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:41.725340  4678 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.723444  4673 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.752645  3262 raft_consensus.cc:1275] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.753756  3232 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:41.704412  4802 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:41.736575  4789 raft_consensus.cc:740] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:41.767746  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:41.744381  4687 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.767911  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:41.796000  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:41.800179  3232 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:41.803673  3896 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:41.800630  3268 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:41.768278  4789 consensus_queue.cc:260] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.770617  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:41.827587  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:41.807621  3260 raft_consensus.cc:1275] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:41.826979  4650 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.826789  4809 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.812594  4826 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.828233  4789 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.818217  4699 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:13:41.830024  4804 log.cc:927] Time spent T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.250s	user 0.000s	sys 0.002s
I20260709 12:13:41.839121  4809 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:41.874011  4802 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:41.874261  4809 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:41.839802  4826 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.828027  4821 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.838624  4650 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:41.879213  4650 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:41.855666  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:41.860283  4789 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:41.879793  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:41.817867  4640 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:41.880407  4789 raft_consensus.cc:697] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:41.880894  4640 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.881381  4640 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.881729  4640 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.817819  3186 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:41.881906  4789 consensus_queue.cc:237] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.819126  4687 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:13:41.885715  3090 catalog_manager.cc:5697] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 4, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 4 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.889308  4699 raft_consensus.cc:697] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:41.889528  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:41.889117  3088 catalog_manager.cc:5697] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 3 to 4, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 4 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:41.890820  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:41.880506  3927 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:41.893163  3090 catalog_manager.cc:5697] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 4, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 4 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.870810  4790 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:41.898217  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 140075us
W20260709 12:13:41.905191  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.953485  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 228847us
I20260709 12:13:41.890714  4699 consensus_queue.cc:237] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.969261  3266 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:41.965795  3306 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:41.959656  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:41.947868  4790 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:41.971050  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:41.976303  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:41.977228  3262 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:41.983984  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:41.985510  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:41.986203  3266 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:41.988294  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:41.987105  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:41.993688  3266 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:41.999939  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:42.000645  3262 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:41.969517  4807 consensus_queue.cc:1059] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:13:42.005239  3262 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.981429  4650 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:42.008751  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 208665us
I20260709 12:13:41.980742  3925 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
W20260709 12:13:42.010507  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 261461us
W20260709 12:13:42.016943  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 262920us
I20260709 12:13:42.018808  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:42.004791  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:42.004278  4812 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.022023  3305 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:42.008074  4650 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:42.034360  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:42.035624  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.027652  4821 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.029345  4650 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.033707  4809 raft_consensus.cc:2764] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:13:42.041944  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:42.029043  4802 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 12:13:42.052265  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.054133  3306 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:42.036038  4785 consensus_queue.cc:1059] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:13:42.045522  4673 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
W20260709 12:13:42.066031  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 53425.1us
I20260709 12:13:42.051877  4812 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:42.054157  4836 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:42.069775  4809 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.083247  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:42.088742  3305 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:42.070665  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:42.092568  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:42.092943  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:42.099738  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:42.075297  3259 raft_consensus.cc:1240] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:42.076817  4785 consensus_queue.cc:1243] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer 7ac63b674f204bc4805ab989f8c965d3 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:13:42.074292  4673 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.104374  3267 raft_consensus.cc:1275] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:42.082394  4591 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.102852  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:42.112341  3185 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:42.091360  4809 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.119642  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:42.064273  4835 consensus_queue.cc:1059] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:13:42.092607  4812 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.127034  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:42.125815  4652 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.129034  4823 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:42.122524  4809 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.130564  4835 raft_consensus.cc:3055] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:42.131174  4835 raft_consensus.cc:740] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:42.132869  4673 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:42.132423  4835 consensus_queue.cc:260] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:42.134282  4835 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.116274  4790 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:42.137485  4790 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:42.138286  4790 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.104803  3184 raft_consensus.cc:1275] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:42.141139  4839 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.141705  4839 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:42.107825  3260 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.147127  3259 raft_consensus.cc:1240] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:42.082935  4640 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:42.148249  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:42.149326  4652 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:42.149747  4652 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:42.150132  4652 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.153239  3191 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:42.103207  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:42.090986  4836 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:42.169207  4664 consensus_queue.cc:1059] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:42.169426  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:42.164245  3268 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:42.170344  3263 raft_consensus.cc:2393] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:42.171375  4667 raft_consensus.cc:3055] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:42.171969  4667 raft_consensus.cc:740] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:42.172995  4667 consensus_queue.cc:260] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.174371  4667 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.170372  4664 raft_consensus.cc:3055] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:42.176851  4664 raft_consensus.cc:740] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:42.177855  4664 consensus_queue.cc:260] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:42.180373  3265 raft_consensus.cc:1240] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:42.183072  4664 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.170849  4809 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:42.189653  4812 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.195595  4840 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:42.196161  4840 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.164803  4823 raft_consensus.cc:697] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:42.199985  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:42.200616  3925 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.200721  4840 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:42.200304  4823 consensus_queue.cc:237] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.201684  4809 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:42.202739  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:42.171165  4836 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:42.205083  4839 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:42.213105  3261 raft_consensus.cc:3055] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:42.213531  3261 raft_consensus.cc:740] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:42.214358  3261 consensus_queue.cc:260] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.218168  3266 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:42.218756  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:42.219312  3339 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.219547  3266 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:42.224028  4821 consensus_queue.cc:765] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Error trying to read ahead of the log while preparing peer request: Incomplete: Op with index 3 is ahead of the local log (next sequential op: 3). Destination peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.674s
W20260709 12:13:42.228184  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:42.227067  4813 log.cc:927] Time spent T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.507s	user 0.002s	sys 0.000s
I20260709 12:13:42.232121  4832 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.232950  3924 raft_consensus.cc:1240] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:42.232724  4832 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.242411  3339 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:42.247934  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:42.277151  3186 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:42.232121  4827 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:13:42.235391  4832 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:42.288960  4839 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.289572  4839 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:42.292722  3896 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:42.193423  4640 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:42.288966  3927 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:42.330360  4839 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:42.327512  4812 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.243096  4650 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:42.405467  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 43677.7us
I20260709 12:13:42.417290  3342 raft_consensus.cc:1240] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:42.438993  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:42.439594  3156 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:42.401600  4826 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.399608  4821 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:42.442544  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 294359us
W20260709 12:13:42.446517  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.446558  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:42.412436  4850 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.444357  3305 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:42.452669  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:42.453954  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:42.454479  4591 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:42.453500  3925 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:42.472108  3305 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:42.463989  4836 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.454329  4812 consensus_queue.cc:1059] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:13:42.465212  4846 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:42.465080  4832 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:13:42.481513  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.449007  4821 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.458406  4687 consensus_queue.cc:1059] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:13:42.486043  3305 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:42.446429  4826 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.473400  4591 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.468284  4851 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.467144  4823 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:42.478303  4808 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.485688  4836 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.490047  4846 raft_consensus.cc:697] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:42.515950  4846 consensus_queue.cc:237] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:42.518723  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:42.520066  4836 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:42.521302  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:42.521770  4667 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:42.522184  3929 raft_consensus.cc:2410] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:13:42.522374  4826 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:42.522899  4789 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.522423  4667 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.523376  4789 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:42.529287  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.529920  3306 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:42.499063  4806 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.501341  4650 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:42.502043  3260 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:42.472563  4673 consensus_queue.cc:1059] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:13:42.503829  3261 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.494992  4591 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.505714  4841 raft_consensus.cc:3055] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:42.455070  4850 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.480667  4809 consensus_queue.cc:1048] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:13:42.513393  4652 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.535842  4667 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:42.537868  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:42.528524  3232 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:13:42.540674  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 54747.5us
I20260709 12:13:42.550524  4673 raft_consensus.cc:3055] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:42.574623  4850 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:42.579453  3156 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:13:42.580828  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 100611us
I20260709 12:13:42.540125  4851 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:42.526566  4823 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:42.585289  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:13:42.587217  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 58743.1us
I20260709 12:13:42.586726  3927 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:42.591910  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 114967us
I20260709 12:13:42.552714  4841 raft_consensus.cc:740] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:42.571293  4835 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.600057  4674 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:42.605541  4819 raft_consensus.cc:3055] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:42.606364  4862 consensus_queue.cc:1048] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:13:42.612946  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:42.592278  4840 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:42.559729  4699 consensus_queue.cc:1059] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:13:42.624611  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:42.621047  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:42.616874  3192 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:42.585213  4673 raft_consensus.cc:740] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:42.587198  4836 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.613626  3305 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:42.621615  3341 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
W20260709 12:13:42.632130  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.596199  4851 raft_consensus.cc:697] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:42.648406  4650 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:42.649241  4650 raft_consensus.cc:697] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:42.649412  4851 consensus_queue.cc:237] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:42.650674  4650 consensus_queue.cc:237] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.656795  4808 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:42.618691  4819 raft_consensus.cc:740] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:42.639918  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:42.619176  4809 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:13:42.620236  4850 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:13:42.617492  4796 consensus_queue.cc:1059] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:13:42.666232  4652 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:42.618465  4835 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.690877  3184 raft_consensus.cc:1240] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:42.710570  4812 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:42.646826  4790 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:42.666079  4840 raft_consensus.cc:697] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:13:42.704768  4822 log.cc:927] Time spent T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:13:42.737555  4652 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:42.738217  4652 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.738071  4819 consensus_queue.cc:260] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.739408  4819 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.716701  4789 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:42.745782  4821 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:42.731496  4841 consensus_queue.cc:260] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:42.750027  4841 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.729856  4812 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:42.757411  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.771366  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:42.780892  3088 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48778 (request call id 279) took 1143 ms. Trace:
I20260709 12:13:42.782971  3342 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:42.782858  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:42.784073  3340 raft_consensus.cc:2393] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 2: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:42.784518  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:42.785956  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:42.778148  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:42.782017  3088 rpcz_store.cc:276] 0709 12:13:41.637123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.640039 (+  2916us) service_pool.cc:224] Handling call
0709 12:13:42.780812 (+1140773us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:41.955008 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:42.010489 (+ 55481us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:42.015482 (+  4993us) write_op.cc:435] Acquired schema lock
0709 12:13:42.018090 (+  2608us) tablet.cc:662] Decoding operations
0709 12:13:42.038710 (+ 20620us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:42.039478 (+   768us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:42.041296 (+  1818us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:42.054981 (+ 13685us) tablet.cc:701] Row locks acquired
0709 12:13:42.059194 (+  4213us) write_op.cc:260] PREPARE: finished
0709 12:13:42.068445 (+  9251us) write_op.cc:270] Start()
0709 12:13:42.076237 (+  7792us) write_op.cc:276] Timestamp: P: 1783599222066631 usec, L: 0
0709 12:13:42.077351 (+  1114us) op_driver.cc:348] REPLICATION: starting
0709 12:13:42.149917 (+ 72566us) log.cc:844] Serialized 538 byte log entry
0709 12:13:42.361004 (+211087us) op_driver.cc:464] REPLICATION: finished
0709 12:13:42.552184 (+191180us) write_op.cc:301] APPLY: starting
0709 12:13:42.552280 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:42.552402 (+   122us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:42.570283 (+ 17881us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:42.573340 (+  3057us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:42.573508 (+   168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:42.573556 (+    48us) write_op.cc:312] APPLY: finished
0709 12:13:42.573772 (+   216us) log.cc:844] Serialized 23 byte log entry
0709 12:13:42.573972 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.574049 (+    77us) write_op.cc:454] Released schema lock
0709 12:13:42.574096 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:42.574445 (+   349us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.574472 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":190892,"apply.run_cpu_time_us":2197,"apply.run_wall_time_us":22269,"num_ops":1,"prepare.queue_time_us":126,"prepare.run_cpu_time_us":4342,"prepare.run_wall_time_us":246751,"replication_time_us":283446,"thread_start_us":113298,"threads_started":1}]]}
I20260709 12:13:42.802670  3342 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:42.805182  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:42.804910  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:42.808475  3333 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:42.808796  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:42.812282  4812 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:42.813359  3232 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:42.812629  4867 log.cc:927] Time spent T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:13:42.824958  3927 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:42.826929  3261 raft_consensus.cc:1275] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:42.827819  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:42.828784  4858 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 12:13:42.830206  4855 log.cc:927] Time spent T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.305s	user 0.004s	sys 0.001s
I20260709 12:13:42.836793  4591 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.847594  4808 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.848496  4652 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:42.838616  3929 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:42.814410  4802 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:42.853941  4808 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:42.805560  4789 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:13:42.872308  3306 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:42.876032  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.838148  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:42.812592  4840 consensus_queue.cc:237] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:42.885540  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.890650  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:42.911584  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.041074  4838 raft_consensus.cc:993] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:42.876293  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1625) took 1143 ms. Trace:
I20260709 12:13:42.865868  4835 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.043583  4835 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.044123  4835 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.046382  4835 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:42.914063  4823 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:42.935401  4873 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.025970  3338 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:43.047209  4873 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:43.033500  4874 ts_tablet_manager.cc:933] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:43.047703  4873 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.043332  3261 rpcz_store.cc:276] 0709 12:13:41.717370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.724957 (+  7587us) service_pool.cc:224] Handling call
0709 12:13:41.792573 (+ 67616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:42.213013 (+420440us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b540013b620. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee544dc0 00007f1aee5cf1c0 00007f1aee5d0231 00007f1aee5ccd8f 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c
0709 12:13:42.502243 (+289230us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800029fd0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5290aa 00007f1aee5ab447 00007f1aee5c3fe7 00007f1aee5c57de 00007f1aee5cfb49 00007f1aee5d0416 00007f1aee5ccd8f 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4
0709 12:13:42.838269 (+336026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.860201 (+ 21932us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768259712}
I20260709 12:13:43.034080  4808 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:43.035336  4591 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:43.035413  3189 raft_consensus.cc:1240] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:43.038920  4652 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.039131  4839 raft_consensus.cc:3055] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:43.065186  4839 raft_consensus.cc:740] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:13:42.858628  4671 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:13:42.857920  4802 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.069206  4802 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.031847  4820 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.073977  4873 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.074698  4820 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.077116  4864 raft_consensus.cc:3055] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:43.077394  4873 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:43.077540  4864 raft_consensus.cc:740] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:43.061640  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.078691  3338 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
W20260709 12:13:43.047220  4806 consensus_meta.cc:287] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.507s	user 0.014s	sys 0.010s
I20260709 12:13:43.063926  4652 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.055923  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1309) took 1290 ms. Trace:
I20260709 12:13:43.066674  4839 consensus_queue.cc:260] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.077414  4820 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.092742  4673 consensus_queue.cc:260] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.093823  4802 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.095548  4864 consensus_queue.cc:260] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:43.101045  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 322954us
I20260709 12:13:43.108647  4687 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.109967  4652 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:43.110255  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.111182  3188 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:43.113313  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.102411  3193 rpcz_store.cc:276] 0709 12:13:41.759362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.759598 (+   236us) service_pool.cc:224] Handling call
0709 12:13:42.222363 (+462765us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b5800002a98. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:13:42.222565 (+   202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:42.222926 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:42.222961 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:42.226806 (+  3845us) log.cc:844] Serialized 26 byte log entry
0709 12:13:42.487131 (+260325us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:42.487192 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.487285 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.728406 (+241121us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:13:43.048987 (+320581us) raft_consensus.cc:1685] finished
0709 12:13:43.049008 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.049147 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"spinlock_wait_cycles":20701824,"thread_start_us":259906,"threads_started":1,"wal-append.queue_time_us":297947}
I20260709 12:13:43.104387  4806 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.118852  3895 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:43.147363  4687 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.168282  4880 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.108703  4869 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.115507  4839 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.144462  4673 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.169183  4821 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.174809  4863 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:43.173157  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.147735  4835 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.184651  3185 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:43.185950  4868 raft_consensus.cc:1081] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:43.173326  4706 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.175958  4864 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.188566  4835 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.179677  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.198709  4802 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.199070  4879 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.199568  4687 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.200769  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:43.201475  3338 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.184244  4880 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.206084  4880 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.190925  3334 raft_consensus.cc:1240] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:43.183729  4821 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.198741  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:43.210111  3931 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:43.183113  4863 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.211459  3187 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:43.227361  3931 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:43.222800  4874 tablet_copy_client.cc:323] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.66:38853
I20260709 12:13:43.240944  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.218633  4836 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:43.223570  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:43.199590  4879 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.248785  3278 tablet_copy_service.cc:140] P 1ef05c9d901046dca7fe0e638cc693b9: Received BeginTabletCopySession request for tablet a85351bf981e43bea61620452a2c7b3a from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:40120)
I20260709 12:13:43.249636  3278 tablet_copy_service.cc:161] P 1ef05c9d901046dca7fe0e638cc693b9: Beginning new tablet copy session on tablet a85351bf981e43bea61620452a2c7b3a from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:40120: session id = 6f0cdd57c5934921829c205d32b2b8a5-a85351bf981e43bea61620452a2c7b3a
I20260709 12:13:43.253849  4721 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:43.254413  4721 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.254417  3337 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:43.258630  4863 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.259378  4836 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.261807  4667 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:43.262051  4836 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.262420  4667 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.263586  3340 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:43.265003  4785 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:43.265532  4785 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.266732  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.267467  3337 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:43.267658  4789 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.268224  4789 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.270478  4802 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.271008  4802 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.279872  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.280921  4721 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.281374  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:43.281982  3184 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.283735  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.284369  3191 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:43.284443  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.285082  3193 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:43.285351  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.285902  3191 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:43.287132  3189 raft_consensus.cc:1240] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:43.289860  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.291947  4835 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:43.292548  4835 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.293045  4835 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.295265  4820 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:43.296196  4789 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.237272  4840 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:43.295284  4835 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.297335  4840 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.300413  3896 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.307682  4840 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.313042  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.277598  4821 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.319700  3278 tablet_copy_source_session.cc:215] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:43.308322  4836 consensus_queue.cc:1048] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:13:43.330287  4873 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.330838  4873 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.331740  3306 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.333098  4806 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:43.333392  4873 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:43.334566  3186 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:43.334724  3306 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.335629  4873 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.336122  4873 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:43.336609  4873 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.337093  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:43.320060  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.320539  4879 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.339035  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:43.321739  3925 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:43.325363  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.345405  3188 raft_consensus.cc:2393] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:43.333751  4806 raft_consensus.cc:697] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:43.345713  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.339780  4819 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:13:43.345721  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.348064  4821 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:43.348307  4802 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.346683  4806 consensus_queue.cc:237] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.351046  4671 raft_consensus.cc:2955] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:43.342319  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.346347  3339 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:43.359802  3342 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:43.366315  3190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40510 (request call id 1603) took 1273 ms. Trace:
I20260709 12:13:43.366565  3306 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:43.371886  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 254450us
I20260709 12:13:43.377653  4819 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:43.378336  4819 raft_consensus.cc:697] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:43.379365  4819 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.380221  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.380889  3333 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:43.382040  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.382155  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.383028  3341 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:43.385175  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.384037  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.390237  3188 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:43.308883  4820 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.395833  3232 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.397394  3232 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.400658  3338 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:13:43.406805  3188 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:13:43.408905  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.411110  3334 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:43.412596  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 107139us
I20260709 12:13:43.414804  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.415608  3185 raft_consensus.cc:2393] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:43.416352  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.416639  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.416915  3185 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:43.417250  3186 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:43.417699  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.418082  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:43.406286  4802 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.418707  3186 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.419935  3090 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48786 (request call id 301) took 1676 ms. Trace:
I20260709 12:13:43.418794  4802 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.721359  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:43.418265  3185 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:43.433226  3185 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:43.430349  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.433526  3192 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:43.403442  3232 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.423125  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:43.424403  3895 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:43.434863  3188 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.399776  4820 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.403776  4821 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.420326  3090 rpcz_store.cc:276] 0709 12:13:41.743332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.743481 (+   149us) service_pool.cc:224] Handling call
0709 12:13:43.419875 (+1676394us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:42.150404 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:42.150971 (+   567us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:42.151002 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:13:42.151020 (+    18us) tablet.cc:662] Decoding operations
0709 12:13:42.151415 (+   395us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:42.151495 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:42.151523 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:13:42.151827 (+   304us) tablet.cc:701] Row locks acquired
0709 12:13:42.151845 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:13:42.151982 (+   137us) write_op.cc:270] Start()
0709 12:13:42.152094 (+   112us) write_op.cc:276] Timestamp: P: 1783599222151940 usec, L: 0
0709 12:13:42.152115 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:13:42.152774 (+   659us) log.cc:844] Serialized 923 byte log entry
0709 12:13:42.500078 (+347304us) op_driver.cc:464] REPLICATION: finished
0709 12:13:42.574791 (+ 74713us) write_op.cc:301] APPLY: starting
0709 12:13:42.574867 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:42.574989 (+   122us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:42.575081 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:42.575391 (+   310us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:42.591228 (+ 15837us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:13:42.596390 (+  5162us) write_op.cc:312] APPLY: finished
0709 12:13:42.622227 (+ 25837us) log.cc:844] Serialized 29 byte log entry
0709 12:13:42.664862 (+ 42635us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.667883 (+  3021us) write_op.cc:454] Released schema lock
0709 12:13:42.667928 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:42.670487 (+  2559us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.670525 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":88287,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":74515,"apply.run_cpu_time_us":2306,"apply.run_wall_time_us":95609,"num_ops":2,"prepare.queue_time_us":195520,"prepare.run_cpu_time_us":2688,"prepare.run_wall_time_us":13613,"replication_time_us":347680,"spinlock_wait_cycles":29440,"thread_start_us":97331,"threads_started":1}]]}
I20260709 12:13:43.435395  3232 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.443135  3232 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.444957  3232 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.456496  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.457432  3193 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:13:43.457887  3193 pending_rounds.cc:85] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3: Aborting all ops after (but not including) 4
I20260709 12:13:43.460094  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:43.471648  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 47328.4us
I20260709 12:13:43.434365  4678 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.471098  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.434626  4802 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.458168  3193 pending_rounds.cc:107] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:13:43.482957  3193 raft_consensus.cc:2889] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:43.434528  4891 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.477346  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:43.484614  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.440665  4820 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.440665  4789 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:43.493708  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:43.494014  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.494400  3266 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:43.455864  4840 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.495651  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:43.501724  3231 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:43.512791  3089 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48764 (request call id 294) took 1149 ms. Trace:
I20260709 12:13:43.516620  3089 rpcz_store.cc:276] 0709 12:13:42.363209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.363405 (+   196us) service_pool.cc:224] Handling call
0709 12:13:42.515334 (+151929us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400189f54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee537090 00007f1aee5d5f3a 00007f1af438be9c 00007f1af448a04e 00007f1af294b2a4 00007f1af294b232 00007f1af294b161 00007f1af294b0dc 00007f1af294a392 00007f1aec90848c 00007f1aec9078c6
0709 12:13:43.512706 (+997372us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":674592,"reported_tablets":1,"spinlock_wait_cycles":256960256}
W20260709 12:13:43.517539  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 72661us
I20260709 12:13:43.455092  4821 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.517361  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:43.518500  4821 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.518951  3263 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:13:43.520124  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:43.521195  3263 raft_consensus.cc:2393] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:43.522017  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:43.523279  3263 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:43.525022  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:43.527674  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:43.528867  3263 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:43.500022  3188 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:43.508708  3157 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.540714  3192 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:43.456231  4670 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.438578  4591 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:13:43.489181  4851 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.453418  4808 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:13:43.494607  3927 raft_consensus.cc:1240] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:43.495361  4789 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:43.591853  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 83230.8us
I20260709 12:13:43.510978  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:43.515179  4840 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:43.557195  4859 log.cc:927] Time spent T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:13:43.551136  4650 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.550956  4809 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.552536  4667 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.548003  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.586355  4851 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.585603  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:43.625283  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:43.608920  4840 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.610054  4890 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:43.627946  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:43.593113  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:43.495584  4891 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.490993  4678 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.630851  4905 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:43.610391  4809 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.610816  4650 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.631975  4667 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:43.631096  3267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:56758
I20260709 12:13:43.592458  4889 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.600711  4789 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:43.642841  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 124332us
I20260709 12:13:43.645661  3157 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.630174  4851 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.625872  4903 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.655398  3267 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:43.647912  3187 raft_consensus.cc:2393] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 2: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:43.661724  3267 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.641562  3186 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:43.669466  3157 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:43.654657  4809 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.636264  4827 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:13:43.650753  3260 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:43.654861  4650 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.672643  4673 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.675642  4891 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.658128  4785 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:43.658205  4889 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.693730  4848 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:13:43.664038  4903 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.644927  4890 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.685317  4839 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.710139  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.660952  4667 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.692359  4673 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:43.704628  4889 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.716566  4839 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.707855  4903 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.739243  4673 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.366914  3190 rpcz_store.cc:276] 0709 12:13:42.092496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.105187 (+ 12691us) service_pool.cc:224] Handling call
0709 12:13:42.105834 (+   647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:42.188280 (+ 82446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:42.188313 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:42.188789 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:13:42.449255 (+260466us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:42.481645 (+ 32390us) log.cc:844] Serialized 14 byte log entry
0709 12:13:42.520266 (+ 38621us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b1800311b00. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
0709 12:13:42.643452 (+123186us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b1800311b00. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb45ac0a 00007f1af4b9a219 00007f1aee183d70 00007f1aee177293 00007f1aee16ccea 00007f1aee16d23a 00007f1aee5d7a2a 00007f1aee5e70bf 00007f1aee5e7038
0709 12:13:43.174489 (+531037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.365885 (+191396us) spinlock_profiling.cc:243] Waited 82.1 ms on lock 0x7b54001b21d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:43.365968 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:43.366034 (+    66us) raft_consensus.cc:1685] finished
0709 12:13:43.366059 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.366238 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":356939,"prepare.queue_time_us":18555,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":404097,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":96,"spinlock_wait_cycles":200620672,"thread_start_us":547102,"threads_started":2,"wal-append.queue_time_us":283510}
I20260709 12:13:43.777269  4667 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:43.778033  4906 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.767567  4839 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.804437  3087 catalog_manager.cc:5697] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 4, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 4 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.820005  4884 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:43.836510  4890 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:43.831852  3184 consensus_meta.cc:287] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.549s	user 0.005s	sys 0.007s
I20260709 12:13:43.852052  3267 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.857574  3267 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:43.847317  4873 consensus_meta.cc:287] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 12:13:43.873888  4884 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.854415  3184 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:13:43.886847  4678 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:43.926126  4897 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.927029  4897 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.930279  4897 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:43.932319  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 430658us
I20260709 12:13:43.873893  4873 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:43.941740  3231 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:43.949038  3231 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:43.947943  4808 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:13:43.957624  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.946012  4897 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.963522  3231 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:43.965607  3231 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:43.974177  3231 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:43.979022  3231 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:43.966380  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:43.984222  4904 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:13:43.964915  4667 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.999061  4904 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:43.964756  4897 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.964260  4785 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:13:43.981145  4884 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:43.963529  4808 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.997419  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:43.975189  4903 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:43.967125  4821 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:44.013700  4902 log.cc:927] Time spent T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.323s	user 0.006s	sys 0.000s
I20260709 12:13:44.010679  4897 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.014755  4667 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:44.031311  3265 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:44.003466  4802 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:44.013515  4650 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:44.031782  3925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.012s	sys 0.010s
I20260709 12:13:44.045783  3264 raft_consensus.cc:1240] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:44.026813  3184 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
W20260709 12:13:44.049114  3925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.013s	sys 0.010s
W20260709 12:13:44.049647  4898 log.cc:927] Time spent T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:13:44.030464  4905 raft_consensus.cc:697] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:44.027908  4851 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:44.071249  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:44.064702  4785 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:44.062049  4904 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:13:44.087626  4873 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:44.097333  4807 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:44.099704  4785 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:44.134406  4673 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:44.121150  4833 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:44.120323  4908 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.124683  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:13:44.165678  3232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.023s	sys 0.017s
W20260709 12:13:44.168232  3232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.023s	sys 0.017s
W20260709 12:13:44.168541  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 506760us
I20260709 12:13:44.144954  4667 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.143132  4807 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:13:44.179469  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 388100us
I20260709 12:13:44.194038  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.195029  3261 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 2: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:44.178735  4905 consensus_queue.cc:237] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:44.199072  4809 consensus_meta.cc:287] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.507s	user 0.002s	sys 0.006s
I20260709 12:13:44.199812  4650 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:44.177559  4908 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:44.201112  4835 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.201696  4835 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:44.202250  4820 consensus_meta.cc:287] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.655s	user 0.013s	sys 0.000s
I20260709 12:13:44.202523  4908 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.202726  4820 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:44.121902  4909 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:44.203887  4909 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:44.204507  4673 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.204360  4909 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:44.204708  4835 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:44.165066  4907 log.cc:927] Time spent T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:13:44.157112  4785 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.203107  4908 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:13:44.157843  4812 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.021s	sys 0.016s
I20260709 12:13:44.176024  4671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:40112 (request call id 10) took 2907 ms. Trace:
W20260709 12:13:44.209519  4900 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:13:44.207604  4667 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:44.217636  4812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.021s	sys 0.016s
I20260709 12:13:44.223270  3927 raft_consensus.cc:2368] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4.
I20260709 12:13:44.223779  4827 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.223062  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:44.226616  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:44.229724  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:13:44.277719  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 292824us
I20260709 12:13:44.236276  3186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:13:44.252432  4889 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:44.253649  4840 consensus_meta.cc:287] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.003s
I20260709 12:13:44.256108  4802 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.255625  4909 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:44.256815  4851 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:44.257189  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:44.257601  4821 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.216471  4908 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:44.221410  4671 rpcz_store.cc:276] 0709 12:13:41.250570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.250704 (+   134us) service_pool.cc:224] Handling call
0709 12:13:41.276440 (+ 25736us) log.cc:844] Serialized 499 byte log entry
0709 12:13:41.503608 (+227168us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b1800370ae0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
0709 12:13:44.157606 (+2653998us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73556,"raft.queue_time_us":112056,"raft.run_cpu_time_us":1973,"raft.run_wall_time_us":17945,"spinlock_wait_cycles":5306240,"thread_start_us":38735,"threads_started":1,"wal-append.queue_time_us":146634,"wal-append.run_cpu_time_us":4169,"wal-append.run_wall_time_us":1445478}
I20260709 12:13:44.219734  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:44.207890  4807 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.164856  4833 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:44.278539  3929 raft_consensus.cc:2393] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 3: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:44.278534  3231 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:44.217248  4808 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:13:44.292197  3156 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.625s (SENT) [suppressed 27 similar messages]
I20260709 12:13:44.209544  4809 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:44.278448  4820 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.319666  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:44.292714  4591 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:44.276995  4839 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:44.342152  3305 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.021s	sys 0.023s
I20260709 12:13:44.386289  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:44.310959  3186 raft_consensus.cc:606] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:44.396803  3267 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.293394  4827 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:44.399128  3305 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.022s	sys 0.023s
W20260709 12:13:44.402442  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 908427us
I20260709 12:13:44.385720  4809 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:44.298976  4840 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:44.312475  3928 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:44.405308  3305 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:44.386209  4821 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.401909  3186 raft_consensus.cc:614] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:44.397104  4911 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:44.442019  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.443135  3232 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:44.448822  4839 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.449878  4908 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:44.413079  4903 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.455785  4812 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:44.456614  4812 raft_consensus.cc:697] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:44.457824  4812 consensus_queue.cc:237] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:44.461615  4789 consensus_meta.cc:287] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.004s
I20260709 12:13:44.461933  4827 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:44.462157  4789 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:44.464277  4840 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.465094  4789 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:44.466256  4889 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.469396  3265 raft_consensus.cc:2368] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5.
I20260709 12:13:44.472663  3267 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:44.474133  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:44.474795  3333 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:44.448683  4874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85351bf981e43bea61620452a2c7b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.476843  3157 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:44.481778  3306 leader_election.cc:400] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4.
I20260709 12:13:44.482148  3306 leader_election.cc:403] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:13:44.483098  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:44.483776  3928 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.402797  4591 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:44.489652  4591 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:44.491403  4667 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.492309  4789 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:44.492900  4789 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:44.496899  4789 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.411837  4851 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:13:44.501307  4851 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.504570  4833 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.508126  3928 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:13:44.530299  3232 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:44.533023  3266 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:44.496565  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:44.535483  4848 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:44.542105  4848 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:44.544641  4848 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.544440  4789 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:44.545320  4866 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.545883  4866 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:44.547168  4789 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:44.547926  4866 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:44.548494  4866 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.548903  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:44.549253  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1646) took 1055 ms. Trace:
I20260709 12:13:44.549662  3262 rpcz_store.cc:276] 0709 12:13:43.493818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.494578 (+   760us) service_pool.cc:224] Handling call
0709 12:13:43.495158 (+   580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.945388 (+450230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.945437 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:43.949969 (+  4532us) log.cc:844] Serialized 26 byte log entry
0709 12:13:44.328989 (+379020us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:44.395838 (+ 66849us) log.cc:844] Serialized 14 byte log entry
0709 12:13:44.396061 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.396137 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.507933 (+111796us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b480018c258. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af34f6aa1 00007f1af34edb37 00007f1af34ed9ca 00007f1af35e526f 00007f1af35e4f37 00007f1af35f955c 00007f1af35f9508 00007f1af35f9488 00007f1af35f9443 00007f1af35f86ec 00007f1af2522a96
0709 12:13:44.548993 (+ 41060us) raft_consensus.cc:1685] finished
0709 12:13:44.549083 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.549198 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":67234,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":242993,"raft.run_cpu_time_us":3413,"raft.run_wall_time_us":109047,"spinlock_wait_cycles":8569216,"thread_start_us":752081,"threads_started":2,"wal-append.queue_time_us":573448}
I20260709 12:13:44.548934  4866 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:44.554594  4866 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.558833  3928 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:44.562146  3232 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:44.563220  4789 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:44.563849  4789 raft_consensus.cc:697] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:44.566753  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:44.567338  3342 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.567826  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:44.568531  3341 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.569353  4808 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:44.569967  4808 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:44.574117  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:44.578625  3342 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
W20260709 12:13:44.580487  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 358196us
I20260709 12:13:44.423569  4809 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:13:44.587781  3341 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:44.582052  3157 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:44.594698  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:44.564990  4789 consensus_queue.cc:237] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:44.579921  4904 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:44.536667  4889 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:44.603186  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.579998  4673 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.607219  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:44.645200  3263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.065s	sys 0.073s
W20260709 12:13:44.645607  3263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.065s	sys 0.073s
I20260709 12:13:44.575171  4785 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:44.647188  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.605305  4890 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:44.651859  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.664579  3265 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:44.609724  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:44.668325  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.686754  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.687614  3265 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:44.688656  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:44.689524  3265 raft_consensus.cc:2393] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:44.681439  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:44.690881  3924 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:44.650717  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:44.698468  4808 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:44.699106  3337 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:44.700790  4785 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:44.643221  4673 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:44.705089  4673 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:44.705168  4821 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:44.706895  4807 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:44.709143  4807 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:44.684406  4890 raft_consensus.cc:697] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:44.710778  4890 consensus_queue.cc:237] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:44.715327  3261 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:44.724401  3261 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:44.725800  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.740272  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.741130  3266 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:13:44.757339  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 352064us
W20260709 12:13:44.766070  3139 auto_rebalancer.cc:629] Failed to schedule move for tablet 1c7c3fc93e9d456eb83867c8095af00c: Illegal state: Replica eb49d92feeb14382b3baa49d696b6141 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:13:44.658862  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:44.644177  4889 raft_consensus.cc:697] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:44.638242  4904 raft_consensus.cc:697] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:13:44.650544  4897 consensus_meta.cc:287] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.001s
I20260709 12:13:44.772384  3267 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.812803  3265 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:13:44.813956  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 343253us
I20260709 12:13:44.815177  3262 raft_consensus.cc:1275] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.767688  4827 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
W20260709 12:13:44.822360  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 530150us
I20260709 12:13:44.828157  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:44.830688  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:44.831384  3262 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.833400  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:44.836773  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:44.837597  3191 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.843647  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:44.844681  3266 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:44.858258  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:44.859174  3185 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.772926  4851 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4.
I20260709 12:13:44.840332  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:44.862141  3193 raft_consensus.cc:2393] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:44.865576  3265 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.870848  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:44.864267  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 265488us
W20260709 12:13:44.778151  4929 log.cc:927] Time spent T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.055s	user 0.002s	sys 0.000s
I20260709 12:13:44.872849  3259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1657) took 1371 ms. Trace:
I20260709 12:13:44.875358  3267 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:44.871655  3266 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:44.876989  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:44.877580  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.878134  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.878662  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.873373  3259 rpcz_store.cc:276] 0709 12:13:43.501404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.680885 (+179481us) service_pool.cc:224] Handling call
0709 12:13:43.681352 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:44.158014 (+476662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:44.161856 (+  3842us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:44.192710 (+ 30854us) log.cc:844] Serialized 26 byte log entry
0709 12:13:44.418223 (+225513us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:44.613627 (+195404us) log.cc:844] Serialized 14 byte log entry
0709 12:13:44.649444 (+ 35817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.665479 (+ 16035us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.720661 (+ 55182us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b1800311200. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4ae2a6 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1
0709 12:13:44.722148 (+  1487us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b1800311200. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
0709 12:13:44.872598 (+150450us) raft_consensus.cc:1685] finished
0709 12:13:44.872629 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.872785 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20674,"prepare.queue_time_us":126388,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":5657,"raft.queue_time_us":112760,"raft.run_cpu_time_us":475,"raft.run_wall_time_us":33423,"spinlock_wait_cycles":38329856,"thread_start_us":685604,"threads_started":2,"wal-append.queue_time_us":450418}
W20260709 12:13:44.880982  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 95320us
I20260709 12:13:44.884913  3156 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:44.871661  3185 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:44.887240  3157 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:44.888701  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:44.908139  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:44.908638  3305 leader_election.cc:400] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5.
I20260709 12:13:44.908939  3266 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:44.912283  3262 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:44.913853  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.936429  3265 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:44.941253  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.887518  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:44.780233  4897 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:44.950099  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:44.917786  4678 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:44.948185  4898 log.cc:927] Time spent T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:13:44.864068  4827 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:44.953743  3192 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:13:44.942734  4937 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.982657  3260 raft_consensus.cc:1240] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:44.957020  4873 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:13:44.998342  3139 auto_rebalancer.cc:629] Failed to schedule move for tablet 94318f741f4143469cf9140cb1be3c4c: Illegal state: Replica eb49d92feeb14382b3baa49d696b6141 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:13:44.961275  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:44.961649  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:44.965093  4678 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.961968  4851 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:13:45.009387  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:45.022233  3193 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:44.973352  4848 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:45.001778  3261 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 2: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:44.973151  4889 consensus_queue.cc:237] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.008627  4678 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.021454  4873 raft_consensus.cc:697] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:45.059340  3928 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:45.061882  3927 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:45.063898  3924 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:45.031049  4848 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:45.075071  4848 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:44.972992  4904 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:44.991654  4937 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.030910  4946 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.076638  3925 raft_consensus.cc:2410] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:13:45.076694  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 253143us
I20260709 12:13:45.097186  3191 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:45.069662  4866 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:45.107949  4939 log.cc:927] Time spent T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:13:45.108208  4927 log.cc:927] Time spent T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 12:13:45.110088  3263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1649) took 1612 ms. Trace:
I20260709 12:13:45.110494  3263 rpcz_store.cc:276] 0709 12:13:43.497553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.531711 (+ 34158us) service_pool.cc:224] Handling call
0709 12:13:43.532224 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.866206 (+333982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.866251 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:43.874063 (+  7812us) log.cc:844] Serialized 26 byte log entry
0709 12:13:44.645976 (+771913us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:45.033459 (+387483us) log.cc:844] Serialized 14 byte log entry
0709 12:13:45.033752 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.036457 (+  2705us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:45.109873 (+ 73416us) raft_consensus.cc:1685] finished
0709 12:13:45.109896 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.110030 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38626,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":246195,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":8558,"thread_start_us":1454480,"threads_started":3,"wal-append.queue_time_us":946710}
W20260709 12:13:45.117455  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 206277us
I20260709 12:13:45.118909  3305 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:45.121621  4866 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:45.131002  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:45.131951  4866 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:45.132145  3189 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.118782  4808 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
W20260709 12:13:45.136282  4936 log.cc:927] Time spent T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 12:13:45.139967  4940 log.cc:927] Time spent T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.112s	user 0.003s	sys 0.000s
I20260709 12:13:45.143800  4897 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:45.148288  3157 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:45.154217  3157 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:45.127364  4942 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:13:45.169858  4839 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:45.170378  4839 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.170751  4839 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.153241  4809 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:45.123697  4950 log.cc:927] Time spent T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:13:45.183100  4678 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:45.189813  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 60920us
I20260709 12:13:45.205791  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:45.208261  3342 raft_consensus.cc:1240] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:13:45.146199  3334 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:13:45.152755  4866 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:45.161226  4946 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:45.211176  3342 raft_consensus.cc:2955] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:45.215860  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:45.216974  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:45.218182  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:45.167263  3189 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:45.218338  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:45.220256  3338 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:45.219383  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:45.221503  3333 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.224768  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:45.225466  3336 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.210774  4884 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.209684  4942 consensus_queue.cc:1048] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:13:45.231467  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:45.231990  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:45.234119  3338 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:45.202692  4808 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:13:45.234941  4946 raft_consensus.cc:697] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:45.243316  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:45.245658  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 360810us
I20260709 12:13:45.247360  3156 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:45.289449  3156 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:45.297379  3156 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:45.218353  4866 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:45.295656  4879 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:45.340233  4827 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:45.221846  4873 consensus_queue.cc:237] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.300185  4673 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:45.299816  4840 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.334651  4911 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:45.243330  4884 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:45.350241  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:45.352587  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:45.362193  3338 raft_consensus.cc:2368] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3.
I20260709 12:13:45.349066  3333 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:45.344748  4879 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:45.365175  3335 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:45.294747  4946 consensus_queue.cc:237] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.366890  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:45.478039  3341 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:45.483784  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:45.486763  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:45.487676  3192 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:45.488860  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:13:45.489745  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 192440us
I20260709 12:13:45.491252  3156 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:45.369608  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:45.495111  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 125632us
I20260709 12:13:45.498073  4964 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:45.464890  4839 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.497817  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:45.499511  3232 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:45.497493  3926 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:13:45.380657  4948 log.cc:927] Time spent T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:13:45.363988  4961 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:45.503964  3156 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:45.496050  4879 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.508422  3187 raft_consensus.cc:1275] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:45.363917  4911 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:45.512075  4967 log.cc:927] Time spent T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:13:45.512372  4839 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:45.513731  4911 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:45.513782  4650 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:45.514460  4911 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:45.514864  4911 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.515192  4911 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:45.517014  4969 log.cc:927] Time spent T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:13:45.523653  3260 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:45.525509  4884 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:45.527287  3156 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:45.473278  4956 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:45.505601  4961 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:45.529186  3336 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:45.392385  4937 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:45.504666  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:45.393077  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:13:45.532691  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 178695us
I20260709 12:13:45.500399  4897 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:45.533835  4809 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.437615  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:45.537181  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:45.359474  4840 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.364272  4785 consensus_queue.cc:1059] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.168s
I20260709 12:13:45.536477  4957 raft_consensus.cc:2804] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:45.522964  4879 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.552459  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:45.545495  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:45.566706  3339 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.531953  4889 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.539963  3333 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:45.528172  4964 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:45.571281  4964 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.571703  4964 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.381268  4789 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:45.528602  4678 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:45.564517  3896 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:45.533208  4961 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.532133  4650 raft_consensus.cc:697] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:45.533896  4673 consensus_queue.cc:1059] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 12:13:45.565850  4976 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:13:45.569703  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:45.583166  3339 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:45.585932  3184 raft_consensus.cc:1240] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:45.586670  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:45.566250  4965 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:45.563084  4957 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:45.577095  4910 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:45.534554  4956 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:45.595075  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 98633.8us
I20260709 12:13:45.568305  4941 consensus_queue.cc:1059] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:13:45.636224  4785 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:45.639420  4956 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:45.578490  4897 raft_consensus.cc:3055] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:45.643257  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:45.594542  4851 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:45.591990  3923 raft_consensus.cc:2393] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 4: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:45.649781  3264 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
W20260709 12:13:45.630266  4874 consensus_meta.cc:287] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.901s	user 0.011s	sys 0.000s
I20260709 12:13:45.616707  4957 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.616873  4866 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:45.659694  3895 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:45.582248  4789 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:45.665657  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 93760.8us
I20260709 12:13:45.627012  4879 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:45.623916  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:45.617301  4965 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:45.673252  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 84532.3us
I20260709 12:13:45.632606  4910 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:45.649544  4897 raft_consensus.cc:740] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:45.676700  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:45.677382  4670 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:45.657217  4956 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:45.675400  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:45.686702  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:45.688339  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:45.689713  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:45.688508  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:45.669549  4785 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:45.671546  4706 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:45.701874  4706 raft_consensus.cc:697] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:45.702008  4911 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.625006  4650 consensus_queue.cc:237] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.659257  4978 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:13:45.695106  4785 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.696797  4982 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:45.698764  4789 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:45.684105  4670 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.680387  4910 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.694603  4879 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:45.739240  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 208111us
I20260709 12:13:45.701236  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55426 (request call id 333) took 3031 ms. Trace:
I20260709 12:13:45.704838  4673 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:13:45.743726  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 67093.9us
I20260709 12:13:45.740103  3156 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:45.717448  4911 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:45.702847  4706 consensus_queue.cc:237] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:45.753906  4785 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:45.692567  4956 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:45.726043  4670 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.773720  3925 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:45.774015  4839 raft_consensus.cc:3055] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:45.715165  4678 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:13:45.738729  4982 raft_consensus.cc:697] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:45.777029  3926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:13:45.741658  4874 rpcz_store.cc:276] 0709 12:13:42.677379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.689039 (+ 11660us) service_pool.cc:224] Handling call
0709 12:13:43.047745 (+358706us) ts_tablet_manager.cc:934] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
0709 12:13:44.282851 (+1235106us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:13:44.707057 (+424206us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:44.707176 (+   119us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:13:45.675882 (+968706us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:13:45.695324 (+ 19442us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:45.701079 (+  5755us) ts_tablet_manager.cc:989] Replica registered.
0709 12:13:45.701150 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":8845,"tablet-copy.queue_time_us":320949,"thread_start_us":420966,"threads_started":2}
I20260709 12:13:45.779559  4977 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:45.781824  4961 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.782279  4957 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:45.743134  4897 consensus_queue.cc:260] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.755110  4673 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:45.785053  4964 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.819278  4874 tablet_copy_client.cc:806] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
W20260709 12:13:45.792642  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 47717.6us
I20260709 12:13:45.774387  4839 raft_consensus.cc:740] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:45.848356  4591 raft_consensus.cc:3055] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:45.848785  4591 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:45.848971  3305 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:45.849114  4839 consensus_queue.cc:260] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.849598  4591 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:45.850383  4839 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.850037  4982 consensus_queue.cc:237] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:45.850798  4591 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.775923  4840 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:45.822438  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:45.819227  4965 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:45.824234  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:45.825176  4673 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:45.827313  4957 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:45.884217  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:45.831770  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:45.806799  3926 raft_consensus.cc:606] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:45.773617  3189 consensus_queue.cc:237] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:45.835599  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:45.847615  4956 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:45.742790  4851 raft_consensus.cc:697] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:45.870229  4941 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:45.868058  4650 raft_consensus.cc:2764] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:13:45.874248  4961 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:45.890447  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 150417us
I20260709 12:13:45.892383  3336 raft_consensus.cc:1240] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:45.870436  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:45.879760  4874 tablet_copy_client.cc:670] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
W20260709 12:13:45.953933  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 103041us
I20260709 12:13:45.975963  3157 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:45.974205  3156 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:45.975064  3087 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34704 (request call id 177) took 3439 ms. Trace:
I20260709 12:13:45.893373  4840 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.982352  4840 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:45.985487  4840 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:45.982125  3087 rpcz_store.cc:276] 0709 12:13:42.535484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.535754 (+   270us) service_pool.cc:224] Handling call
0709 12:13:43.045430 (+509676us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b5400189f54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee537090 00007f1aee5d5f3a 00007f1af438be9c 00007f1af448a04e 00007f1af294b2a4 00007f1af294b232 00007f1af294b161 00007f1af294b0dc 00007f1af294a392 00007f1aec90848c 00007f1aec9078c6
0709 12:13:45.974968 (+2929538us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:44.245411 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:44.245956 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:44.245991 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:13:44.246007 (+    16us) tablet.cc:662] Decoding operations
0709 12:13:44.246327 (+   320us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:44.246406 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:44.246435 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:44.246606 (+   171us) tablet.cc:701] Row locks acquired
0709 12:13:44.246623 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:13:44.246745 (+   122us) write_op.cc:270] Start()
0709 12:13:44.246848 (+   103us) write_op.cc:276] Timestamp: P: 1783599224246706 usec, L: 0
0709 12:13:44.246867 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:13:44.247557 (+   690us) log.cc:844] Serialized 533 byte log entry
0709 12:13:45.135337 (+887780us) op_driver.cc:464] REPLICATION: finished
0709 12:13:45.356012 (+220675us) write_op.cc:301] APPLY: starting
0709 12:13:45.360270 (+  4258us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:45.382613 (+ 22343us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:45.458751 (+ 76138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:45.482814 (+ 24063us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:45.526590 (+ 43776us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:45.526648 (+    58us) write_op.cc:312] APPLY: finished
0709 12:13:45.563207 (+ 36559us) log.cc:844] Serialized 23 byte log entry
0709 12:13:45.571165 (+  7958us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:45.571265 (+   100us) write_op.cc:454] Released schema lock
0709 12:13:45.571311 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:45.571690 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:45.571724 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":468721,"reported_tablets":2,"spinlock_wait_cycles":174155136,"child_traces":[["op",{"apply.queue_time_us":211244,"apply.run_cpu_time_us":2733,"apply.run_wall_time_us":220400,"num_ops":1,"prepare.queue_time_us":393595,"prepare.run_cpu_time_us":16429,"prepare.run_wall_time_us":368438,"raft.queue_time_us":370630,"raft.run_cpu_time_us":19308,"raft.run_wall_time_us":195131,"replication_time_us":857051,"thread_start_us":990821,"threads_started":4,"wal-append.queue_time_us":467440}]]}
W20260709 12:13:46.056532  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 76894.1us
W20260709 12:13:46.060292  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.093098  4941 consensus_queue.cc:1059] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:46.093459  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 119356us
I20260709 12:13:46.093660  4964 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:46.094321  4964 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:46.094878  4989 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:46.094936  4964 raft_consensus.cc:697] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:13:46.096256  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 155730us
I20260709 12:13:46.096458  4957 raft_consensus.cc:3055] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:46.094280  3156 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:46.110226  3156 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:46.112001  4946 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:46.112581  4946 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:46.113011  4946 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.108233  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:46.129101  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:46.130352  4998 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.106966  4957 raft_consensus.cc:740] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:46.167362  4670 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.168412  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:46.169453  4961 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:46.176687  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 66562.8us
I20260709 12:13:45.988843  4874 tablet_copy_client.cc:538] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:46.132258  4851 consensus_queue.cc:237] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.204377  4840 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.205209  4840 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.208694  4840 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:46.225378  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 210736us
I20260709 12:13:46.216709  3156 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:46.196789  4879 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.197660  4983 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:46.229269  4840 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.245431  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:46.259908  5000 log.cc:927] Time spent T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:13:46.260854  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:46.261662  3926 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:46.197235  4964 consensus_queue.cc:237] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.251820  4956 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.280177  3157 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:46.280928  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:46.281188  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 223896us
I20260709 12:13:46.282532  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.284976  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.285699  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.285930  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.286270  3188 raft_consensus.cc:3055] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:46.286613  3188 raft_consensus.cc:740] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:46.287444  3185 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:13:46.278074  4910 consensus_meta.cc:287] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 12:13:46.229574  4911 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:46.211228  4946 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.300323  3188 consensus_queue.cc:260] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.312887  3188 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.210753  4957 consensus_queue.cc:260] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.289901  4670 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:46.295804  4983 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:46.329432  3188 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:46.330406  3191 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:46.352259  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:46.353044  3264 raft_consensus.cc:2393] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:46.396977  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.287473  4840 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.398154  3188 raft_consensus.cc:2393] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:13:46.405644  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 123657us
I20260709 12:13:46.407531  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:46.407858  3232 leader_election.cc:400] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3.
I20260709 12:13:46.408197  3232 leader_election.cc:403] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:46.408144  3264 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.304948  4673 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:46.311549  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.417981  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.418762  3190 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.421954  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:13:46.393376  3924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.003s	sys 0.033s
I20260709 12:13:46.328913  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.422784  3188 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:46.306128  4910 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.433027  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.312125  4911 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.436825  3333 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:46.433209  3337 raft_consensus.cc:1275] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:46.423501  4957 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:46.453416  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 142626us
I20260709 12:13:46.443141  5005 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:46.453480  4846 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:13:46.502190  4673 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:46.512696  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:13:46.521718  5007 log.cc:927] Time spent T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:13:46.506356  5005 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.542569  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:46.543833  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:46.553231  3336 raft_consensus.cc:2393] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:46.543412  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:46.554046  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:46.544396  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.556713  3188 raft_consensus.cc:2393] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:46.530325  4946 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:46.558351  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:46.558569  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:46.560050  3339 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:46.529971  5014 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3.
I20260709 12:13:46.517705  4673 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.564469  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.553339  4964 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.566542  3188 raft_consensus.cc:2393] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:46.569938  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:46.562942  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 155237us
W20260709 12:13:46.568168  5004 log.cc:927] Time spent T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:13:46.563555  3186 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:46.576706  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.581030  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.582471  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.586506  3232 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:46.587570  3188 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:46.589051  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.590845  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:46.593713  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.601241  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:46.603523  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:46.605012  3339 raft_consensus.cc:2376] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4. Re-sending same reply.
I20260709 12:13:46.606838  3232 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:46.608532  3264 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:13:46.610075  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.577018  4910 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:46.599329  3927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb7809b208b14a549539330993804c34"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:13:46.595099  3192 raft_consensus.cc:2955] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:46.588594  4840 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:46.616607  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.617687  3191 raft_consensus.cc:2393] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:46.591275  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:46.620548  3927 raft_consensus.cc:606] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:46.574196  4964 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.624465  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:46.625428  5017 log.cc:927] Time spent T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:13:46.626082  5012 log.cc:927] Time spent T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 12:13:46.613122  4591 consensus_meta.cc:287] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.003s
I20260709 12:13:46.668774  3232 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:46.628372  5005 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:46.629475  4673 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:46.573824  5016 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:13:46.631418  3190 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:46.635737  3184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1341) took 1282 ms. Trace:
I20260709 12:13:46.611284  5022 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:46.638103  3895 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:13:46.688576  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 50553.4us
I20260709 12:13:46.643889  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:46.645071  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.644057  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.650542  4879 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:46.652495  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.651028  4904 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:46.650406  3927 raft_consensus.cc:614] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:46.591868  5021 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:46.693737  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.670280  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.673918  4884 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.675164  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55426 (request call id 355) took 1023 ms. Trace:
I20260709 12:13:46.706672  3191 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 1.
I20260709 12:13:46.684577  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:46.713558  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.681035  4956 consensus_queue.cc:1048] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:13:46.708770  4959 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:46.708787  5021 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.714977  3337 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:13:46.736830  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:46.737541  4995 raft_consensus.cc:993] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: : Instructing follower eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:46.714839  4678 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.738011  4995 raft_consensus.cc:1081] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Signalling peer eb49d92feeb14382b3baa49d696b6141 to start an election
I20260709 12:13:46.715402  3924 rpcz_store.cc:276] 0709 12:13:45.646677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.650750 (+  4073us) service_pool.cc:224] Handling call
0709 12:13:45.670200 (+ 19450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:45.678677 (+  8477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.680138 (+  1461us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:45.881018 (+200880us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b2c00075df8. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aecec6a11 00007f1aeced6372 00007f1aee608a01 00007f1aee5cd43a 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2
0709 12:13:45.881512 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:13:46.438368 (+556856us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:46.446194 (+  7826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.451341 (+  5147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:46.610272 (+158931us) raft_consensus.cc:1685] finished
0709 12:13:46.612133 (+  1861us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.655083 (+ 42950us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10963,"raft.queue_time_us":5676,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6229,"spinlock_wait_cycles":19522304,"thread_start_us":541275,"threads_started":1,"wal-append.queue_time_us":555718}
I20260709 12:13:46.677541  5014 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:13:46.703977  4989 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:46.741462  4989 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.703655  4998 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:46.737165  3337 pending_rounds.cc:85] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 5
I20260709 12:13:46.738138  4678 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.733889  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.745765  3185 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
W20260709 12:13:46.753726  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 85064us
I20260709 12:13:46.754472  3191 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.731110  3188 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:13:46.709323  4961 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:46.719977  5016 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:46.735970  4840 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:46.749526  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:46.743577  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.708972  4904 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.753751  3337 pending_rounds.cc:107] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:13:46.769397  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:46.704159  4879 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.721465  4884 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.744028  5021 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.773008  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.760155  5016 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.767364  4961 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.770110  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.688185  3184 rpcz_store.cc:276] 0709 12:13:45.353583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.356124 (+  2541us) service_pool.cc:224] Handling call
0709 12:13:45.440358 (+ 84234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.594681 (+154323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.635504 (+1040823us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54001513d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:46.635682 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286632192}
I20260709 12:13:46.788858  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.789873  3192 raft_consensus.cc:2410] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:46.792433  5022 raft_consensus.cc:697] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:46.794094  3191 raft_consensus.cc:2410] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:46.794983  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.796339  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.796931  3191 raft_consensus.cc:2376] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4. Re-sending same reply.
I20260709 12:13:46.797816  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.798519  3191 raft_consensus.cc:2393] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:13:46.775893  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 74234.3us
I20260709 12:13:46.799280  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.759080  3334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:52822
I20260709 12:13:46.750883  4959 raft_consensus.cc:697] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:46.787828  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:46.783713  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:46.801911  5022 consensus_queue.cc:237] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.803834  3334 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:46.805644  3334 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.806077  4959 consensus_queue.cc:237] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.805006  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:46.812273  4995 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.813184  3895 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:46.813943  4995 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.805191  4846 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:46.814556  4846 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:46.814958  4846 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.822463  4846 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.826656  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:46.830286  3192 raft_consensus.cc:1240] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:46.776366  3337 raft_consensus.cc:2889] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:46.836223  3192 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:46.801527  3191 raft_consensus.cc:1240] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:13:46.838114  3191 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:46.754313  4998 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.788384  5016 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.785321  3190 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
W20260709 12:13:46.834347  5008 log.cc:927] Time spent T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.381s	user 0.004s	sys 0.000s
W20260709 12:13:46.844131  5024 log.cc:927] Time spent T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:13:46.773159  4840 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.844502  4956 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.864105  4851 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:46.867980  4884 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:46.868067  4851 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.869596  4846 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:46.824786  3334 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.872419  3334 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:46.870466  4851 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:13:46.882807  4992 log.cc:927] Time spent T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 1.007s	user 0.007s	sys 0.021s
I20260709 12:13:46.884838  4879 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:46.852366  4721 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:46.823040  4995 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.843326  4964 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:46.895569  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:46.896988  3932 raft_consensus.cc:3055] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:46.898537  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:46.897393  3932 raft_consensus.cc:740] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:46.854669  4591 consensus_queue.cc:1059] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:13:46.888567  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.908085  4904 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:46.909343  4961 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:46.910805  5013 log.cc:927] Time spent T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.353s	user 0.002s	sys 0.001s
I20260709 12:13:46.914240  4678 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:46.914615  4897 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.915871  4989 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:46.896134  4721 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.918642  4998 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:46.902989  5034 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:46.919960  3932 consensus_queue.cc:260] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.947901  3932 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.950093  5021 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:46.951545  3193 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:46.953488  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:46.964067  3932 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:46.965569  3306 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:46.967818  4982 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:46.968369  4982 raft_consensus.cc:697] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:46.969321  4840 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:46.919708  5034 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:46.960407  4983 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.975129  4874 tablet_bootstrap.cc:492] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:46.962747  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.984822  5034 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:46.985535  3189 raft_consensus.cc:1275] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:46.987282  4983 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:47.001659  3189 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:46.969364  4982 consensus_queue.cc:237] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:47.003700  4904 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:47.004462  4904 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.006876  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:46.995375  5034 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.017916  5034 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.029836  5021 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:47.019977  5006 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:13:47.045047  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.046121  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:47.046779  3185 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:47.031777  3189 raft_consensus.cc:2393] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:47.029810  5034 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:47.011332  4911 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:47.050719  3231 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.052018  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.053758  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.054524  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.058928  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.059542  3185 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:47.060282  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.060537  3231 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.061239  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.061910  3231 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.063798  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.066470  3231 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.068696  4911 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:47.070722  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:47.071209  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:46.999922  4650 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:13:47.063239  5006 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:47.077808  4840 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.058805  4957 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.073417  5009 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:47.068795  5034 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:47.081091  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:47.069136  5021 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:47.065940  4897 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.070736  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:13:47.078495  3157 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ec2274893aa4cc087f9d4af8119b1ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:47.089226  3231 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.088717  5009 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.094254  5009 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:47.095019  3191 raft_consensus.cc:1240] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:47.090708  5034 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:47.102680  4840 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:47.084048  4957 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.090687  4904 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:47.105047  5031 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:47.117565  5031 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.106318  3231 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.108064  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.108780  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.111035  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.083487  5006 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:47.112112  5021 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.090673  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.126432  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.126700  3336 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:47.119309  4957 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:47.126068  4650 consensus_queue.cc:1059] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:13:47.131173  4904 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.137607  3189 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:47.119880  5031 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.143811  3231 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.159759  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.182958  3191 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:47.136935  3186 raft_consensus.cc:2376] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4. Re-sending same reply.
I20260709 12:13:47.189529  3339 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:47.192966  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:47.194336  4650 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:47.194887  4650 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:47.195261  4650 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.200295  5045 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:47.203414  4983 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:47.185925  4840 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.204140  4941 raft_consensus.cc:3055] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:47.134356  5021 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.204588  4941 raft_consensus.cc:740] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:47.205127  5006 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:47.205515  4941 consensus_queue.cc:260] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.206257  5021 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:47.162734  5016 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:47.206784  4941 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.191291  5034 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:47.208238  4809 raft_consensus.cc:3055] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:47.208597  5016 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:47.208673  4809 raft_consensus.cc:740] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:47.208992  3186 raft_consensus.cc:1240] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:47.209404  5031 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:47.209858  4809 consensus_queue.cc:260] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.212149  3336 raft_consensus.cc:1275] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:13:47.213583  4809 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.216099  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:47.188963  4897 consensus_queue.cc:1059] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:13:47.218412  4897 raft_consensus.cc:3055] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:47.218765  4897 raft_consensus.cc:740] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:13:47.225452  5044 log.cc:927] Time spent T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:13:47.227478  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.229506  4721 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:47.229117  4897 consensus_queue.cc:260] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:47.230036  4650 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.230955  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:47.232402  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.214627  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.235178  3188 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.238545  3185 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:47.241031  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.245059  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.246788  3188 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:13:47.247673  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:47.249656  3268 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:47.251188  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:47.251955  3268 raft_consensus.cc:2393] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:47.253501  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:47.254145  3268 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.257994  4874 tablet_bootstrap.cc:492] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:13:47.259248  4874 tablet_bootstrap.cc:492] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:47.260396  4840 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:47.230674  4897 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.263284  3268 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:47.267175  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.212159  3184 raft_consensus.cc:1275] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:47.268548  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:47.260390  4957 consensus_queue.cc:1059] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:13:47.270393  3261 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:47.271273  4874 ts_tablet_manager.cc:1403] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.296s	user 0.011s	sys 0.026s
I20260709 12:13:47.274816  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:47.274300  4650 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:47.281152  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:47.281886  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:47.293201  3264 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:47.305275  3260 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.303581  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.285979  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:47.293839  4840 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:47.314043  3266 raft_consensus.cc:1275] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:13:47.314170  3259 raft_consensus.cc:2368] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4.
I20260709 12:13:47.299758  4879 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:13:47.311144  3926 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:47.321938  3189 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:47.294181  4965 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:13:47.323342  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:47.322422  3260 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:47.313596  4840 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:47.309044  4673 consensus_queue.cc:1048] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:13:47.327416  4840 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:47.336723  3895 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.339157  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.340045  3187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40510 (request call id 1629) took 1056 ms. Trace:
I20260709 12:13:47.340368  3187 rpcz_store.cc:276] 0709 12:13:46.283860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.288342 (+  4482us) service_pool.cc:224] Handling call
0709 12:13:46.869702 (+581360us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b5800002a98. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:13:47.339002 (+469300us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b5800002a98. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8e9c 00007f1aeb4a8a5b 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:13:47.339961 (+   959us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58614016}
I20260709 12:13:47.341571  4721 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:47.362986  3260 raft_consensus.cc:1275] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:47.364557  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.367909  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.369154  3157 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:47.376670  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.370602  4983 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:47.370427  4989 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.383062  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:47.312176  4957 consensus_queue.cc:1048] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:13:47.359349  4721 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:47.360169  4650 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.390214  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.388134  4917 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:13:47.394647  4874 raft_consensus.cc:359] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.397734  4874 raft_consensus.cc:740] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:47.398375  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:47.382766  4879 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:47.400626  4957 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.400985  4879 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.402540  3263 raft_consensus.cc:2410] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:47.402217  4879 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.405231  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:13:47.405754  5049 log.cc:927] Time spent T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.213s	user 0.005s	sys 0.000s
I20260709 12:13:47.406629  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:47.401479  4650 raft_consensus.cc:697] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:47.407636  4721 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:47.408694  4650 consensus_queue.cc:237] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.410560  4721 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:47.412246  4957 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.413822  3261 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:47.414309  4957 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:47.415293  4874 consensus_queue.cc:260] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:47.416630  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:47.419683  4874 ts_tablet_manager.cc:1434] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.120s	user 0.004s	sys 0.005s
I20260709 12:13:47.419528  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.421721  3265 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:13:47.422237  3265 pending_rounds.cc:85] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 2
I20260709 12:13:47.422533  3265 pending_rounds.cc:107] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:13:47.422899  3265 raft_consensus.cc:2889] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:47.424952  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.426488  3266 raft_consensus.cc:1240] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:47.427220  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:47.428278  3268 raft_consensus.cc:1275] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:47.429699  3267 raft_consensus.cc:1240] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:47.430794  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:47.431689  3268 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:47.422442  5053 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:13:47.438143  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.438367  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.444420  3260 raft_consensus.cc:1240] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:47.427858  3335 raft_consensus.cc:2376] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4. Re-sending same reply.
I20260709 12:13:47.438513  3267 raft_consensus.cc:1275] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:47.449380  3335 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:47.465173  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.484436  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.471169  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.487720  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.488045  3268 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:47.485323  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.491236  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:47.494235  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:47.495894  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:47.505649  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 118920us
I20260709 12:13:47.509510  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:47.511638  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 122783us
I20260709 12:13:47.475251  4957 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.515959  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.516886  3188 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:47.520412  3896 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.522364  3232 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:47.524492  3193 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:47.527352  3895 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.524277  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.530052  3267 raft_consensus.cc:2393] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:47.531965  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.532564  3260 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:47.480172  4879 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:47.522066  4807 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.528672  5021 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:47.539321  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.540445  3232 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.531780  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:47.558492  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.564420  3264 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:47.562799  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:47.565657  3193 raft_consensus.cc:2376] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4. Re-sending same reply.
I20260709 12:13:47.566174  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.566530  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.566663  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:47.525568  5031 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:13:47.563072  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:47.570845  3192 raft_consensus.cc:2376] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4. Re-sending same reply.
I20260709 12:13:47.571803  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.572523  3192 raft_consensus.cc:2393] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:47.563351  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.563669  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.524688  4957 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:47.575599  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.572829  4911 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.577036  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:47.568817  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:47.562450  3156 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:47.554226  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:47.575547  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:47.574851  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.592741  3192 raft_consensus.cc:2393] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:47.581624  4965 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.584204  3193 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:47.584714  3156 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:47.569299  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.573112  5006 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:47.573071  4846 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:47.572759  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:47.565068  5014 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:47.546118  5016 consensus_queue.cc:1059] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:13:47.607333  3156 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:47.609143  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 76823us
I20260709 12:13:47.595149  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:13:47.585529  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 58295.8us
I20260709 12:13:47.603682  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.611835  3156 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:47.572422  5021 raft_consensus.cc:697] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:47.612785  4839 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:47.573261  4650 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:13:47.617390  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:47.604815  4982 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:47.605973  4897 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.614758  4957 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:47.620286  4989 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.615154  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:47.628077  4998 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:47.637043  3259 raft_consensus.cc:2393] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:47.630879  3925 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:47.616886  4983 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 12:13:47.674672  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 59913.2us
I20260709 12:13:47.659274  4721 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:47.679183  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:47.655956  3278 tablet_copy_service.cc:342] P 1ef05c9d901046dca7fe0e638cc693b9: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-a85351bf981e43bea61620452a2c7b3a received from {username='slave'} at 127.0.0.1:40120
I20260709 12:13:47.633587  5009 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:13:47.686244  4957 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:47.688632  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 72802.9us
I20260709 12:13:47.691191  3231 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:47.692931  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 62128.3us
I20260709 12:13:47.693545  3231 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.668475  4989 raft_consensus.cc:697] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:47.664851  4807 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:13:47.694862  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 77500.4us
I20260709 12:13:47.696064  3231 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.700312  3231 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:47.705121  3231 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.692716  5031 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:47.692451  3278 tablet_copy_service.cc:434] P 1ef05c9d901046dca7fe0e638cc693b9: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-a85351bf981e43bea61620452a2c7b3a on tablet a85351bf981e43bea61620452a2c7b3a with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:47.687326  4941 consensus_queue.cc:1048] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:13:47.698681  4911 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.720536  3231 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.700565  4879 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:47.726009  3231 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.723007  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:47.729627  3231 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.702468  5016 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:47.731135  3231 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:47.704471  5022 raft_consensus.cc:2764] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:13:47.738428  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.738761  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.740272  3260 raft_consensus.cc:1275] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:47.743763  3156 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.743939  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.705701  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:47.744676  3265 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:47.676016  5021 consensus_queue.cc:237] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.753160  4879 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:47.750212  4911 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:47.753777  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:47.727149  4897 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:47.752159  3156 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.756055  5009 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:13:47.758074  5064 log.cc:927] Time spent T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:13:47.779450  5009 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:47.735677  5014 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.779835  5009 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:47.780289  5009 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:47.780611  5061 log.cc:927] Time spent T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
I20260709 12:13:47.759246  3923 raft_consensus.cc:1217] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:47.744510  5031 raft_consensus.cc:2764] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:13:47.704406  4957 consensus_queue.cc:1059] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:13:47.728305  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:47.784207  4989 consensus_queue.cc:237] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.784804  3927 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.734229  4904 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:47.778144  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 55227.2us
I20260709 12:13:47.795714  3305 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:47.798056  4941 raft_consensus.cc:2749] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.791064  4879 raft_consensus.cc:697] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:47.799497  3156 leader_election.cc:400] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4.
I20260709 12:13:47.799350  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:47.799819  3156 leader_election.cc:403] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:13:47.802331  4879 consensus_queue.cc:237] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.733126  5070 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:13:47.802610  4998 consensus_queue.cc:1048] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:47.802162  3923 raft_consensus.cc:2955] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:47.803236  4964 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4.
I20260709 12:13:47.809098  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.813637  5006 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:47.813637  5031 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:47.815248  4591 raft_consensus.cc:3055] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:47.813714  5076 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.815691  4591 raft_consensus.cc:740] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:47.816025  5076 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.816582  4591 consensus_queue.cc:260] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:47.817917  4591 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.818958  5076 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:47.820072  3928 raft_consensus.cc:1240] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:47.822343  5022 consensus_queue.cc:1059] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:47.825240  3156 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.827066  4904 raft_consensus.cc:3055] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:47.827559  4904 raft_consensus.cc:740] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:47.809333  4982 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:47.810292  4998 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:47.840306  3232 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.848708  5022 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.852710  3927 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:47.852345  4998 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:47.856942  4998 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:47.847973  3232 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:47.858237  5022 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:47.829339  4983 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:47.896674  3264 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:47.901186  3895 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:47.833464  4982 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.924665  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:47.939393  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 51702.2us
I20260709 12:13:47.828147  4964 consensus_queue.cc:1059] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:13:47.844758  5080 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:47.886981  4673 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:47.959789  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 56659us
I20260709 12:13:47.956499  4982 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.954834  5059 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:48.020221  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:48.025107  3929 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:48.027797  3342 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:48.017055  5009 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:48.000357  4673 raft_consensus.cc:697] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:48.038790  5031 consensus_queue.cc:1059] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:13:48.062754  4673 consensus_queue.cc:237] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:48.029850  4989 raft_consensus.cc:3055] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:48.064011  4989 raft_consensus.cc:740] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:48.011802  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:48.064872  4989 consensus_queue.cc:260] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:48.065739  3184 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:48.066092  4989 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.042304  4978 raft_consensus.cc:3055] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:47.967483  4721 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:13:48.048689  3335 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:48.010978  4904 consensus_queue.cc:260] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:47.972048  5080 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:48.057497  5084 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:13:48.018230  5059 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:47.977837  5078 consensus_queue.cc:1048] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:13:47.974709  5070 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:13:48.059299  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:48.083243  3340 raft_consensus.cc:1240] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:48.073166  3263 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:13:48.073294  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 191771us
I20260709 12:13:48.075476  4904 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.074312  4879 raft_consensus.cc:2955] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:48.070657  4978 raft_consensus.cc:740] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:48.083652  5021 consensus_queue.cc:1059] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:13:48.088788  5082 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:48.082852  5059 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.107259  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:48.115841  5016 raft_consensus.cc:3055] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:48.116371  5016 raft_consensus.cc:740] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:13:48.127321  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 172880us
I20260709 12:13:48.131182  3188 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:48.151588  3157 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:13:48.158023  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 268386us
W20260709 12:13:48.270866  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.272411  5073 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:13:48.276170  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 105069us
I20260709 12:13:48.289182  5073 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:48.296927  5073 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:48.285934  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 148531us
I20260709 12:13:48.318454  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:48.208494  4990 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:48.149134  4978 consensus_queue.cc:260] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:48.350131  5103 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:13:48.340466  5080 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:48.341805  4591 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.378177  4591 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:48.382844  4982 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:48.383214  4591 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:13:48.425493  5092 log.cc:927] Time spent T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
I20260709 12:13:48.429529  4874 ts_tablet_manager.cc:933] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
W20260709 12:13:48.494026  5095 log.cc:927] Time spent T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:13:48.420342  4982 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:48.517601  3336 raft_consensus.cc:1275] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:13:48.555030  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 218401us
I20260709 12:13:48.515944  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:48.562827  4673 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.563627  3337 raft_consensus.cc:2393] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:48.563489  4673 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:48.594309  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 422487us
W20260709 12:13:48.656278  4879 consensus_meta.cc:287] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.003s
W20260709 12:13:48.685442  5094 log.cc:927] Time spent T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.415s	user 0.001s	sys 0.001s
I20260709 12:13:48.751695  3333 raft_consensus.cc:1275] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:48.736280  4827 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:48.739993  4650 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.801136  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:48.736582  4840 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:13:48.801431  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:48.749867  4874 tablet_copy_client.cc:323] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.65:44889
I20260709 12:13:48.811044  3260 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.801272  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:48.593474  5059 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:48.814095  3264 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.748258  5006 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:13:48.814445  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.755738  5114 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.753424  4990 raft_consensus.cc:697] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:48.809392  4673 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:48.826005  3337 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:48.815201  5031 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.811367  4904 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:48.813374  4982 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:48.880141  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 222361us
I20260709 12:13:48.807659  5121 consensus_queue.cc:1048] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:13:48.812129  4827 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:48.888559  5106 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:48.909166  5073 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:48.918248  3187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47276 (request call id 185) took 1405 ms. Trace:
I20260709 12:13:48.868140  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1241) took 1448 ms. Trace:
I20260709 12:13:48.861193  5006 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:48.922057  3260 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:48.923528  3264 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:48.814878  4650 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:48.880049  4904 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:48.894599  5058 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:48.921200  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 108670us
I20260709 12:13:48.907619  5123 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:48.893766  4982 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:48.944213  5136 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:48.901712  4941 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:13:48.927276  5097 log.cc:927] Time spent T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 12:13:48.926036  5021 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:48.952880  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:48.880438  5031 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:48.947921  5112 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.186s	user 0.001s	sys 0.001s
I20260709 12:13:48.862920  5114 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:48.935927  4990 consensus_queue.cc:237] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:48.961829  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:49.018957  5133 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:13:49.019778  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 58025.2us
W20260709 12:13:49.022166  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 426077us
I20260709 12:13:49.023294  3156 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:49.025846  3156 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:48.954965  5070 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.012s	sys 0.006s
I20260709 12:13:48.928086  3261 rpcz_store.cc:276] 0709 12:13:47.415233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.436981 (+ 21748us) service_pool.cc:224] Handling call
0709 12:13:48.528113 (+1091132us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b58001c3898. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:13:48.559040 (+ 30927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:48.571975 (+ 12935us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:13:48.573512 (+  1537us) log.cc:844] Serialized 14 byte log entry
0709 12:13:48.808643 (+235131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:48.810980 (+  2337us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:48.815822 (+  4842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.857301 (+ 41479us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.863686 (+  6385us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":575,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":14205,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":1577,"spinlock_wait_cycles":59961088,"thread_start_us":180012,"threads_started":1,"wal-append.queue_time_us":291635}
I20260709 12:13:48.927502  5106 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:48.958844  4904 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:48.953742  5058 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:49.034337  5070 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.027s	sys 0.033s
I20260709 12:13:49.033033  5129 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:48.928165  5073 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.020534  5133 raft_consensus.cc:697] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:49.051471  3341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 1848) took 1086 ms. Trace:
I20260709 12:13:49.052131  3341 rpcz_store.cc:276] 0709 12:13:47.961503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.961608 (+   105us) service_pool.cc:224] Handling call
0709 12:13:48.861423 (+899815us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b5800042698. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:13:48.861638 (+   215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:48.875310 (+ 13672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:48.875339 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:48.875797 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 12:13:48.929395 (+ 53598us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:48.929458 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.929624 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:49.043756 (+114132us) raft_consensus.cc:1685] finished
0709 12:13:49.043777 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:49.047746 (+  3969us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8713,"raft.queue_time_us":9988,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":14495,"spinlock_wait_cycles":3639552,"thread_start_us":65990,"threads_started":2,"wal-append.queue_time_us":157658}
I20260709 12:13:48.962250  4941 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:48.960882  5136 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.038069  4995 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:48.955708  5121 consensus_queue.cc:1059] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 12:13:49.057842  5129 raft_consensus.cc:697] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:48.927404  3187 rpcz_store.cc:276] 0709 12:13:47.513386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.520290 (+  6904us) service_pool.cc:224] Handling call
0709 12:13:47.545563 (+ 25273us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:47.585442 (+ 39879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:47.587715 (+  2273us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:47.665323 (+ 77608us) log.cc:844] Serialized 52 byte log entry
0709 12:13:47.795015 (+129692us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:48.308866 (+513851us) log.cc:844] Serialized 14 byte log entry
0709 12:13:48.562545 (+253679us) log.cc:844] Serialized 14 byte log entry
0709 12:13:48.917532 (+354987us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b18001fc660. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb45ac0a 00007f1af4b9a219 00007f1aeb4e2a40 00007f1aeb4dd4e4 00007f1aeb4dd455 00007f1aee5c5060 00007f1aee5d7716 00007f1aee5e8287 00007f1aee5e8208
0709 12:13:48.917765 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.917872 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:48.918014 (+   142us) raft_consensus.cc:1685] finished
0709 12:13:48.918032 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.918179 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105802,"prepare.queue_time_us":252819,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":419600,"raft.run_cpu_time_us":428,"raft.run_wall_time_us":28901,"spinlock_wait_cycles":14480128,"thread_start_us":670669,"threads_started":3,"wal-append.queue_time_us":168718}
W20260709 12:13:49.062541  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 472907us
I20260709 12:13:48.967877  5021 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.056167  4879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:47270 (request call id 12) took 3757 ms. Trace:
I20260709 12:13:48.955446  5123 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.054463  5109 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:49.092528  5072 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:49.093461  5072 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:49.064949  4995 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.108561  5058 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:13:49.111006  5126 log.cc:927] Time spent T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:13:49.112020  5111 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:49.113457  5111 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.110149  4995 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:49.058825  5129 consensus_queue.cc:237] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.095739  4946 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:13:49.157236  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 131485us
I20260709 12:13:49.158823  3156 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:49.124179  4827 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.124049  5006 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:49.098121  5109 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.172752  5109 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.173745  5121 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.140386  4650 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:49.158475  4946 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.163187  4982 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:49.192842  4946 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.188657  5114 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:49.197448  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 176563us
I20260709 12:13:49.179304  5031 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.185319  5091 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:49.217413  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:49.217598  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:49.219645  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:49.227787  5072 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.220757  5108 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:49.226194  5115 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:49.225625  5109 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:49.119894  5133 consensus_queue.cc:237] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.231366  5073 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:49.233084  4941 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:49.231899  5136 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:49.251904  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55426 (request call id 364) took 1844 ms. Trace:
I20260709 12:13:49.254635  3185 raft_consensus.cc:1275] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:49.249897  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.256471  3259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56754 (request call id 1259) took 1363 ms. Trace:
I20260709 12:13:49.186179  5121 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.256868  5093 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:49.252450  3932 rpcz_store.cc:276] 0709 12:13:47.403768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.404507 (+   739us) service_pool.cc:224] Handling call
0709 12:13:47.404819 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.424572 (+ 19753us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:13:47.427849 (+  3277us) log.cc:844] Serialized 14 byte log entry
0709 12:13:47.591965 (+164116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.592025 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:47.592074 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:49.247912 (+1655838us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54006784d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:49.247950 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:49.248057 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9387,"prepare.queue_time_us":3627,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":3901,"raft.queue_time_us":39667,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6316,"spinlock_wait_cycles":38176640,"thread_start_us":154189,"threads_started":2,"wal-append.queue_time_us":126646,"wal-append.run_cpu_time_us":10758,"wal-append.run_wall_time_us":1240144}
I20260709 12:13:49.235905  5106 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:49.264362  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:49.270568  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:49.258795  5073 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:49.261991  5034 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:49.254616  3203 tablet_copy_service.cc:140] P 7ac63b674f204bc4805ab989f8c965d3: Received BeginTabletCopySession request for tablet 9ec2274893aa4cc087f9d4af8119b1ea from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:47276)
I20260709 12:13:49.287817  3187 raft_consensus.cc:1275] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:49.074600  4879 rpcz_store.cc:276] 0709 12:13:45.295333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.298830 (+  3497us) service_pool.cc:224] Handling call
0709 12:13:45.771684 (+472854us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800002a98. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a71c0 00007f1af35939d9 00007f1af3593ca2 00007f1aecb121d4
0709 12:13:46.868079 (+1096395us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b4c00158180. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aec899a20 00007f1aec8aaa29 00007f1aec870644 00007f1aec897f2d 00007f1aec897b93 00007f1aee5261af 00007f1aee525f3e 00007f1aee5ab888 00007f1aee5c875c 00007f1aee5c976a 00007f1aee5c891b
0709 12:13:46.868795 (+   716us) log.cc:844] Serialized 499 byte log entry
0709 12:13:49.046417 (+2177622us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11206,"raft.run_cpu_time_us":981,"raft.run_wall_time_us":30740,"spinlock_wait_cycles":12118656,"thread_start_us":52182,"threads_started":1,"wal-append.queue_time_us":128877,"wal-append.run_cpu_time_us":2166,"wal-append.run_wall_time_us":1052774}
I20260709 12:13:49.283298  5111 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:49.250238  5109 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.271077  5021 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:49.246116  5115 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.293776  5106 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:49.298797  5121 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.300244  5123 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:49.300781  3203 tablet_copy_service.cc:161] P 7ac63b674f204bc4805ab989f8c965d3: Beginning new tablet copy session on tablet 9ec2274893aa4cc087f9d4af8119b1ea from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:47276: session id = 6f0cdd57c5934921829c205d32b2b8a5-9ec2274893aa4cc087f9d4af8119b1ea
I20260709 12:13:49.316469  5136 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:49.256875  3259 rpcz_store.cc:276] 0709 12:13:47.893013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.896169 (+  3156us) service_pool.cc:224] Handling call
0709 12:13:49.248124 (+1351955us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b58001c3898. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8f8c 00007f1aeb4a8ef6 000000000036eb39 00007f1af351c1e0 00007f1af35e50c4 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:13:49.256363 (+  8239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5243648}
I20260709 12:13:49.294555  5073 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.304395  5034 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.315523  3268 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:49.314206  5106 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:49.319267  5090 log.cc:927] Time spent T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 1.205s	user 0.009s	sys 0.011s
I20260709 12:13:49.319139  5136 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.309043  4827 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:49.317128  4809 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:49.322451  4827 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.322736  4809 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.308622  5083 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:49.322062  5073 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.325826  5083 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.333057  5034 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.338585  5106 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:49.340091  5109 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.322131  5136 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:49.325574  4827 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.343587  5115 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:49.342249  4941 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:49.352905  4941 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.361079  4807 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:49.361627  4941 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:49.351897  4650 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:49.362581  4650 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:49.370328  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 293056us
I20260709 12:13:49.370599  3340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 1652) took 1532 ms. Trace:
I20260709 12:13:49.371155  3340 rpcz_store.cc:276] 0709 12:13:47.838561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.839137 (+   576us) service_pool.cc:224] Handling call
0709 12:13:47.839484 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:48.083775 (+244291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:49.370376 (+1286601us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5400033ed4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:49.370544 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560145792}
I20260709 12:13:49.372040  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:49.374061  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:49.375562  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:49.376541  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:49.376912  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:49.344453  5118 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:49.380940  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:49.382717  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:49.382653  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.391585  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:49.391804  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.392522  3266 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:49.394483  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:49.394797  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.396039  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:49.397611  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.398339  3260 raft_consensus.cc:2393] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:49.399816  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.400408  3264 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:49.351851  4995 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:49.398164  3339 raft_consensus.cc:2955] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:49.402060  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.383955  4941 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:49.363502  5006 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:49.361953  4807 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.412631  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:49.431583  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.413209  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.412987  5118 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.710088  4807 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:49.569562  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.711585  5118 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:49.711671  5115 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:49.712634  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:49.712492  5115 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.513159  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.714252  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:49.493275  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.496802  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.715907  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:49.716686  3191 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:49.710136  3263 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:49.706656  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:49.715088  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.714751  5115 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.718443  3333 raft_consensus.cc:2393] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 2: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:13:49.711676  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 233611us
I20260709 12:13:49.391163  5034 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.720094  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:49.383704  5073 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:13:49.650203  5045 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.006s	sys 0.014s
I20260709 12:13:49.600833  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:49.546432  5076 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.725339  3341 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:49.623111  4809 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:49.777130  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.757207  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:49.779506  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:49.781824  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.781762  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:49.721984  3231 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:49.779501  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:49.792728  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:49.400859  4983 consensus_queue.cc:1059] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.381s
I20260709 12:13:49.660434  4839 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:49.817039  3931 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:49.823611  3262 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:49.414477  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:13:49.823374  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 101448us
I20260709 12:13:49.726209  4807 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:49.414297  5103 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:13:49.777688  5045 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.007s	sys 0.016s
I20260709 12:13:49.730047  5021 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.716536  3261 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:49.716348  4650 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:49.719499  5123 raft_consensus.cc:476] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 12:13:49.830184  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:49.728260  5109 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:49.775637  5115 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.833521  3231 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:49.782086  4990 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.449795  4995 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.781450  5070 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.836705  5155 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.779403  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:49.781247  4982 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:49.728843  4897 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:49.782588  5118 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:49.776367  5034 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.719372  4941 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.885931  3260 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
W20260709 12:13:49.860620  3156 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.528s (SENT) [suppressed 23 similar messages]
I20260709 12:13:49.863283  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:49.817727  5073 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.818019  5076 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.870826  3231 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:49.830930  4839 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.895987  4839 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:49.839664  4807 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.871729  5115 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.898804  4807 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.852762  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:49.899556  3231 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:49.901193  3231 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:49.719712  5121 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:49.848286  5016 consensus_queue.cc:260] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:49.715874  5006 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.859827  4879 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.888130  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:49.907965  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:49.908737  3189 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:49.887292  3191 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.874687  5045 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.893616  5076 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:49.869850  5109 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.853206  5021 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.857692  5129 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:49.905791  3336 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:49.911602  3305 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:49.876991  5070 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.891414  5118 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.874297  4990 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.920130  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:50.044377  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 132899us
I20260709 12:13:49.889249  5009 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:49.893512  5034 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:50.055147  3335 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:49.915872  5121 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:49.889006  4897 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:50.059604  5021 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.059844  5073 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:50.059124  5118 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.053053  5129 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.061363  4995 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.906046  5123 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.063830  5070 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:50.044413  4879 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:49.906584  5155 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:50.068622  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.068742  3305 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:50.058251  5115 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:49.883658  4982 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.044893  4807 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:50.052687  5076 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:50.051370  5045 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:49.917799  5153 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.101027  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.099287  3191 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:50.107824  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.110042  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.112242  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.113827  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.114162  3305 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:50.114625  3189 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:50.116288  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:50.116351  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:50.122018  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.102528  5070 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:50.125921  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.132838  4982 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.133072  5129 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.134011  5006 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.103571  5076 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:50.134712  5076 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:50.134816  5083 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:50.140110  5109 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:50.141165  5006 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:50.141782  4879 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:50.125841  5082 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.141866  5006 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:50.144042  5082 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:50.144654  5082 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.146275  5006 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:50.146946  5082 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.148469  4990 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:50.140115  5121 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.105582  4807 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.148497  5151 raft_consensus.cc:3055] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:50.151896  4807 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:50.152000  5151 raft_consensus.cc:740] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:13:50.154017  3259 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.019s	sys 0.012s
I20260709 12:13:50.130952  5118 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:50.109715  5045 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:50.129819  4941 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:50.163892  3259 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.019s	sys 0.013s
I20260709 12:13:50.164391  4978 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:50.169271  5118 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:50.155009  5151 consensus_queue.cc:260] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:50.184332  5118 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.191793  4941 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:50.192560  4846 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.193163  4846 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.193606  5151 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:50.195142  5145 log.cc:927] Time spent T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.940s	user 0.001s	sys 0.001s
I20260709 12:13:50.196271  4846 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
W20260709 12:13:50.199685  5143 log.cc:927] Time spent T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.945s	user 0.003s	sys 0.000s
I20260709 12:13:50.192360  4941 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.184937  5076 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:50.212620  5149 log.cc:927] Time spent T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.616s	user 0.002s	sys 0.009s
I20260709 12:13:50.203198  4897 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:50.201954  5118 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:50.226110  5076 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:50.227324  5045 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:50.255932  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 395089us
W20260709 12:13:50.257825  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 391435us
I20260709 12:13:50.259884  3184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47276 (request call id 193) took 1031 ms. Trace:
I20260709 12:13:50.260526  3184 rpcz_store.cc:276] 0709 12:13:49.228160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.228513 (+   353us) service_pool.cc:224] Handling call
0709 12:13:49.228888 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:49.229272 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.229313 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:49.229906 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 12:13:49.274153 (+ 44247us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:49.275765 (+  1612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:49.276120 (+   355us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.211839 (+935719us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:13:50.258922 (+ 47083us) raft_consensus.cc:1685] finished
0709 12:13:50.259004 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.259612 (+   608us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4272,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7464,"spinlock_wait_cycles":29215104,"thread_start_us":38579,"threads_started":1,"wal-append.queue_time_us":251930}
I20260709 12:13:50.264930  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.267293  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.268435  3184 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:13:50.268781  5172 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:50.270051  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.271989  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.271054  5172 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.273826  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.274706  3184 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:50.130225  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.278286  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:50.278414  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 377138us
I20260709 12:13:50.280915  3264 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:13:50.284147  3157 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:50.284994  3337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 1854) took 1333 ms. Trace:
I20260709 12:13:50.293187  3305 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:50.295763  3924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:13:50.297201  3924 raft_consensus.cc:606] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:50.298727  4941 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.285770  3337 rpcz_store.cc:276] 0709 12:13:48.951216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.952379 (+  1163us) service_pool.cc:224] Handling call
0709 12:13:49.027238 (+ 74859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:49.042714 (+ 15476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.042753 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:49.043246 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:13:49.233526 (+190280us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:49.235372 (+  1846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:49.244457 (+  9085us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:49.322736 (+ 78279us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b180026c620. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
0709 12:13:50.199101 (+876365us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:13:50.284278 (+ 85177us) raft_consensus.cc:1685] finished
0709 12:13:50.284334 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.284648 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3459,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"spinlock_wait_cycles":12661376,"thread_start_us":178252,"threads_started":1,"wal-append.queue_time_us":190913}
I20260709 12:13:50.306401  4897 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:50.307644  4897 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.309599  4941 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:50.311962  4941 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:50.311094  3932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:13:50.312942  3932 raft_consensus.cc:606] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:50.315665  4941 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:50.317206  3268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 1690) took 2578 ms (client timeout 2528 ms). Trace:
W20260709 12:13:50.317730  3268 rpcz_store.cc:269] 0709 12:13:47.738308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.738540 (+   232us) service_pool.cc:224] Handling call
0709 12:13:50.316666 (+2578126us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54001a2054. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:50.316917 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3624656640}
I20260709 12:13:50.323864  4911 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:50.324985  4911 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.326566  4839 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:50.327283  4839 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:50.327800  4839 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:50.328070  3335 raft_consensus.cc:1275] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:13:50.328507  3335 pending_rounds.cc:85] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 1
I20260709 12:13:50.328845  3335 pending_rounds.cc:107] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:50.329205  3335 raft_consensus.cc:2889] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:50.329945  3231 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:50.331481  4978 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.332317  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:50.333240  4879 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:50.334057  4911 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.334474  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.339521  3305 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:50.336185  3334 raft_consensus.cc:1240] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:50.336516  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.337649  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.341640  3341 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:50.336239  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.338039  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:50.228241  5118 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:50.379565  3268 raft_consensus.cc:1275] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:50.380600  5172 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.381948  3268 raft_consensus.cc:1240] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:50.387769  3231 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:50.388083  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 48785.9us
I20260709 12:13:50.393276  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.395720  3263 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:50.388490  5045 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:13:50.388685  5141 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:50.398453  5141 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:50.398586  3337 raft_consensus.cc:1275] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:50.399086  5141 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:50.402251  3203 tablet_copy_source_session.cc:215] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:50.369875  4897 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.403549  3188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47276 (request call id 190) took 1179 ms. Trace:
I20260709 12:13:50.403810  3203 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:47276 (request call id 195) took 1172 ms. Trace:
I20260709 12:13:50.396474  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.405483  3191 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:50.404096  3188 rpcz_store.cc:276] 0709 12:13:49.224522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.225385 (+   863us) service_pool.cc:224] Handling call
0709 12:13:49.225662 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:49.319073 (+ 93411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.319101 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:49.319147 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:49.319179 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.403050 (+1083871us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b54002f5654. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:50.403118 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.403330 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214252288}
I20260709 12:13:50.404289  3203 rpcz_store.cc:276] 0709 12:13:49.240722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.254296 (+ 13574us) service_pool.cc:224] Handling call
0709 12:13:50.403656 (+1149360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:50.423979  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 353) took 1031 ms. Trace:
I20260709 12:13:50.408149  4897 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.426656  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:50.435791  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.435984  5171 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:50.436792  5171 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.440791  5171 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:50.442939  5171 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:50.444058  5103 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:50.448741  5103 raft_consensus.cc:697] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:50.449769  3157 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:50.451680  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.450677  5103 consensus_queue.cc:237] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:50.444782  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56754 (request call id 1290) took 1046 ms. Trace:
W20260709 12:13:50.453055  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.452885  3260 rpcz_store.cc:276] 0709 12:13:49.398171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.401824 (+  3653us) service_pool.cc:224] Handling call
0709 12:13:50.444305 (+1042481us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400421654. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:50.444522 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094617856}
I20260709 12:13:50.454404  5144 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:50.454859  5144 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.455260  5144 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:50.452716  5080 consensus_queue.cc:1048] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:50.465557  4946 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:13:50.466526  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 79159.7us
I20260709 12:13:50.466300  4946 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.468214  3231 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:50.469182  4946 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.471184  5045 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.472312  5045 consensus_queue.cc:1048] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:50.477368  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.478487  3336 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:50.480290  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:50.483614  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.485011  3341 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:50.477250  4941 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:50.489161  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.489763  4941 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:50.490183  3335 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:50.490311  3187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40510 (request call id 1694) took 1118 ms. Trace:
I20260709 12:13:50.491879  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.492859  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.475075  4839 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.493139  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.495890  3929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:13:50.496011  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:50.496944  3929 raft_consensus.cc:606] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:50.497447  3929 raft_consensus.cc:614] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:50.499127  3185 raft_consensus.cc:2393] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:50.495970  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.502547  4874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec2274893aa4cc087f9d4af8119b1ea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:50.503198  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.506382  5171 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.506764  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.507956  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.509157  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.519892  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:50.521696  3185 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:50.524657  3189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1379) took 1019 ms. Trace:
I20260709 12:13:50.484457  3184 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:50.508986  5171 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:50.528383  5016 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.529920  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:50.532020  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.508946  3334 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:50.533193  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:50.520195  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 63666.3us
I20260709 12:13:50.495358  4839 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.490911  3187 rpcz_store.cc:276] 0709 12:13:49.371989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.383909 (+ 11920us) service_pool.cc:224] Handling call
0709 12:13:50.488907 (+1104998us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5800002a98. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8eee 000000000036eb39 00007f1af351c1e0 00007f1af35e50c4 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:13:50.490227 (+  1320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6138112}
I20260709 12:13:50.536723  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:50.553370  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 82167.2us
I20260709 12:13:50.427516  3926 rpcz_store.cc:276] 0709 12:13:49.355775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.363314 (+  7539us) service_pool.cc:224] Handling call
0709 12:13:50.385956 (+1022642us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8eee 000000000036eb39 00007f1af351c1e0 00007f1af35e50c4 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:13:50.386406 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.386895 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.386943 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:50.387031 (+    88us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:50.387084 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.387173 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.387355 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6828928}
W20260709 12:13:50.602646  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 66066.8us
W20260709 12:13:50.605581  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 101435us
I20260709 12:13:50.608166  3185 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:13:50.605139  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:50.610329  3305 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:50.614419  4941 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:50.615111  4941 raft_consensus.cc:697] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:50.616460  4941 consensus_queue.cc:237] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:50.612859  4839 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:50.620044  3187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1387) took 1113 ms. Trace:
I20260709 12:13:50.620445  4839 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:50.621006  4839 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:50.620616  3187 rpcz_store.cc:276] 0709 12:13:49.506928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.602497 (+1095569us) service_pool.cc:224] Handling call
0709 12:13:50.605031 (+  2534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.619529 (+ 14498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.619582 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:50.619655 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:50.619702 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.619789 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.619934 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:50.623538  3190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1378) took 1035 ms. Trace:
I20260709 12:13:50.631989  5141 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.639173  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1698) took 1240 ms. Trace:
I20260709 12:13:50.639778  3262 rpcz_store.cc:276] 0709 12:13:49.399042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.836315 (+437273us) service_pool.cc:224] Handling call
0709 12:13:49.867231 (+ 30916us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:49.880856 (+ 13625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.880904 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:49.882342 (+  1438us) log.cc:844] Serialized 499 byte log entry
0709 12:13:50.276625 (+394283us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:50.276776 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.638499 (+361723us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b54001a2554. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:50.638558 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.638611 (+    53us) raft_consensus.cc:1685] finished
0709 12:13:50.638631 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.638947 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30131584,"thread_start_us":393535,"threads_started":1,"wal-append.queue_time_us":342832}
I20260709 12:13:50.642153  3337 raft_consensus.cc:2393] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:13:50.651125  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 47701.3us
I20260709 12:13:50.635264  5141 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.698904  3184 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:13:50.699082  3185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1388) took 1146 ms. Trace:
I20260709 12:13:50.702438  3185 rpcz_store.cc:276] 0709 12:13:49.552901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.612553 (+1059652us) service_pool.cc:224] Handling call
0709 12:13:50.665162 (+ 52609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.698507 (+ 33345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.698562 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:50.698649 (+    87us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:50.698709 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.698793 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.698955 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:50.704931  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.710402  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:50.708843  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40510 (request call id 1687) took 1404 ms. Trace:
I20260709 12:13:50.703974  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:50.722339  3185 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:50.665015  4946 consensus_queue.cc:1048] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:13:50.711863  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:50.724679  4946 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:50.725476  4946 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.725983  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:50.727028  3186 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
W20260709 12:13:50.728618  3308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.256s	user 0.047s	sys 0.056s
I20260709 12:13:50.714583  3266 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
W20260709 12:13:50.703307  5181 log.cc:927] Time spent T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.150s	user 0.000s	sys 0.002s
I20260709 12:13:50.704058  3187 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:50.708496  3231 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:50.730335  4998 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:50.729708  3305 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:50.705907  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:50.739122  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55426 (request call id 379) took 1191 ms. Trace:
I20260709 12:13:50.740005  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:50.781919  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.744676  5161 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:50.744555  5151 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:50.744462  4839 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.721797  3192 rpcz_store.cc:276] 0709 12:13:49.252759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.252938 (+   179us) service_pool.cc:224] Handling call
0709 12:13:49.253311 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:49.253701 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.253728 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:49.262325 (+  8597us) log.cc:844] Serialized 52 byte log entry
0709 12:13:50.306662 (+1044337us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b18001fc6c0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4c2e07 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1aee16720b 00007f1aee16cd23 00007f1aee16d0d1 00007f1aee588a0f
0709 12:13:50.631313 (+324651us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b5400196020. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee537090 00007f1aee5446b8 00007f1aee5cd92b 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c
0709 12:13:50.631419 (+   106us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:50.631851 (+   432us) log.cc:844] Serialized 14 byte log entry
0709 12:13:50.645094 (+ 13243us) log.cc:844] Serialized 14 byte log entry
0709 12:13:50.645379 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.650809 (+  5430us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.650855 (+    46us) raft_consensus.cc:1685] finished
0709 12:13:50.650871 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.657250 (+  6379us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17413,"prepare.queue_time_us":1274,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":13470,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":7230,"spinlock_wait_cycles":42937472,"thread_start_us":44764,"threads_started":1,"wal-append.queue_time_us":1074296}
W20260709 12:13:50.747614  3186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40494 (request call id 1372) took 2626 ms (client timeout 2919 ms). Trace:
W20260709 12:13:50.816380  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 86846.8us
I20260709 12:13:50.779973  5172 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
W20260709 12:13:50.780325  3308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.308s	user 0.047s	sys 0.056s
I20260709 12:13:50.741703  5144 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:50.728284  4946 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.814388  5142 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:50.823560  4998 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.824457  4839 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.825001  5116 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:50.826225  3335 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:50.815403  3186 rpcz_store.cc:269] 0709 12:13:48.121670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.123854 (+  2184us) service_pool.cc:224] Handling call
0709 12:13:49.595867 (+1472013us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b5800002a98. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8eee 000000000036eb39 00007f1af351c1e0 00007f1af35e50c4 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:13:50.725765 (+1129898us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b5800002a98. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8f8c 00007f1aeb4a8ef6 000000000036eb39 00007f1af351c1e0 00007f1af35e50c4 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:13:50.747526 (+ 21761us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28489216}
I20260709 12:13:50.826869  5151 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:50.837952  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 98076.7us
I20260709 12:13:50.790896  3928 rpcz_store.cc:276] 0709 12:13:49.547241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.554654 (+  7413us) service_pool.cc:224] Handling call
0709 12:13:50.730380 (+1175726us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8eee 000000000036eb39 00007f1af351c1e0 00007f1af35e50c4 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:13:50.730635 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.730884 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.730922 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:50.730985 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:50.738672 (+  7687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.738748 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.738887 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12521216}
I20260709 12:13:50.851534  5082 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:50.852267  5082 raft_consensus.cc:697] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:50.853914  5144 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:50.853526  5082 consensus_queue.cc:237] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:50.855546  5172 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.857772  5172 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.845182  5161 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.860368  5161 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:50.868018  3185 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:13:50.874826  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:50.906005  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:50.906821  3338 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:50.908082  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:50.908701  3338 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:50.910884  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:50.912016  5103 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:50.884840  5172 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.915629  5103 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:50.937289  3188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1385) took 1431 ms. Trace:
I20260709 12:13:50.872442  5142 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:50.991048  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 160648us
I20260709 12:13:50.948666  3188 rpcz_store.cc:276] 0709 12:13:49.506370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.427248 (+920878us) service_pool.cc:224] Handling call
0709 12:13:50.520514 (+ 93266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.546501 (+ 25987us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:13:50.546861 (+   360us) log.cc:844] Serialized 14 byte log entry
0709 12:13:50.936824 (+389963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:50.936941 (+   117us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:50.936991 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.937075 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.937226 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1256,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":18403,"thread_start_us":366416,"threads_started":1}
W20260709 12:13:51.000495  5185 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:13:51.017655  4591 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.020977  4998 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:51.044574  5151 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:51.049448  3338 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:51.064039  5103 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:51.018646  4591 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:51.069082  3335 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:51.070039  5142 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:51.082947  4591 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:51.234400  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.288888  3087 catalog_manager.cc:5697] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.290841  3087 catalog_manager.cc:5697] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 3, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.293169  3087 catalog_manager.cc:5697] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 2 to 3, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.294849  3087 catalog_manager.cc:5697] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.296486  3087 catalog_manager.cc:5697] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 2, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:13:51.298214  3087 catalog_manager.cc:5697] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 2, term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to <none>, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 2 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:13:51.299682  3087 catalog_manager.cc:5697] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.301270  3087 catalog_manager.cc:5697] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 2 to 3, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 3 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:51.302793  3087 catalog_manager.cc:5697] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.304364  3087 catalog_manager.cc:5697] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:13:51.306118  3087 catalog_manager.cc:5697] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 2 to 4, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 4 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.307636  3087 catalog_manager.cc:5697] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:51.309497  3087 catalog_manager.cc:5697] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.310802  3087 catalog_manager.cc:5697] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 2, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.312532  3087 catalog_manager.cc:5697] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:13:51.346658  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1386) took 1840 ms. Trace:
I20260709 12:13:51.347074  3191 rpcz_store.cc:276] 0709 12:13:49.506648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.468557 (+961909us) service_pool.cc:224] Handling call
0709 12:13:50.487139 (+ 18582us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:50.597719 (+110580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.597770 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:50.608550 (+ 10780us) log.cc:844] Serialized 26 byte log entry
0709 12:13:50.904383 (+295833us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:50.904425 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.904513 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:51.346361 (+441848us) raft_consensus.cc:1685] finished
0709 12:13:51.346383 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.346576 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":807,"raft.queue_time_us":54266,"raft.run_cpu_time_us":572,"raft.run_wall_time_us":39792,"thread_start_us":246756,"threads_started":1,"wal-append.queue_time_us":383385}
I20260709 12:13:51.373453  3338 raft_consensus.cc:1240] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:51.374549  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:51.375509  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:51.376406  3156 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.012s	sys 0.011s
W20260709 12:13:51.376808  3156 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.012s	sys 0.011s
W20260709 12:13:51.377169  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 549317us
I20260709 12:13:51.377621  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:51.378683  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:51.380692  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:51.382460  5173 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:51.383191  5173 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.385480  5173 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:51.386047  5173 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:51.386613  5173 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:51.388620  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.392190  5173 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:51.396080  3184 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:13:51.378800  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:51.400343  3184 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.401000  5059 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:51.401677  5059 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:51.402150  5059 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.404121  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.404857  3185 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:51.406260  5059 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:51.408654  3267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1264) took 3464 ms. Trace:
I20260709 12:13:51.409049  3267 rpcz_store.cc:276] 0709 12:13:47.944095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.944254 (+   159us) service_pool.cc:224] Handling call
0709 12:13:47.944690 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:49.291399 (+1346709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.291464 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:49.293862 (+  2398us) log.cc:844] Serialized 26 byte log entry
0709 12:13:49.784366 (+490504us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:49.784424 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.407722 (+1623298us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400174dd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:51.407813 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:51.407907 (+    94us) raft_consensus.cc:1685] finished
0709 12:13:51.407922 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.408465 (+   543us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2145,"raft.queue_time_us":3251,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":10690,"spinlock_wait_cycles":3090955136,"thread_start_us":487743,"threads_started":1,"wal-append.queue_time_us":750709}
I20260709 12:13:50.525594  3189 rpcz_store.cc:276] 0709 12:13:49.504699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.122299 (+617600us) service_pool.cc:224] Handling call
0709 12:13:50.122675 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.122908 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:50.373636 (+250728us) log.cc:844] Serialized 14 byte log entry
0709 12:13:50.523788 (+150152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:50.523884 (+    96us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:50.523966 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.524121 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.524364 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46447,"prepare.queue_time_us":291214,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":4839,"raft.queue_time_us":58050,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":203,"thread_start_us":179301,"threads_started":2,"wal-append.queue_time_us":122145}
I20260709 12:13:51.419004  3265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1276) took 2614 ms. Trace:
I20260709 12:13:51.419523  3265 rpcz_store.cc:276] 0709 12:13:48.804974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.805070 (+    96us) service_pool.cc:224] Handling call
0709 12:13:50.319612 (+1514542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:50.320454 (+   842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.320494 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:50.321236 (+   742us) log.cc:844] Serialized 26 byte log entry
0709 12:13:50.406793 (+ 85557us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:50.423354 (+ 16561us) log.cc:844] Serialized 14 byte log entry
0709 12:13:50.423737 (+   383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.425219 (+  1482us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.481917 (+ 56698us) raft_consensus.cc:1685] finished
0709 12:13:50.481934 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.418544 (+936610us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54001a2050. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:51.418801 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19735,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":11785,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":320,"spinlock_wait_cycles":3482194304,"thread_start_us":84962,"threads_started":1,"wal-append.queue_time_us":112771}
I20260709 12:13:51.421068  3338 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:51.426321  3157 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.012s	sys 0.018s
W20260709 12:13:51.426736  3157 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.012s	sys 0.018s
W20260709 12:13:51.427034  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 538340us
I20260709 12:13:51.428290  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:51.431631  3157 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:51.434063  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:51.432792  5116 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:51.434726  5116 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:51.435128  5116 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.439322  4983 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:51.440202  4983 raft_consensus.cc:697] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:51.441213  4983 consensus_queue.cc:237] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.447635  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.448448  5144 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:51.448725  3926 raft_consensus.cc:2393] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 4: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:51.449213  5144 raft_consensus.cc:697] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:51.450601  5144 consensus_queue.cc:237] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.453737  3090 catalog_manager.cc:5697] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 4, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 4 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.459282  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.461583  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.473644  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.476797  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.478998  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.481866  4983 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:51.482618  4983 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.485571  4983 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:51.489509  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:13:51.490137  4874 consensus_meta.cc:287] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.004s
I20260709 12:13:51.490664  5081 consensus_queue.cc:1059] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:51.491729  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55438 (request call id 600) took 3388 ms. Trace:
I20260709 12:13:51.492110  4958 raft_consensus.cc:3055] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:51.492630  4958 raft_consensus.cc:740] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:51.493125  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:51.493861  4958 consensus_queue.cc:260] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.502262  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.503084  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.504369  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:51.509740  3188 raft_consensus.cc:1275] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:51.511922  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:51.512275  3306 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:51.513237  5103 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.503257  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:51.517921  3306 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:51.513789  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.492225  4874 rpcz_store.cc:276] 0709 12:13:48.103181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.105111 (+  1930us) service_pool.cc:224] Handling call
0709 12:13:48.430016 (+324905us) ts_tablet_manager.cc:934] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
0709 12:13:50.500454 (+2070438us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:13:50.747408 (+246954us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:50.781572 (+ 34164us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:13:51.490658 (+709086us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:13:51.491071 (+   413us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:51.491480 (+   409us) ts_tablet_manager.cc:989] Replica registered.
0709 12:13:51.491620 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":74698,"tablet-copy.queue_time_us":9296,"thread_start_us":225210,"threads_started":1}
I20260709 12:13:51.525655  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.526132  4874 tablet_copy_client.cc:806] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:51.521311  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:51.526918  4874 tablet_copy_client.cc:670] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:51.527035  3186 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.537225  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:51.537607  3188 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:13:51.524905  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:51.542732  3306 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:50.623935  3190 rpcz_store.cc:276] 0709 12:13:49.504371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.504611 (+   240us) service_pool.cc:224] Handling call
0709 12:13:50.404116 (+899505us) spinlock_profiling.cc:243] Waited 9.18 ms on lock 0x7b5800002a98. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:13:50.404406 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.404812 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:50.414134 (+  9322us) log.cc:844] Serialized 14 byte log entry
0709 12:13:50.539243 (+125109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:50.539308 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:50.539388 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.539501 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.539626 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24021,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":23381,"raft.queue_time_us":429,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":63237,"spinlock_wait_cycles":21110144,"thread_start_us":124710,"threads_started":2,"wal-append.queue_time_us":199108}
I20260709 12:13:51.565815  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.565992  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.567189  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.567874  3929 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:51.567971  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.570344  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.571074  3931 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:13:51.573606  5118 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.560771  5082 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.570142  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.583746  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47276 (request call id 194) took 2355 ms. Trace:
I20260709 12:13:51.584856  3193 rpcz_store.cc:276] 0709 12:13:49.228530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.230065 (+  1535us) service_pool.cc:224] Handling call
0709 12:13:49.230469 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:49.241137 (+ 10668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.241170 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:49.241224 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:49.241259 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.583238 (+2341979us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b54002350d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:51.583307 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.583544 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24021376}
I20260709 12:13:51.610177  5116 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.612950  5116 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:51.616516  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:51.618793  5109 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:51.619941  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 911566us
I20260709 12:13:51.620743  3231 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:51.621625  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.624704  5206 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.625406  5206 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.627777  5206 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:51.659782  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:51.674877  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.675743  3193 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:13:51.678210  3186 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
W20260709 12:13:51.678419  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 73192.1us
I20260709 12:13:51.681758  3337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58564 (request call id 1687) took 1248 ms. Trace:
I20260709 12:13:51.682277  3337 rpcz_store.cc:276] 0709 12:13:50.433554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.433987 (+   433us) service_pool.cc:224] Handling call
0709 12:13:51.681530 (+1247543us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54000230d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:51.681690 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472237824}
I20260709 12:13:51.682870  5206 consensus_queue.cc:1059] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:51.683658  3895 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:51.685324  5206 raft_consensus.cc:3055] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:51.685685  5206 raft_consensus.cc:740] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:51.685791  5059 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:51.686190  5059 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.686527  5059 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.686683  5206 consensus_queue.cc:260] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.687839  5206 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:51.690496  3266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 1709) took 2214 ms (client timeout 2134 ms). Trace:
I20260709 12:13:51.681883  3340 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.692392  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:51.690943  3266 rpcz_store.cc:269] 0709 12:13:49.475629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.720048 (+244419us) service_pool.cc:224] Handling call
0709 12:13:51.690268 (+1970220us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b540048f3d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:51.690396 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057822208}
I20260709 12:13:51.700944  5116 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.705572  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:51.710348  4721 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:51.711076  4721 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.713608  4721 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:51.716594  3929 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:51.716944  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.717849  3931 raft_consensus.cc:2393] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 2: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:51.717998  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.719201  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.720899  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.721302  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1699) took 2321 ms. Trace:
I20260709 12:13:51.722682  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.724686  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:51.725050  5016 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:51.725507  5016 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.725921  5016 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.726569  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:51.727514  5161 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:51.729398  5161 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.731711  5045 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.731953  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:51.731997  5059 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.734099  4911 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:51.734715  4911 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.735042  5059 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:51.735625  3305 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:51.736608  5106 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.736970  4911 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:51.737553  4911 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:51.738073  4911 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:51.739902  5022 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:51.740477  3305 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:51.740453  5022 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:51.742774  5022 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:51.742837  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:51.732784  4840 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:13:51.761137  3264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 1703) took 2353 ms (client timeout 1705 ms). Trace:
W20260709 12:13:51.744881  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 120401us
W20260709 12:13:51.838235  3264 rpcz_store.cc:269] 0709 12:13:49.408157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.702086 (+293929us) service_pool.cc:224] Handling call
0709 12:13:51.760865 (+2058779us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b540046ebd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:51.761039 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065651584}
I20260709 12:13:51.839385  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:51.840116  3090 catalog_manager.cc:5697] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 3, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 3 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:51.842366  5215 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.849812  5142 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:51.852438  5016 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.834009  4958 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.854565  5016 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:51.746387  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 606) took 1219 ms. Trace:
I20260709 12:13:51.757589  4911 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:51.743671  4904 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:51.746219  5121 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:51.763075  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:51.880049  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 117026us
I20260709 12:13:51.879626  4904 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:51.743382  5022 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.816956  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.818549  3895 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:51.829165  5045 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:51.759776  5103 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:51.829809  4840 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:51.889936  4840 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:51.830341  5166 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:51.890661  5166 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:51.892593  5166 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:51.893265  5045 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.894874  3338 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:51.831677  5116 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.895709  5116 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:51.897327  5103 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:51.897778  5103 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.897830  5116 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:51.834158  5151 consensus_queue.cc:1048] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:51.898114  5172 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:51.707031  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:51.840764  3232 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:51.760166  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.721791  3261 rpcz_store.cc:276] 0709 12:13:49.399300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.875834 (+476534us) service_pool.cc:224] Handling call
0709 12:13:50.445432 (+569598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:50.446325 (+   893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.446383 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:50.447143 (+   760us) log.cc:844] Serialized 26 byte log entry
0709 12:13:50.523116 (+ 75973us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:50.603635 (+ 80519us) log.cc:844] Serialized 14 byte log entry
0709 12:13:51.617411 (+1013776us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b18003ef5c0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb45ac0a 00007f1af4b9a219 00007f1aeb4e2a40 00007f1aeb4dd4e4 00007f1aeb4dd455 00007f1aee5c5060 00007f1aee5d7716 00007f1aee5e8287 00007f1aee5e8208
0709 12:13:51.617699 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.617831 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:51.617912 (+    81us) raft_consensus.cc:1685] finished
0709 12:13:51.618039 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.720927 (+102888us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b5400421650. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:51.721083 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22026,"prepare.queue_time_us":22752,"prepare.run_cpu_time_us":10373,"prepare.run_wall_time_us":48547,"raft.queue_time_us":1119429,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":328,"spinlock_wait_cycles":1277458048,"thread_start_us":62275,"threads_started":1,"wal-append.queue_time_us":99248}
I20260709 12:13:51.900007  3190 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:51.901032  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.902186  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.866007  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.903455  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.904008  3186 raft_consensus.cc:2410] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:51.905030  5142 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.867300  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.870245  3927 rpcz_store.cc:276] 0709 12:13:50.527454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.534230 (+  6776us) service_pool.cc:224] Handling call
0709 12:13:51.745492 (+1211262us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:13:51.745711 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.745961 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.745995 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:51.746042 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:51.746093 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.746176 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.746301 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3307904}
I20260709 12:13:51.906040  3188 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:13:51.903199  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.906987  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.907986  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.868683  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.913933  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.914482  3189 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 1.
I20260709 12:13:51.868963  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:51.868510  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 125754us
I20260709 12:13:51.916509  3185 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.917034  3305 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:51.918524  3185 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:51.918723  5197 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.855154  5016 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:51.915237  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:51.920012  3189 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.919754  5016 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:51.920243  3305 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:51.921797  5106 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:51.921892  5016 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:51.880424  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.922458  3185 raft_consensus.cc:1240] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:51.923621  5045 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:51.817293  5210 consensus_queue.cc:1059] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:13:51.884645  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 66182.1us
I20260709 12:13:51.924628  3185 raft_consensus.cc:1240] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:51.885193  5121 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:51.885861  3929 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:51.886147  4995 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:51.880187  3192 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:13:51.886724  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:51.888149  3191 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:51.864588  5141 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:51.904973  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.866725  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.908077  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:51.867718  5215 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:51.908583  5022 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:51.909469  3932 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37962 (request call id 362) took 1580 ms (client timeout 1785 ms). Trace:
I20260709 12:13:51.912681  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:51.922214  5106 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:51.932444  5210 raft_consensus.cc:3055] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:51.936482  3090 catalog_manager.cc:5697] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 3 to 5, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 5 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:13:51.945390  3932 rpcz_store.cc:269] 0709 12:13:50.328805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.816580 (+1487775us) service_pool.cc:224] Handling call
0709 12:13:51.909408 (+ 92828us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:51.978286  5118 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:51.979259  5121 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:51.980042  3087 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48786 (request call id 302) took 4757 ms. Trace:
I20260709 12:13:51.949389  5106 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.944955  5141 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:51.976771  3895 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:51.987573  5016 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:51.988279  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.955225  5210 raft_consensus.cc:740] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:51.981736  4874 tablet_copy_client.cc:538] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:51.991330  3895 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:51.981118  4840 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:51.949991  4995 raft_consensus.cc:697] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
W20260709 12:13:52.006572  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 56681.8us
I20260709 12:13:51.981621  4904 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:52.015272  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 174581us
I20260709 12:13:52.020243  3189 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:13:52.025980  3895 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:52.024421  3305 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:51.985339  5109 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:13:51.998082  5141 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.019131  5081 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:52.000522  5121 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:52.033138  3932 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:52.052026  5022 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:52.030092  4840 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:52.054564  4840 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:52.036226  5081 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:51.980443  3087 rpcz_store.cc:276] 0709 12:13:47.223112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.223241 (+   129us) service_pool.cc:224] Handling call
0709 12:13:51.979933 (+4756692us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:51.319932 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:51.320507 (+   575us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:51.320560 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:13:51.320592 (+    32us) tablet.cc:662] Decoding operations
0709 12:13:51.321977 (+  1385us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:51.322082 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:51.322113 (+    31us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:13:51.323329 (+  1216us) tablet.cc:701] Row locks acquired
0709 12:13:51.323374 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:13:51.323582 (+   208us) write_op.cc:270] Start()
0709 12:13:51.323720 (+   138us) write_op.cc:276] Timestamp: P: 1783599231323511 usec, L: 0
0709 12:13:51.323747 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:13:51.324529 (+   782us) log.cc:844] Serialized 5932 byte log entry
0709 12:13:51.329496 (+  4967us) op_driver.cc:464] REPLICATION: finished
0709 12:13:51.330737 (+  1241us) write_op.cc:301] APPLY: starting
0709 12:13:51.330842 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:51.331142 (+   300us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:51.331329 (+   187us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:51.333451 (+  2122us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:51.333892 (+   441us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:13:51.333971 (+    79us) write_op.cc:312] APPLY: finished
0709 12:13:51.334309 (+   338us) log.cc:844] Serialized 107 byte log entry
0709 12:13:51.334514 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:51.334673 (+   159us) write_op.cc:454] Released schema lock
0709 12:13:51.334757 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:51.335961 (+  1204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:51.336002 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19872,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":963,"apply.run_cpu_time_us":4292,"apply.run_wall_time_us":5179,"num_ops":15,"prepare.queue_time_us":1219,"prepare.run_cpu_time_us":5703,"prepare.run_wall_time_us":5709,"raft.queue_time_us":1026,"raft.run_cpu_time_us":1147,"raft.run_wall_time_us":1148,"replication_time_us":5586,"thread_start_us":2575,"threads_started":4,"wal-append.queue_time_us":999}]]}
I20260709 12:13:51.993108  5215 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:52.020152  4591 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:52.034942  5206 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:52.091218  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 45395.8us
I20260709 12:13:52.055641  5081 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.045145  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.138351  3261 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:13:52.030390  5221 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:52.139798  5221 raft_consensus.cc:697] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:52.140986  5221 consensus_queue.cc:237] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:52.096717  4591 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:52.112272  3122 debug-util.cc:398] Leaking SignalData structure 0x7b0800040d40 after lost signal to thread 2020
I20260709 12:13:52.112979  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:52.113719  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 57138us
I20260709 12:13:52.120594  4840 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:52.122340  4995 consensus_queue.cc:237] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:52.128892  5215 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:52.099702  5121 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:52.055828  5210 consensus_queue.cc:260] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:52.092772  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:52.155160  3265 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
W20260709 12:13:52.183919  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 91214.8us
I20260709 12:13:52.185132  3232 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:52.180500  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.162196  4840 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:52.187733  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.188565  5215 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:52.188989  5215 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:52.189366  5215 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:52.191605  5197 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:52.195622  5226 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:13:52.143958  5222 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:52.200407  5210 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:52.208020  3261 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:52.187155  3264 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:52.229070  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.229837  3267 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
W20260709 12:13:52.232023  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 46983.4us
I20260709 12:13:52.232990  3232 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:13:52.236996  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 84244.2us
I20260709 12:13:52.241147  3339 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:52.243170  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.243350  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.250837  3265 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
W20260709 12:13:52.257834  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 231911us
I20260709 12:13:52.258705  3895 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:52.186251  5103 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:52.246590  5219 log.cc:927] Time spent T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:13:52.238737  5121 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:52.243062  4904 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:52.264137  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:52.264819  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 74149.5us
I20260709 12:13:52.265466  3262 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:52.284642  3232 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:52.260515  5217 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:52.286015  3337 raft_consensus.cc:1240] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:52.271508  4840 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:52.289012  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:52.290356  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
W20260709 12:13:52.272203  3122 debug-util.cc:398] Leaking SignalData structure 0x7b08000372a0 after lost signal to thread 3125
I20260709 12:13:52.266050  4958 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.295738  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.296495  3259 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
W20260709 12:13:52.297237  3122 debug-util.cc:398] Leaking SignalData structure 0x7b08002734c0 after lost signal to thread 3217
W20260709 12:13:52.298537  3122 debug-util.cc:398] Leaking SignalData structure 0x7b0800377200 after lost signal to thread 3292
W20260709 12:13:52.298848  3122 debug-util.cc:398] Leaking SignalData structure 0x7b0800377240 after lost signal to thread 3293
I20260709 12:13:52.299410  5103 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:52.300118  5103 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:52.300918  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:52.292620  3895 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:52.304855  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.305512  3264 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:52.314306  3267 raft_consensus.cc:2393] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:52.291955  5217 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.319923  3265 raft_consensus.cc:1275] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:52.320569  5206 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:52.325817  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:52.291196  5235 consensus_queue.cc:1059] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:13:52.340876  3264 raft_consensus.cc:3055] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:52.341468  3264 raft_consensus.cc:740] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:13:52.328390  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.312099  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.311312  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:13:52.335047  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 50530.4us
I20260709 12:13:52.336928  3931 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:13:52.327653  5173 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:52.300519  5103 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
W20260709 12:13:52.339661  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 55179.1us
I20260709 12:13:52.345710  3306 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:52.350363  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:52.330049  4904 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:52.351562  4904 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:52.351953  4904 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.352099  5206 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:52.352514  5206 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.352876  5206 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.353448  5081 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:52.355170  3268 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:52.344046  3232 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:52.337579  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.357615  3263 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:52.330618  5217 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:52.340643  3122 debug-util.cc:398] Leaking SignalData structure 0x7b080026b120 after lost signal to thread 3366
I20260709 12:13:52.366031  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.371891  3267 raft_consensus.cc:3055] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:52.372342  3267 raft_consensus.cc:740] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:52.363586  3264 consensus_queue.cc:260] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:52.306042  5106 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:52.373736  3232 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:52.374964  3265 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:52.357175  5103 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:52.376106  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 46637.3us
I20260709 12:13:52.384028  3264 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:52.386035  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.386742  3260 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:52.365945  5022 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:52.392439  3232 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:52.385149  4911 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:52.394232  5105 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:52.394670  5105 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:52.394742  5224 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:52.395193  5105 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.395354  5224 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:52.397725  5224 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:52.402814  3895 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:13:52.409528  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 111677us
I20260709 12:13:52.379109  4958 consensus_queue.cc:1059] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:13:52.391674  5022 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.411510  5022 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.390807  3261 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:52.365581  5081 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:52.373447  4840 consensus_queue.cc:1059] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 12:13:52.478200  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 54271.9us
I20260709 12:13:52.429363  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:52.485906  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 56798us
W20260709 12:13:52.488955  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 66971.4us
I20260709 12:13:52.411739  5098 consensus_queue.cc:1048] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:13:52.428768  4911 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:52.493397  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.516033  5231 consensus_queue.cc:1059] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:13:52.572434  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.520038  4591 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:52.488730  4995 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:52.575462  4995 raft_consensus.cc:697] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:52.576911  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.576684  4995 consensus_queue.cc:237] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:52.578657  4911 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.491374  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:52.579238  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 149949us
I20260709 12:13:52.579190  4911 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:52.527514  5233 log.cc:927] Time spent T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:13:52.528086  5059 raft_consensus.cc:3055] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:52.580756  5059 raft_consensus.cc:740] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:52.581481  4911 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:52.582365  5098 raft_consensus.cc:2804] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:52.582820  5098 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.548388  3336 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:52.589598  5231 raft_consensus.cc:3055] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:52.590118  5231 raft_consensus.cc:740] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:52.591888  3184 raft_consensus.cc:1275] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:52.583197  5098 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:52.552939  5141 consensus_meta.cc:287] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.518s	user 0.018s	sys 0.005s
W20260709 12:13:52.555528  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 126020us
I20260709 12:13:52.581735  5059 consensus_queue.cc:260] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:52.547298  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 159091us
I20260709 12:13:52.550676  5103 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:52.566802  3122 debug-util.cc:398] Leaking SignalData structure 0x7b0800375a40 after lost signal to thread 3956
I20260709 12:13:52.605535  5106 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:52.623589  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:52.553673  5215 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:52.631955  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:52.635488  3190 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.633126  3232 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:52.619128  3122 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1f60 after lost signal to thread 3957
I20260709 12:13:52.644650  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.645365  3262 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:52.648634  5103 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:52.642462  3267 consensus_queue.cc:260] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:52.649928  3267 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.642067  5206 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:52.653858  5206 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:13:52.606112  3261 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:52.658879  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:52.615330  5141 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:52.661664  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 54835.4us
I20260709 12:13:52.670001  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:52.670699  3185 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.661053  3267 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:13:52.674286  3264 raft_consensus.cc:1275] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:52.591041  5231 consensus_queue.cc:260] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:52.683878  3342 raft_consensus.cc:1240] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:52.686152  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.687182  3262 raft_consensus.cc:2410] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:52.666203  5121 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:52.681476  5166 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:13:52.712488  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:52.713070  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.713218  3267 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:52.714226  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.715857  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.716248  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.716418  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.717123  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.717535  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.717742  3259 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:52.718108  3268 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:13:52.718636  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.718895  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.715274  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.721257  3260 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:52.724061  3267 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:13:52.691227  4840 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:52.729373  3337 raft_consensus.cc:1240] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:52.715903  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.733660  3266 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:52.747262  3185 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:52.753377  3264 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:52.755663  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:52.757292  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.758630  3262 raft_consensus.cc:2410] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:52.732405  4840 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:52.743541  5231 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.763748  4840 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:52.807333  5245 log.cc:927] Time spent T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:13:52.773761  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.806586  3264 raft_consensus.cc:2955] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
W20260709 12:13:52.809274  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 136467us
I20260709 12:13:52.768062  4995 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:52.753132  5225 consensus_queue.cc:1059] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 12:13:52.826479  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.835563  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:13:52.886667  5249 log.cc:927] Time spent T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:13:52.889850  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:13:52.893514  5247 log.cc:927] Time spent T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:13:52.919907  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.932956  3190 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
W20260709 12:13:52.935549  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:52.932180  3156 leader_election.cc:336] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.528s (SENT)
I20260709 12:13:52.823094  3259 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:52.942278  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.888832  5022 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:52.938120  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 340520us
I20260709 12:13:52.939576  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.944269  3268 raft_consensus.cc:2393] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:52.828625  4995 raft_consensus.cc:697] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:52.942605  3156 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:52.950486  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.968261  3263 raft_consensus.cc:1240] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:52.973244  3305 leader_election.cc:336] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.535s (SENT)
I20260709 12:13:52.884517  5105 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:52.974720  3305 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:52.946008  5141 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:52.976696  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:52.946692  5215 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:52.962038  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:53.020397  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:52.968936  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.022977  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:52.974416  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:13:53.036273  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 63075.2us
W20260709 12:13:53.040206  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 113734us
W20260709 12:13:53.043510  3156 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.581s (SENT)
I20260709 12:13:53.044207  3156 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:53.006377  5217 consensus_meta.cc:287] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.632s	user 0.000s	sys 0.011s
I20260709 12:13:53.042551  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:53.046718  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:53.003408  5103 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:53.065177  3156 leader_election.cc:336] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.640s (SENT)
I20260709 12:13:53.065819  3156 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:13:53.068426  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.050779  5151 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.053983  4874 tablet_bootstrap.cc:492] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:13:53.022912  4998 consensus_queue.cc:1059] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:13:53.058529  4983 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.078303  5115 raft_consensus.cc:3055] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:13:53.079178  5246 log.cc:927] Time spent T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 12:13:53.047669  3261 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:53.079587  4995 consensus_queue.cc:237] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:53.080766  5252 log.cc:927] Time spent T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:13:53.084313  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:53.061009  5217 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:53.087277  3924 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:53.108791  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.075412  5225 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:53.089682  3156 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.643s (SENT)
I20260709 12:13:53.097729  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:13:53.098475  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 154984us
I20260709 12:13:53.112277  3156 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.113976  3190 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:53.115399  3260 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:53.099383  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:53.097990  5115 raft_consensus.cc:740] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:53.120142  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.102973  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:53.121357  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.123409  3265 raft_consensus.cc:2368] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3.
I20260709 12:13:53.127961  3266 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:53.135244  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:53.141793  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 52137.3us
W20260709 12:13:53.144054  3156 leader_election.cc:336] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.705s (SENT)
I20260709 12:13:53.133881  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.144546  3156 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.144997  3259 raft_consensus.cc:2376] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5. Re-sending same reply.
I20260709 12:13:53.130458  4983 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.148061  4983 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.150605  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.135990  3260 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:53.157433  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.158010  3266 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:53.160172  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:53.162075  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:53.163378  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:53.164062  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:53.164716  3192 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:53.156071  3261 raft_consensus.cc:2410] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:53.168680  3186 raft_consensus.cc:2393] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
W20260709 12:13:53.170028  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.176175  5105 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:53.178603  4904 consensus_meta.cc:287] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.826s	user 0.012s	sys 0.000s
I20260709 12:13:53.187920  3232 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:13:53.160991  5253 log.cc:927] Time spent T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:13:53.189441  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:53.190032  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:53.152127  5022 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:53.161335  3927 raft_consensus.cc:1240] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:53.196437  3186 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:53.199126  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.200181  3156 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.200402  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:53.201488  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:53.202647  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:53.179178  4904 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:53.203826  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:53.205291  3260 raft_consensus.cc:1240] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:53.206663  4904 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:53.207377  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.207480  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:53.210924  5098 consensus_meta.cc:287] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.578s	user 0.006s	sys 0.001s
I20260709 12:13:53.211529  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.211627  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.213552  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.212423  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.214641  4983 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.215035  3187 raft_consensus.cc:1240] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:53.215659  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.216396  3267 raft_consensus.cc:2393] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:53.217142  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.217814  5217 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:53.218883  5144 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.213711  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.225399  3156 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:53.227380  3156 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.229058  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:53.194867  5121 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.234032  5173 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:53.214635  4840 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:53.237807  5173 raft_consensus.cc:697] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:53.238049  4840 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:53.235611  3156 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.238883  5173 consensus_queue.cc:237] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:53.240350  3156 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:53.241357  5225 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.243614  4998 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.243888  3156 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.243764  5224 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:53.244846  4998 raft_consensus.cc:2804] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:53.245206  4998 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:53.245545  4998 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:53.249768  3266 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:53.243616  3264 raft_consensus.cc:1240] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:53.233234  5144 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.162739  5115 consensus_queue.cc:260] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:53.211359  5098 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:13:53.301963  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 56014.8us
I20260709 12:13:53.302901  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:53.311385  3231 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.313310  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:53.312316  4840 consensus_queue.cc:1059] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:13:53.302157  5115 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.311345  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:53.324352  4983 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.325030  4983 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:53.318287  5098 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:53.330720  3193 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:53.332505  5121 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:53.335196  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 174714us
I20260709 12:13:53.335999  3925 raft_consensus.cc:1240] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:53.336956  3231 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.337157  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.338294  5166 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.338676  5098 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:53.338790  3231 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.339241  5098 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:53.345757  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:53.350594  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.360671  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.363037  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.368594  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:13:53.377390  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.379522  4840 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:53.363332  4983 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:53.383698  3192 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:53.385603  3266 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:53.388898  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.390214  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.393162  5098 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:53.364482  5235 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 12:13:53.395684  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.360034  5166 consensus_queue.cc:1059] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:13:53.397464  5166 consensus_queue.cc:1243] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer 6f0cdd57c5934921829c205d32b2b8a5 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:13:53.398442  5059 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:53.399600  3259 raft_consensus.cc:3055] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:53.400008  3259 raft_consensus.cc:740] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:53.396730  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:53.385960  3192 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:13:53.402180  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 63524.6us
I20260709 12:13:53.408020  3231 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.418749  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.425766  4998 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:53.428529  4911 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:53.400904  3259 consensus_queue.cc:260] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:53.430675  3259 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:53.434463  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 122620us
I20260709 12:13:53.439582  3231 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.441424  5106 consensus_queue.cc:1048] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:13:53.443993  4840 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.446863  5263 raft_consensus.cc:3055] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:53.447774  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:53.449786  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.450117  4998 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:53.450918  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.454191  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.454233  5121 raft_consensus.cc:3055] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:53.455046  5121 raft_consensus.cc:740] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:53.455442  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:53.455757  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.456679  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:53.457245  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:53.457726  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:53.458478  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.458837  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.464627  3336 raft_consensus.cc:1240] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:53.467203  3342 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:53.481812  5082 raft_consensus.cc:3055] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:53.473672  3231 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:53.482298  5082 raft_consensus.cc:740] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:53.485141  3231 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:53.447278  5263 raft_consensus.cc:740] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:53.486991  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:53.491982  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 113973us
I20260709 12:13:53.494900  3231 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:53.496524  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:53.496757  3231 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:53.506008  3189 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:13:53.492136  5260 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:53.512373  5270 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:53.512806  5270 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:53.513010  3925 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:53.513199  5270 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.504225  5022 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:53.518772  3895 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.489639  5240 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:13:53.504050  5217 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:53.516546  5271 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.510281  5121 consensus_queue.cc:260] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:53.525974  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:53.519738  5022 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:53.530730  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:53.559051  3190 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:53.559398  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:53.531457  5263 consensus_queue.cc:260] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:53.491480  5082 consensus_queue.cc:260] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:53.518945  3231 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:13:53.564548  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 45686.5us
I20260709 12:13:53.564579  3306 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:53.542557  5121 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:53.556421  3340 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:53.551332  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:53.567365  4958 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.568804  3259 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:53.560875  5022 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.571616  4591 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:53.572111  4591 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:53.572510  4591 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:53.575142  5016 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.576323  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.560189  3336 raft_consensus.cc:2368] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3.
W20260709 12:13:53.580278  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 63924.1us
I20260709 12:13:53.566730  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.563143  3232 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.586839  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.588647  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.591995  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:53.542901  5215 consensus_queue.cc:1175] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7ac63b674f204bc4805ab989f8c965d3" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:53.593660  3190 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:53.594774  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.596040  3267 raft_consensus.cc:2368] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5.
I20260709 12:13:53.595917  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.596501  3262 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.597046  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:53.597762  3190 raft_consensus.cc:2393] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:53.601075  3232 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.601877  3895 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.602934  3157 leader_election.cc:400] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3.
I20260709 12:13:53.603245  3157 leader_election.cc:403] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:53.604136  3232 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.609150  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.608155  5059 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.610457  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.610888  3089 catalog_manager.cc:5697] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 2 to 1, leader changed from <none> to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 12:13:53.599538  5016 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:53.602514  5166 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:13:53.615828  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.643101  3090 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34704 (request call id 178) took 4311 ms. Trace:
I20260709 12:13:53.613219  3232 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.622673  3089 catalog_manager.cc:5697] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 3 to 4, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 4 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:53.606912  5082 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:53.657699  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.627534  5217 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.608877  5144 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3.
I20260709 12:13:53.634253  5263 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.637868  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.680688  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.675082  3156 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.615309  5271 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.686586  5109 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.686693  3156 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.687633  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.688346  3156 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:53.689291  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.690469  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.690999  3263 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:13:53.691614  4983 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:53.692023  4983 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:53.692503  4983 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.666029  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.607352  5215 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.671326  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.660943  5166 raft_consensus.cc:2749] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.692090  5225 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:53.711887  5225 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:53.667227  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.695870  3156 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.712821  3267 raft_consensus.cc:2393] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:53.653859  3232 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.698992  3262 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:13:53.706306  3268 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:53.667641  5022 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:53.708423  3895 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.716893  3895 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:53.717514  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.717952  3895 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:53.719326  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.719481  3156 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.720739  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.721463  3263 raft_consensus.cc:2368] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3.
I20260709 12:13:53.714821  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:53.707509  3260 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:13:53.684433  5261 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:53.728855  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 75076.5us
I20260709 12:13:53.649216  3090 rpcz_store.cc:276] 0709 12:13:49.331320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.331499 (+   179us) service_pool.cc:224] Handling call
0709 12:13:53.643040 (+4311541us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:52.389641 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:52.619522 (+229881us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:52.622694 (+  3172us) write_op.cc:435] Acquired schema lock
0709 12:13:52.627369 (+  4675us) tablet.cc:662] Decoding operations
0709 12:13:52.725234 (+ 97865us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:52.731106 (+  5872us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:52.731154 (+    48us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:13:52.768962 (+ 37808us) tablet.cc:701] Row locks acquired
0709 12:13:52.772263 (+  3301us) write_op.cc:260] PREPARE: finished
0709 12:13:52.822690 (+ 50427us) write_op.cc:270] Start()
0709 12:13:52.829362 (+  6672us) write_op.cc:276] Timestamp: P: 1783599232782270 usec, L: 0
0709 12:13:52.921270 (+ 91908us) op_driver.cc:348] REPLICATION: starting
0709 12:13:53.054915 (+133645us) log.cc:844] Serialized 1293 byte log entry
0709 12:13:53.339592 (+284677us) op_driver.cc:464] REPLICATION: finished
0709 12:13:53.491064 (+151472us) write_op.cc:301] APPLY: starting
0709 12:13:53.491151 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:53.491291 (+   140us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:53.491497 (+   206us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:53.512202 (+ 20705us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:53.512388 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:13:53.512451 (+    63us) write_op.cc:312] APPLY: finished
0709 12:13:53.512646 (+   195us) log.cc:844] Serialized 35 byte log entry
0709 12:13:53.512803 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:53.512896 (+    93us) write_op.cc:454] Released schema lock
0709 12:13:53.512937 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:53.513308 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:53.513338 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":446191,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":151170,"apply.run_cpu_time_us":2449,"apply.run_wall_time_us":22211,"num_ops":3,"prepare.queue_time_us":383902,"prepare.run_cpu_time_us":21679,"prepare.run_wall_time_us":762433,"raft.queue_time_us":108357,"raft.run_cpu_time_us":10553,"raft.run_wall_time_us":106739,"replication_time_us":410342,"thread_start_us":339833,"threads_started":4,"wal-append.queue_time_us":120703}]]}
I20260709 12:13:53.732159  3232 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.740675  5271 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.712316  5225 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.740180  5059 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.726363  5206 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:53.762741  3156 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.722919  4958 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:53.750815  3266 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:13:53.708290  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.722707  5144 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.715363  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:53.789112  3265 raft_consensus.cc:1240] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:53.674249  5270 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:53.791348  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:53.725798  3334 raft_consensus.cc:1240] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:53.808229  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.734772  4591 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:53.810767  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 58215us
W20260709 12:13:53.815892  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 53270.6us
W20260709 12:13:53.807941  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 75836.5us
I20260709 12:13:53.817562  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.787905  5231 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:53.821146  4591 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:53.809268  5230 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:53.812191  5166 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.894348  3336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:46076
I20260709 12:13:53.896965  3336 raft_consensus.cc:606] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:53.897671  4591 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:53.898128  4591 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:53.898532  4591 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:53.779104  5261 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:53.902136  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.823318  5231 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:13:53.922135  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 105388us
W20260709 12:13:53.905653  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 88168.2us
I20260709 12:13:53.927888  3232 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.893616  5230 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:53.930858  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:53.936232  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 214330us
I20260709 12:13:53.937661  3305 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:13:53.939657  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 179110us
I20260709 12:13:53.949139  5080 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.949796  5080 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:53.952944  3232 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.918375  5271 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.918905  5231 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.955170  3232 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.924219  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:53.958444  3232 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:53.935855  5230 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.933947  5121 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.969009  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:53.956664  5166 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:53.956615  5215 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.961194  5105 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:53.963323  5217 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.977195  5210 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:53.979156  5261 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:53.969895  5221 consensus_queue.cc:1048] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:13:53.980067  5080 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:53.980350  5248 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:53.969617  4911 consensus_queue.cc:1059] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.012s
W20260709 12:13:53.979944  5282 log.cc:927] Time spent T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:13:53.967614  5016 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.984889  5022 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:53.975133  5105 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:53.996922  5105 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:53.998245  4911 raft_consensus.cc:3055] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:53.998723  4911 raft_consensus.cc:740] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:53.999670  5241 consensus_queue.cc:1059] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:53.999591  4911 consensus_queue.cc:260] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.001029  5166 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:54.002336  5166 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:54.003965  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 74458.1us
I20260709 12:13:54.004967  3156 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:54.014088  3895 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:54.016549  3156 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:53.975055  4958 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:54.023944  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 57378.9us
I20260709 12:13:54.025629  5270 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:54.107585  5286 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.091s	user 0.001s	sys 0.003s
I20260709 12:13:54.019984  5080 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.026684  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:54.021487  5206 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:54.196317  5206 raft_consensus.cc:697] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
W20260709 12:13:54.075449  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:54.198400  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:54.075618  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 56527.3us
I20260709 12:13:54.198146  5206 consensus_queue.cc:237] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:54.199586  5098 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:54.200594  5293 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:54.201857  5105 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:54.201099  5293 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.104039  3931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "7ac63b674f204bc4805ab989f8c965d3"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:13:54.008491  5121 consensus_queue.cc:1059] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:13:54.204124  3931 raft_consensus.cc:606] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Received request to transfer leadership to TS 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:54.020159  5241 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:13:54.019742  5106 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:13:54.023006  5082 consensus_queue.cc:1048] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:13:54.016500  5287 consensus_queue.cc:1059] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:13:54.207382  5287 raft_consensus.cc:3055] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:54.207531  3340 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:54.207787  5287 raft_consensus.cc:740] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:54.208696  5287 consensus_queue.cc:260] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:54.210260  5287 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.115633  5285 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:13:54.116545  5290 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.119478  4874 tablet_bootstrap.cc:492] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:54.076489  5291 consensus_queue.cc:1059] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:13:54.130268  3268 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:54.005386  4591 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.132951  5261 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:13:54.188131  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 171655us
W20260709 12:13:54.178048  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:54.194155  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 167598us
I20260709 12:13:54.024420  4911 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.223863  3156 leader_election.cc:400] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3.
I20260709 12:13:54.224294  3156 leader_election.cc:403] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:54.133596  4958 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:54.222087  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:54.123273  3925 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:54.204036  5293 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:54.135510  4983 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.244385  4591 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:54.248613  3156 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:54.236369  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:54.192776  5166 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:54.234661  4958 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.258875  4591 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.261610  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:54.262334  3931 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:54.262651  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:54.263998  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:54.264716  3333 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:54.249519  5296 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:54.259073  3305 leader_election.cc:400] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5.
W20260709 12:13:54.266611  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 66910us
I20260709 12:13:54.274176  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:54.215509  5222 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:13:54.234404  5261 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:54.273617  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.249204  5293 raft_consensus.cc:3055] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:54.250339  5290 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3.
I20260709 12:13:54.283210  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:54.284076  3268 raft_consensus.cc:2393] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 2: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:54.284878  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:54.289602  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:54.292464  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:54.281746  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:54.295930  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:54.296682  3262 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:54.298146  5098 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.299461  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:54.300587  3261 raft_consensus.cc:2410] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:54.300930  4983 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:54.287151  3184 raft_consensus.cc:1240] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:54.311630  3268 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:54.283263  4874 tablet_bootstrap.cc:492] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:13:54.316090  3189 raft_consensus.cc:2393] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:54.277741  5105 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:54.317771  3306 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:54.321161  3895 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:54.280794  4998 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.282948  5293 raft_consensus.cc:740] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:54.268755  5230 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.309913  5244 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.342232  3926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:13:54.357384  3926 raft_consensus.cc:606] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:54.361246  5210 raft_consensus.cc:3055] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:54.361832  5210 raft_consensus.cc:740] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:54.362370  5298 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:54.362984  5298 raft_consensus.cc:697] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:54.364135  5298 consensus_queue.cc:237] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:54.366039  5288 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:54.366613  5288 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:54.368505  5225 consensus_meta.cc:287] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.003s
I20260709 12:13:54.368947  5225 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:54.369606  5288 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:54.371047  5225 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:54.371551  5306 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:54.279014  5296 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.342562  5290 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:54.383400  4874 ts_tablet_manager.cc:1403] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 1.406s	user 0.033s	sys 0.032s
I20260709 12:13:54.354488  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:13:54.393617  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 78954.4us
W20260709 12:13:54.385836  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 97493.4us
I20260709 12:13:54.374104  5241 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:54.398211  5241 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:54.401036  5241 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:54.402319  3928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "7ac63b674f204bc4805ab989f8c965d3"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:13:54.403059  3928 raft_consensus.cc:606] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Received request to transfer leadership to TS 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:54.403822  3928 raft_consensus.cc:614] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:54.407483  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.385576  5290 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:54.392022  5263 consensus_meta.cc:287] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.718s	user 0.010s	sys 0.003s
I20260709 12:13:54.362880  5210 consensus_queue.cc:260] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:54.415977  5210 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.419694  3334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:46076
I20260709 12:13:54.420501  3334 raft_consensus.cc:606] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:54.422376  5296 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:54.422835  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:13:54.424279  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 73684.8us
I20260709 12:13:54.424921  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:54.425992  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:54.426580  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:54.429205  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:54.413816  5290 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.407060  4958 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:54.438719  4874 raft_consensus.cc:359] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:54.411657  3305 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:13:54.451368  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.454932  3931 raft_consensus.cc:1240] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:54.455755  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 46024.2us
I20260709 12:13:54.458962  3305 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:54.457702  5106 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:54.462858  5230 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:54.445173  4874 raft_consensus.cc:740] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:13:54.470186  4958 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:54.470302  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:54.490721  5312 consensus_queue.cc:1059] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:13:54.473687  5231 consensus_meta.cc:287] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.001s
I20260709 12:13:54.492463  5312 raft_consensus.cc:3055] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:54.492859  5312 raft_consensus.cc:740] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:54.410472  5293 consensus_queue.cc:260] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.475742  5261 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:54.480407  5270 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:54.481562  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:54.481820  3184 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:54.483978  3305 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:54.492164  5231 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.479635  4998 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:54.502893  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:54.506474  3263 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:54.505154  3265 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:13:54.512658  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 174953us
I20260709 12:13:54.496019  5082 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:54.519011  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:54.497334  5225 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:54.519816  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:54.521076  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:54.510890  3261 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.527554  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:54.532143  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 48285.2us
I20260709 12:13:54.533214  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:54.519126  5235 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:54.504534  5270 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.525004  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:54.513494  4998 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.551571  4998 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:54.493703  5312 consensus_queue.cc:260] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:54.560839  5303 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:13:54.539896  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:54.519548  4874 consensus_queue.cc:260] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:54.568961  5270 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:54.570093  4874 ts_tablet_manager.cc:1434] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.175s	user 0.010s	sys 0.000s
I20260709 12:13:54.570703  3261 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:13:54.570966  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:54.572312  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:54.572553  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:54.572984  3263 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:13:54.573613  5221 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.573760  3305 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:54.574853  5231 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:54.574956  3305 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:54.530412  5225 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:54.577085  5225 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:54.577086  5242 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:54.577744  5242 raft_consensus.cc:697] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:54.578576  5242 consensus_queue.cc:237] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.581454  5306 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:54.583973  4911 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:54.584513  5271 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:54.584589  4911 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.585182  5271 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:54.586890  3266 raft_consensus.cc:1240] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:54.597170  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:54.597533  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:54.597869  3192 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:54.598116  3186 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:54.599622  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:54.588129  5235 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.605178  5298 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:54.605358  4840 raft_consensus.cc:3055] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:54.605738  5298 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.605782  4840 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:54.606309  5298 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:54.607882  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:54.609644  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:54.613070  3185 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:54.616000  3156 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:54.586822  4911 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:54.617858  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:54.620251  3192 raft_consensus.cc:2393] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:54.619149  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:54.606791  4840 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:54.623103  4591 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.612010  5271 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:54.625276  5317 log.cc:927] Time spent T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.077s	user 0.002s	sys 0.002s
I20260709 12:13:54.625738  3336 raft_consensus.cc:1240] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:54.627880  3156 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:13:54.628077  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 103324us
I20260709 12:13:54.625769  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:54.598892  5231 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:54.661633  4591 consensus_queue.cc:1059] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:54.663725  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:54.664069  3895 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:54.661752  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:54.669127  3189 raft_consensus.cc:1240] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:54.669278  3232 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:54.674433  3895 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:54.675923  3263 raft_consensus.cc:1240] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:54.676911  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:54.677325  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:54.678135  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:54.676937  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:54.679010  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:54.673204  3156 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:54.627141  3925 raft_consensus.cc:1240] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:54.682577  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:54.683658  3305 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:54.626816  5302 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:54.689713  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:54.683560  4591 raft_consensus.cc:3055] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:54.691780  4591 raft_consensus.cc:740] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:54.691617  3156 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:54.659808  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:54.664738  5301 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:54.697809  3265 raft_consensus.cc:1240] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:54.619136  5298 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.701396  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:54.683117  5210 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:54.688586  5302 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:54.693361  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:54.705551  3231 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:54.683899  5271 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.701968  3305 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:54.707046  3203 tablet_copy_service.cc:342] P 7ac63b674f204bc4805ab989f8c965d3: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-9ec2274893aa4cc087f9d4af8119b1ea received from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:54.731688  3203 tablet_copy_service.cc:434] P 7ac63b674f204bc4805ab989f8c965d3: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-9ec2274893aa4cc087f9d4af8119b1ea on tablet 9ec2274893aa4cc087f9d4af8119b1ea with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:54.707480  5310 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.672062  4995 consensus_queue.cc:1059] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:13:54.689486  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:54.710625  5298 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:54.690361  5305 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:54.744940  4911 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:54.752290  5305 raft_consensus.cc:3055] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:54.752583  4911 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:54.665344  5231 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.700311  5225 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:54.712575  5295 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:54.684057  5221 raft_consensus.cc:2804] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:54.703050  3232 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:54.724771  3231 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:54.689935  5263 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 12:13:54.755762  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 52786.3us
I20260709 12:13:54.752828  5305 raft_consensus.cc:740] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:54.660737  5290 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:54.760680  5231 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:54.754541  4911 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.761530  5270 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.761878  5221 raft_consensus.cc:697] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:54.757922  5225 raft_consensus.cc:697] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:54.762957  5221 consensus_queue.cc:237] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:54.758469  5295 raft_consensus.cc:697] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:54.763757  5225 consensus_queue.cc:237] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:54.764887  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 254410us
I20260709 12:13:54.764786  5295 consensus_queue.cc:237] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.765959  3157 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:54.770807  5270 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:54.771322  5270 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:54.771721  5270 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.772677  5263 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.727775  5302 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.774468  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:54.775741  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:54.776348  3187 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:54.777549  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 52905.1us
I20260709 12:13:54.748100  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:54.781337  3193 raft_consensus.cc:2368] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4.
I20260709 12:13:54.740813  5242 raft_consensus.cc:2749] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:54.744987  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:54.739600  5311 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:54.760687  5290 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:54.781160  3231 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:54.715876  5103 consensus_queue.cc:1059] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:13:54.751547  3188 raft_consensus.cc:1240] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:54.787159  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:54.790974  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:54.793169  5298 consensus_queue.cc:1059] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:54.793535  5082 raft_consensus.cc:3055] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:54.793936  5082 raft_consensus.cc:740] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:54.794047  5298 raft_consensus.cc:3055] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:54.794426  5298 raft_consensus.cc:740] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:54.795353  5082 consensus_queue.cc:260] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.796643  5082 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.798657  5302 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.800434  5248 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.800921  5248 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.802175  5235 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:54.803083  5248 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:54.803876  5305 consensus_queue.cc:260] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:54.804715  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.805457  5305 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.813544  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:54.805751  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:54.806634  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:54.807631  3305 leader_election.cc:400] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4.
I20260709 12:13:54.792896  3231 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:54.819995  3231 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:54.810616  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 65687.2us
I20260709 12:13:54.829085  3192 raft_consensus.cc:1240] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:54.820969  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:54.749243  5310 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.834297  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:54.838809  3157 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:54.813187  4958 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.821606  5166 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.850668  3336 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:13:54.854260  3336 pending_rounds.cc:85] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 3
I20260709 12:13:54.854635  3336 pending_rounds.cc:107] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:13:54.854954  3336 raft_consensus.cc:2889] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:54.833370  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:54.846509  4998 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:54.908208  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 50271.5us
I20260709 12:13:54.841179  5080 consensus_queue.cc:1059] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:13:54.906466  3928 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.910732  5166 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.857103  5291 consensus_queue.cc:1059] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:13:54.923621  3193 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:54.841995  5298 consensus_queue.cc:260] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:54.917160  5311 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:54.969203  3928 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:54.957720  3187 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:13:54.980594  3265 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:54.988909  5310 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:54.991634  5298 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.996918  5287 raft_consensus.cc:993] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:54.980536  5311 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:13:55.005120  5324 log.cc:927] Time spent T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 12:13:55.007072  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 72094.5us
I20260709 12:13:55.027966  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:55.028862  3185 raft_consensus.cc:1240] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:55.033926  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 214021us
W20260709 12:13:55.053227  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.056969  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:55.059177  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:55.031313  5081 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 12:13:55.085541  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 57677.5us
I20260709 12:13:55.089540  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:55.031505  3927 raft_consensus.cc:1217] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 12:13:55.092022  3266 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.094703  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:55.060896  4983 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.050884  5270 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:55.160466  3268 raft_consensus.cc:1240] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:13:55.110975  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:55.253077  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.059357  5272 raft_consensus.cc:1081] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:13:55.085204  5231 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.123303  3266 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:13:55.060413  5242 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:13:55.110929  5325 log.cc:927] Time spent T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:13:55.108644  4958 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.203s
I20260709 12:13:55.315466  5270 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:55.095028  5301 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:55.085407  4911 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:55.156356  5328 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:13:55.328413  5331 log.cc:927] Time spent T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:13:55.166793  5225 raft_consensus.cc:3055] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:55.307879  5166 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.108378  5316 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.260s
I20260709 12:13:55.293556  5336 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:13:55.341972  5305 consensus_meta.cc:287] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260709 12:13:55.343441  5311 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:55.307649  4983 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:55.166129  5271 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:55.280790  5312 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.193300  5261 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:55.159011  5306 raft_consensus.cc:993] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: : Instructing follower 7ac63b674f204bc4805ab989f8c965d3 to start an election
I20260709 12:13:55.089777  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:55.358008  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 264164us
W20260709 12:13:55.323261  5082 consensus_meta.cc:287] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.005s
I20260709 12:13:55.333169  4840 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:55.393240  3231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.723s (SENT) [suppressed 33 similar messages]
I20260709 12:13:55.446630  3261 raft_consensus.cc:1240] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:55.450515  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:13:55.458417  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 65225.9us
I20260709 12:13:55.372786  5225 raft_consensus.cc:740] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:55.353565  5231 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.481644  5231 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:55.449164  3334 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:55.482172  5293 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.470258  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 643) took 1215 ms. Trace:
W20260709 12:13:55.469915  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 155820us
I20260709 12:13:55.357002  5242 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:55.462929  5336 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.475723  4998 raft_consensus.cc:3055] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:55.463320  5206 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:55.445395  5166 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.445837  5301 raft_consensus.cc:697] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:55.466452  5272 raft_consensus.cc:1081] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Signalling peer 7ac63b674f204bc4805ab989f8c965d3 to start an election
I20260709 12:13:55.469178  5305 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:55.486302  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 414904us
I20260709 12:13:55.497954  3265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:40120
I20260709 12:13:55.502434  3265 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:55.502971  3265 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.497043  5290 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.529253  5290 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:55.530750  5242 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:55.488449  4998 raft_consensus.cc:740] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:55.532608  4911 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:55.533613  5301 consensus_queue.cc:237] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.534615  5336 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:55.534782  5166 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:55.497243  5206 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.536291  4983 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:55.537875  5206 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:55.483129  3924 rpcz_store.cc:276] 0709 12:13:54.251913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.260318 (+  8405us) service_pool.cc:224] Handling call
0709 12:13:54.281492 (+ 21174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.387300 (+105808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:54.390799 (+  3499us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:54.396450 (+  5651us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:54.406779 (+ 10329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.465104 (+1058325us) spinlock_profiling.cc:243] Waited 91.7 ms on lock 0x7b54006243d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:55.467438 (+  2334us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.467584 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210982784}
I20260709 12:13:55.463670  5261 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:55.541002  5242 consensus_queue.cc:1059] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:55.542054  5242 raft_consensus.cc:3055] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:55.542356  5242 raft_consensus.cc:740] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:55.542479  5261 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:55.528613  5305 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.545591  5305 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:55.498697  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:55.545624  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:55.548192  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 47328.2us
I20260709 12:13:55.545325  5242 consensus_queue.cc:260] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.550447  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:55.551718  5290 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:55.553359  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 53022.7us
I20260709 12:13:55.554647  3190 raft_consensus.cc:2410] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:55.557228  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:55.564994  3264 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:55.557858  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:55.565891  3337 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
W20260709 12:13:55.555487  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 56873.7us
I20260709 12:13:55.570480  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:55.572651  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:55.573956  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:55.574246  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:55.574761  3262 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:13:55.571187  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:55.572672  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:55.572746  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:55.575747  3191 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:55.566581  3265 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.581913  3263 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:55.569902  3895 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:13:55.657769  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 87928.3us
W20260709 12:13:55.663599  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.663679  5222 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:55.714315  5222 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:55.664327  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:55.715179  5296 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:55.569005  5336 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:55.555908  5298 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:55.655972  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:55.656925  5295 consensus_queue.cc:1059] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:13:55.684233  3191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
 from {username='slave'} at 127.0.0.1:47276
I20260709 12:13:55.719105  3191 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:55.719563  3191 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.687886  5166 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.690317  5311 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:55.696233  4911 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.723848  5340 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:55.723660  4911 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.680334  4840 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:55.725241  4840 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:55.726596  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:55.706148  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:55.585003  4591 consensus_queue.cc:260] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:55.710114  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:55.738011  3191 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.788704  3924 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:55.791082  4911 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:55.792887  4840 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:55.712491  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 131078us
I20260709 12:13:55.714841  5222 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.715737  5296 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:55.720711  3265 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:55.795629  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:55.724406  5340 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.727669  3268 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:55.792979  4911 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:55.722633  5166 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:55.809258  5261 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.817039  4591 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:55.824831  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 96445.8us
I20260709 12:13:55.825747  3191 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:55.711941  3231 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:55.828042  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 116187us
I20260709 12:13:55.828846  3231 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:55.828115  3156 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:55.830492  5336 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:55.830941  5336 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:55.831349  5336 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.831611  5310 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:55.833715  3232 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:55.836066  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.772177  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:55.841113  3264 raft_consensus.cc:1240] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:55.796734  5298 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:55.832744  3156 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:55.844702  3188 raft_consensus.cc:1240] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.842727  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:55.848941  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:55.851523  3265 raft_consensus.cc:1240] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:55.832273  5317 log.cc:927] Time spent T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:13:55.832049  5310 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.829134  4840 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:55.862412  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:55.865877  3265 raft_consensus.cc:1275] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:55.855388  4983 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:55.875771  3264 raft_consensus.cc:2393] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:55.852686  3925 raft_consensus.cc:3055] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:55.827049  4911 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.860658  5270 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.826781  5261 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:55.863785  5310 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.882498  5302 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:55.883594  5346 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.876049  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:55.877734  4840 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:55.880870  4983 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.883351  5309 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:55.903371  3189 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:55.880728  3925 raft_consensus.cc:740] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:55.909392  4840 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.909895  5166 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:55.910529  3925 consensus_queue.cc:260] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.911571  4840 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:55.913676  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 61743.3us
I20260709 12:13:55.917879  5106 consensus_queue.cc:1059] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:55.919922  5106 consensus_queue.cc:1059] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:55.920722  5106 raft_consensus.cc:3055] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:13:55.906783  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 73162.1us
I20260709 12:13:55.901055  3928 raft_consensus.cc:1240] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.921154  5345 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:55.923400  5105 raft_consensus.cc:3055] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:55.923087  5350 consensus_queue.cc:1059] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:13:55.923753  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:55.921070  5106 raft_consensus.cc:740] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:55.907171  4983 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.928148  5105 raft_consensus.cc:740] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:55.943768  5350 raft_consensus.cc:3055] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:55.945470  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:55.947973  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:55.952589  3340 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.953912  5350 raft_consensus.cc:740] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:55.959587  5350 consensus_queue.cc:260] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:55.961638  5350 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.964113  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:55.903008  5346 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.964809  3931 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:55.930414  5298 raft_consensus.cc:697] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:55.982681  3232 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:55.917665  5222 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:55.951304  5296 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:55.950930  4840 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:56.042572  3263 raft_consensus.cc:2393] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:13:56.043414  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 60813.8us
I20260709 12:13:55.950474  3187 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
W20260709 12:13:55.986117  5353 log.cc:927] Time spent T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
W20260709 12:13:56.052250  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 106165us
I20260709 12:13:55.984112  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:56.057335  5261 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:56.059121  5354 log.cc:927] Time spent T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:13:56.057403  3927 raft_consensus.cc:1240] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:56.063660  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:56.062885  3231 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:56.064392  3262 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:56.047362  5296 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:55.938931  5345 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.079380  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:56.079998  3929 raft_consensus.cc:3055] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:56.088770  5222 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.054821  5105 consensus_queue.cc:260] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.093458  5105 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.059227  5210 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.044884  5106 consensus_queue.cc:260] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.095837  5210 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.096328  5106 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.097929  5210 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.080302  3929 raft_consensus.cc:740] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:56.046731  4840 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.099074  5298 consensus_queue.cc:237] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.105815  4840 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:56.105943  5346 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:56.078028  5296 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.106729  5296 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.106786  5358 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.107311  5358 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.107674  5358 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.109521  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1353) took 1430 ms. Trace:
I20260709 12:13:56.109901  3261 rpcz_store.cc:276] 0709 12:13:54.687821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.768113 (+ 80292us) service_pool.cc:224] Handling call
0709 12:13:54.768411 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:55.447109 (+678698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.109287 (+662178us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54003a98d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:56.109462 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559286144}
I20260709 12:13:56.118019  3340 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:56.121121  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:56.061386  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:56.125749  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:56.130030  5296 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.099043  3929 consensus_queue.cc:260] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.135492  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:56.155850  3930 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:56.124487  5363 consensus_queue.cc:1048] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:13:56.137066  5302 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.137686  3187 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:56.134402  5361 consensus_queue.cc:1059] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:13:56.138299  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:56.180086  3926 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:56.180414  5361 raft_consensus.cc:3055] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:56.139050  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.180838  5361 raft_consensus.cc:740] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:56.181150  3337 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:13:56.139559  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.182232  3333 raft_consensus.cc:2393] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:56.139767  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.140226  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.141021  5230 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:56.183748  3338 raft_consensus.cc:2393] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:56.183662  5230 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.181713  5296 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:56.180430  5336 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.185186  5310 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.185745  5230 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.141935  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:56.186764  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 44960.2us
I20260709 12:13:56.187124  5336 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:56.188100  3157 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:56.189486  5173 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.189613  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:56.150463  5345 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.152339  5270 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:56.120669  5271 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.154464  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:56.176304  5302 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.140550  3232 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:56.150477  3264 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:56.157258  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.164661  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:56.191344  4911 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:56.192137  5271 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.213101  5271 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:56.192992  3895 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:56.151170  4983 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.181712  5361 consensus_queue.cc:260] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.175737  5241 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:56.209429  3336 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:56.157320  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.195739  3261 raft_consensus.cc:1275] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:56.195012  3184 raft_consensus.cc:1240] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
W20260709 12:13:56.209365  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:56.208402  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 67956.3us
I20260709 12:13:56.238220  3232 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:56.227064  3340 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:56.194276  3157 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:56.239491  3232 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:56.240803  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 46586us
I20260709 12:13:56.248435  3157 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:56.193146  5294 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:56.223547  5271 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.256276  5271 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.258283  5271 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:56.193274  5173 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:56.209120  5270 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:56.225385  5288 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.192478  3924 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:56.261161  4983 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.262039  5082 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.255752  5296 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:56.263056  5296 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.250005  5106 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.264102  5106 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.265173  5296 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.266891  5106 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:56.166153  5309 consensus_queue.cc:1059] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:13:56.199265  5302 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:56.279253  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 67629.7us
I20260709 12:13:56.286147  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.266939  3232 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:56.267767  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.285677  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:56.187227  5310 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.262750  5082 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.224680  5141 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
W20260709 12:13:56.280948  3190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40510 (request call id 1724) took 2025 ms (client timeout 1723 ms). Trace:
W20260709 12:13:56.337677  3190 rpcz_store.cc:269] 0709 12:13:54.255714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.255885 (+   171us) service_pool.cc:224] Handling call
0709 12:13:54.570800 (+314915us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800002a98. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:13:56.280675 (+1709875us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54001513d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:56.280860 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2203525760}
W20260709 12:13:56.333858  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 66999.8us
I20260709 12:13:56.335511  3337 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
W20260709 12:13:56.274307  5348 log.cc:927] Time spent T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.734s	user 0.012s	sys 0.000s
I20260709 12:13:56.251180  5311 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:56.267256  4911 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:56.253698  5336 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:56.340454  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:56.279150  5350 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.278460  5345 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:56.363206  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:56.253290  5361 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.281451  5103 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.328801  5288 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.313278  5105 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.313755  5272 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.355211  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:56.364114  3333 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.313967  5271 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:56.267619  5270 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:56.364711  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.365439  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.397037  3340 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:13:56.366214  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:56.366454  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:56.367401  3232 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:56.367939  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:56.336583  5296 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:56.411083  5296 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.411520  5296 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:56.225989  5241 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.253895  5341 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 12:13:56.416877  5241 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.417064  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:56.284265  5358 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.375510  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:56.369010  4911 raft_consensus.cc:697] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:56.368733  5346 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.360836  5345 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.400840  3232 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:56.401448  5336 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.403611  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:56.394881  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.399641  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:56.406132  5082 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:56.396418  3338 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
W20260709 12:13:56.437734  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 169910us
I20260709 12:13:56.394984  5059 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.369530  5350 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.393939  5272 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.424005  4911 consensus_queue.cc:237] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.391151  5221 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.430508  3333 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:56.431196  3895 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:56.432124  3265 raft_consensus.cc:1240] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:56.431200  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.434808  5359 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:56.438802  3157 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:56.440649  3305 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:56.376994  5103 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.427150  5346 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.422004  5270 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.375933  5288 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.433933  5336 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:56.459733  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:56.444665  5301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.014s	sys 0.025s
I20260709 12:13:56.463114  4591 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:56.474531  3190 raft_consensus.cc:1240] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:56.417960  5271 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.463714  3232 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:56.465276  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:56.462177  5222 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.464049  5359 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:56.472186  3930 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:56.450668  3923 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:13:56.434315  5345 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:56.493105  5367 log.cc:927] Time spent T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:13:56.493551  5225 consensus_queue.cc:260] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.494694  5225 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.479189  3265 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:13:56.467228  5082 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.498222  3929 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.468369  5173 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:56.501201  5342 log.cc:927] Time spent T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.969s	user 0.000s	sys 0.008s
I20260709 12:13:56.501516  5350 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:56.503826  3267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1780) took 1449 ms. Trace:
I20260709 12:13:56.504860  5270 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.504197  3267 rpcz_store.cc:276] 0709 12:13:55.054454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.054590 (+   136us) service_pool.cc:224] Handling call
0709 12:13:55.072686 (+ 18096us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:55.096552 (+ 23866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:55.096600 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:55.097348 (+   748us) log.cc:844] Serialized 52 byte log entry
0709 12:13:55.451780 (+354432us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:55.451843 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.451937 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:56.500472 (+1048535us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:13:56.503508 (+  3036us) raft_consensus.cc:1685] finished
0709 12:13:56.503528 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.503754 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15313,"raft.queue_time_us":17725,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":15254,"spinlock_wait_cycles":33662720,"thread_start_us":353972,"threads_started":1,"wal-append.queue_time_us":431062}
I20260709 12:13:56.505481  5270 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:56.505945  5270 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.506321  5270 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:56.508841  5358 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.513432  5271 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:56.515477  5103 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:56.517529  5363 raft_consensus.cc:3055] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:56.517983  5363 raft_consensus.cc:740] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:56.522187  5082 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.450008  5059 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.556701  5339 consensus_queue.cc:1059] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:56.557333  5059 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.421799  5105 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.557629  5366 raft_consensus.cc:3055] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:56.558046  5366 raft_consensus.cc:740] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:56.558838  5366 consensus_queue.cc:260] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.559284  5105 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:13:56.559705  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.560652  5369 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.560830  3931 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:56.471966  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:56.561146  5369 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.564404  5082 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.463304  5221 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.530000  5359 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.476491  5336 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.469411  5346 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.480873  4840 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.549156  5345 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.551797  5363 consensus_queue.cc:260] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.552335  4998 consensus_queue.cc:260] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.553529  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:56.625201  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 161560us
I20260709 12:13:56.554821  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:56.564764  5360 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.566848  5106 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.567749  3306 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
W20260709 12:13:56.628249  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 60610.8us
I20260709 12:13:56.563337  5369 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:56.568390  5230 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:13:56.474200  5301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.014s	sys 0.025s
I20260709 12:13:56.574994  3932 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 LEARNER]: Advancing to term 3
I20260709 12:13:56.577144  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:56.577361  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:56.578737  5242 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.580938  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:56.583715  5358 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:56.586621  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.506915  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:56.588917  3231 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:56.590474  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:56.590889  3929 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:56.610154  3156 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:56.611236  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.644934  3189 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:56.645572  3336 raft_consensus.cc:2393] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:56.625860  3232 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:56.631284  4591 consensus_queue.cc:1059] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:56.647145  5378 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:56.648187  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.630095  5240 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:56.623744  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:56.613233  5082 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.650189  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:56.654443  3333 raft_consensus.cc:2393] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:56.654975  3268 raft_consensus.cc:1240] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:56.661147  3190 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:56.662189  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:56.664332  4591 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.665431  3338 raft_consensus.cc:1240] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:56.666538  3337 raft_consensus.cc:1275] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:56.666951  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.668578  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.668830  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.670753  3335 raft_consensus.cc:1240] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:56.653576  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.673620  3232 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:56.640861  5296 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.678310  3895 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:56.644683  4998 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.624529  4840 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.680244  4591 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.688771  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:56.689594  3337 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.675285  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:56.681545  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:56.690524  3189 raft_consensus.cc:2393] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:56.682451  5241 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:56.695168  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:56.691313  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:56.698699  3189 raft_consensus.cc:2368] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5.
I20260709 12:13:56.699656  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:56.686939  5059 consensus_queue.cc:1059] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:13:56.696641  5241 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:56.634162  5360 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:56.701107  5241 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:56.648833  3926 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:56.633203  5106 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.652725  5240 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:56.703748  3189 raft_consensus.cc:2393] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:56.706389  3896 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:56.725430  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.726184  5081 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.726635  5081 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.726984  5081 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.727490  5240 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.735811  3932 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:56.635833  5230 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.707147  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:56.707886  3929 raft_consensus.cc:1240] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:56.697587  4911 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:56.712073  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:56.709724  3306 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:56.672745  5309 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.712669  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:56.750188  3263 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:56.750361  3306 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:56.705617  3260 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:56.696655  5365 raft_consensus.cc:3055] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:56.753472  3306 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:56.753957  3189 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:13:56.711776  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:56.653041  5358 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.747234  4591 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:56.759858  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:13:56.747784  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 164398us
I20260709 12:13:56.751917  3190 raft_consensus.cc:2393] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:56.761722  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.762081  3231 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:56.763244  3231 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:56.766031  4840 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.767151  5221 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:56.769874  5358 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:56.770589  5370 log.cc:927] Time spent T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.222s	user 0.000s	sys 0.002s
I20260709 12:13:56.770511  5361 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:56.771849  5373 log.cc:927] Time spent T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 12:13:56.772112  5361 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:56.772516  5361 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.772868  5361 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.752099  5369 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.775285  3335 raft_consensus.cc:2393] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:56.776818  3895 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:56.778203  3337 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:56.742331  5340 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:56.781767  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.783183  3339 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
W20260709 12:13:56.758095  5355 log.cc:927] Time spent T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:13:56.782586  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.819022  3337 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:56.783749  3895 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:56.758090  5103 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.773598  5309 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.794692  5360 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:56.752840  5365 raft_consensus.cc:740] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:56.796479  5303 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.802253  5082 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:56.804533  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.805953  3925 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.807855  5301 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.811453  5346 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.780705  5272 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.814801  5345 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:56.820073  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.817086  5240 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.821344  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.868731  3337 raft_consensus.cc:2410] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:56.825520  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.827956  3193 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:56.834410  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:56.840909  5385 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.820896  3338 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:13:56.826870  4840 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:56.865388  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:56.866472  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:56.875785  3341 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:56.869300  3339 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:56.832715  5358 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:56.838917  5210 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:56.848167  4911 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.878527  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:56.880059  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:56.881455  5270 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.838666  5303 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.878058  5210 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.811093  5359 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:56.767175  5288 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.887094  3266 raft_consensus.cc:2393] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:56.824869  5081 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.858192  5378 raft_consensus.cc:697] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:13:57.015003  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 251815us
I20260709 12:13:56.944048  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:57.020414  3231 leader_election.cc:400] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5.
I20260709 12:13:57.020869  3231 leader_election.cc:403] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:13:57.015131  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:57.022068  3231 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:57.014761  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 231074us
I20260709 12:13:56.940342  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40510 (request call id 1739) took 1368 ms. Trace:
W20260709 12:13:57.018361  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 237207us
W20260709 12:13:57.027052  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.029075  3193 rpcz_store.cc:276] 0709 12:13:55.572091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.572482 (+   391us) service_pool.cc:224] Handling call
0709 12:13:56.940146 (+1367664us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001b12d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:56.940265 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2879995776}
I20260709 12:13:57.029623  3340 raft_consensus.cc:1240] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:57.030593  3232 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:57.031075  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:57.031908  3333 raft_consensus.cc:2393] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:56.872226  5341 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:57.034698  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.885324  4840 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:57.038115  5242 raft_consensus.cc:1064] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:56.999811  5384 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:56.949769  3334 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:56.944410  3924 raft_consensus.cc:2393] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:56.895562  5303 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.926122  5288 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:56.937220  3925 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:57.017591  5103 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.049161  3261 raft_consensus.cc:1275] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:57.050146  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.071869  3260 raft_consensus.cc:2368] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6.
I20260709 12:13:57.034145  5271 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.849114  5301 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.053970  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:57.057721  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.090776  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:56.947750  4995 raft_consensus.cc:3055] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:57.060133  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:57.092618  3341 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.000291  5366 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.093505  3265 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
W20260709 12:13:57.059531  5242 raft_consensus.cc:1068] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Unable to promote non-voter 6f0cdd57c5934921829c205d32b2b8a5: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:56.893977  5210 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.061563  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:13:57.068542  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.011132  5106 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:56.939529  5230 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:57.051337  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:57.018249  5241 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.096580  3931 raft_consensus.cc:2368] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4.
I20260709 12:13:56.952551  5240 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:56.940965  5309 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:57.059317  3926 raft_consensus.cc:1240] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:57.076570  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.102113  3264 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:56.878549  4911 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:57.105669  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.078073  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:57.071236  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:57.053090  5385 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:13:57.091336  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.041515  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:57.051555  4840 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.061753  5358 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.092375  5261 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.939495  5336 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:56.942274  5361 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.059621  5263 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.053090  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:57.061997  5296 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:57.102988  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.107594  3261 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.092325  4995 raft_consensus.cc:740] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:57.089627  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55426 (request call id 411) took 1352 ms. Trace:
W20260709 12:13:57.152841  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.077792  5103 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:57.162726  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:56.931691  5365 consensus_queue.cc:260] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.163383  3268 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:57.100045  5288 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.044586  5341 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.105857  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:57.181077  5270 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:57.159958  3925 rpcz_store.cc:276] 0709 12:13:55.723233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.732952 (+  9719us) service_pool.cc:224] Handling call
0709 12:13:56.152583 (+419631us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b180026fac0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee608646 00007f1aee54258e 00007f1aee5c3f9e 00007f1aee5c57de 00007f1aee5d127c 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c
0709 12:13:56.805700 (+653117us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b58000296d0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5290aa 00007f1aee5ab447 00007f1aee5c3fe7 00007f1aee5c57de 00007f1aee5d127c 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c
0709 12:13:57.075363 (+269663us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524971648}
I20260709 12:13:57.183313  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.175720  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.216910  3267 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
W20260709 12:13:57.176612  5391 log.cc:927] Time spent T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:13:57.172497  5363 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.235096  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:57.182744  3340 raft_consensus.cc:1240] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:57.108162  5346 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:57.230501  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 68221.7us
I20260709 12:13:57.233287  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:57.182209  5361 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:57.236265  3186 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:13:57.236289  3157 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:57.243558  3156 leader_election.cc:400] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6.
I20260709 12:13:57.243937  3156 leader_election.cc:403] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:57.246007  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.250665  3157 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:57.253513  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:57.059221  5378 consensus_queue.cc:237] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.150118  5081 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:57.257992  3306 leader_election.cc:400] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4.
I20260709 12:13:57.271245  3306 leader_election.cc:403] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:13:57.260212  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.260910  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:57.238778  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 185862us
I20260709 12:13:57.266461  3261 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:57.253679  5225 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:57.072013  5384 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:57.278654  5302 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:13:57.279518  5384 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:57.280378  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:57.281016  3923 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.282764  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:57.283118  4995 consensus_queue.cc:260] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.284286  4995 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.286258  5302 raft_consensus.cc:2804] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:57.286847  5302 raft_consensus.cc:697] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:57.287871  5302 consensus_queue.cc:237] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.245828  5358 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:57.249238  5311 raft_consensus.cc:2804] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:57.307000  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 49226.2us
I20260709 12:13:57.153720  5263 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:57.153533  5261 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:57.295543  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:57.311069  3261 raft_consensus.cc:2393] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:57.292413  3157 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:57.304015  3231 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:57.214015  5345 consensus_queue.cc:1048] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:13:57.255178  5365 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.231678  5288 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:57.333050  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 227008us
I20260709 12:13:57.328775  3192 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:57.334139  3341 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:13:57.319159  3186 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
W20260709 12:13:57.298970  5391 log.cc:927] Time spent T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:13:57.324606  3923 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:57.300312  5346 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.379698  3895 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:57.325037  5350 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:57.381881  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 73511.6us
I20260709 12:13:57.325380  5261 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:57.326417  5301 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:57.317349  3157 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:57.338909  3261 raft_consensus.cc:1240] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:57.389084  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 71787.7us
I20260709 12:13:57.390157  3157 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:57.391161  3931 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:57.400643  5261 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:57.400592  5342 log.cc:927] Time spent T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:13:57.381562  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:57.336158  5310 consensus_queue.cc:1048] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:13:57.397276  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:57.397646  5290 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6.
I20260709 12:13:57.403997  5301 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:57.442253  3926 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:57.447474  5301 raft_consensus.cc:697] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:57.448577  5301 consensus_queue.cc:237] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:57.450335  5311 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:57.450944  5311 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.436100  5272 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.408525  5341 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:57.389529  5346 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:57.426891  5261 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.446787  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:13:57.464519  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 82025.1us
I20260709 12:13:57.464915  3341 raft_consensus.cc:2393] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:13:57.463805  5393 log.cc:927] Time spent T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:13:57.467497  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 69213.2us
I20260709 12:13:57.445101  5241 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:57.467126  5261 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.462538  4911 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:57.494990  5359 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:57.529896  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:57.496922  5210 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.500142  3342 raft_consensus.cc:2410] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:13:57.506450  5395 log.cc:927] Time spent T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:13:57.534528  5336 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:57.507395  3926 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:13:57.495100  5311 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:57.337767  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:57.509263  4840 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.331728  4998 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:57.298662  5358 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.488479  5303 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.521462  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:57.521428  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:57.548209  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 72078.4us
W20260709 12:13:57.521780  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 203109us
I20260709 12:13:57.522442  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:57.525593  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.525980  5263 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:57.530742  5288 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:13:57.538043  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 234141us
I20260709 12:13:57.536350  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:57.544409  3930 raft_consensus.cc:2393] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:57.476428  5103 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:57.545236  3188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1478) took 1067 ms. Trace:
W20260709 12:13:57.547720  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.560360  3188 rpcz_store.cc:276] 0709 12:13:56.477822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.477955 (+   133us) service_pool.cc:224] Handling call
0709 12:13:56.478254 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:56.480106 (+  1852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.480132 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:56.936010 (+455878us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b2c000c7a48. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aecec6a11 00007f1aeced6372 00007f1aee608a01 00007f1aee5cd43a 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2
0709 12:13:57.001694 (+ 65684us) log.cc:844] Serialized 26 byte log entry
0709 12:13:57.237867 (+236173us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:57.237920 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.238034 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:57.536014 (+297980us) raft_consensus.cc:1685] finished
0709 12:13:57.536033 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.545158 (+  9125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30229,"raft.queue_time_us":1850,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":17988,"spinlock_wait_cycles":11455360,"thread_start_us":189756,"threads_started":1,"wal-append.queue_time_us":311293}
I20260709 12:13:57.559649  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:57.566824  3266 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:13:57.568920  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.569445  5361 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.569845  5361 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.570199  5361 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.570922  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:57.571633  3266 raft_consensus.cc:2368] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4.
I20260709 12:13:57.573047  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.576538  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.577116  3266 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:13:57.582628  3157 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:57.545401  5270 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:57.590031  3156 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:57.592469  3306 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:57.549783  5358 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.546342  4998 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:57.581735  5360 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.544601  5261 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:57.598331  3156 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:57.623790  5206 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:57.624677  5206 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.630491  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:57.614411  5339 consensus_queue.cc:1059] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:13:57.632608  5339 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:57.633057  5339 raft_consensus.cc:697] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:57.633527  5261 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:57.633926  5339 consensus_queue.cc:237] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.635030  5366 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:13:57.642131  5225 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:57.642936  5225 raft_consensus.cc:697] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:57.643699  5385 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:57.646821  3089 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48778 (request call id 280) took 9680 ms. Trace:
I20260709 12:13:57.598937  4998 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:57.656641  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 57403.2us
I20260709 12:13:57.598970  5310 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:57.597038  5230 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:57.587777  5270 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:13:57.659747  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 66504.1us
I20260709 12:13:57.613349  5360 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:57.674122  3305 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:57.665910  5225 consensus_queue.cc:237] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:57.675101  5082 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:57.633554  5309 raft_consensus.cc:3055] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:57.677363  5309 raft_consensus.cc:740] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:57.678218  5309 consensus_queue.cc:260] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:57.679374  5309 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:57.683410  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:57.684057  3342 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:57.685520  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:57.667047  3088 catalog_manager.cc:5697] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 2 to 3, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:57.654402  5206 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:57.613543  5103 consensus_queue.cc:1059] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:13:57.687462  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:57.689450  3340 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:57.687305  3088 catalog_manager.cc:5697] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 2 to 3, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:13:57.664114  5270 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.692793  3339 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:57.693372  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:57.635936  5406 consensus_queue.cc:1059] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:13:57.712201  3342 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:13:57.700960  3305 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:57.720607  5141 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.700021  3157 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:57.683771  5360 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.723623  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:57.698875  3088 catalog_manager.cc:5697] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 3 to 4, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 4 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.647363  3089 rpcz_store.cc:276] 0709 12:13:47.966156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.974739 (+  8583us) service_pool.cc:224] Handling call
0709 12:13:57.646703 (+9671964us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:53.666683 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:53.667183 (+   500us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:53.667216 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:13:53.667231 (+    15us) tablet.cc:662] Decoding operations
0709 12:13:53.723978 (+ 56747us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:53.731130 (+  7152us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:53.750695 (+ 19565us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:13:53.819724 (+ 69029us) tablet.cc:701] Row locks acquired
0709 12:13:53.819762 (+    38us) write_op.cc:260] PREPARE: finished
0709 12:13:54.435392 (+615630us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b2c000c6028. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aecec6a11 00007f1aeced5a0a 00007f1aeced5693 00007f1aeced5631 00007f1aee608902 00007f1aee6086dd 00007f1af2003243 00007f1af2002d58 00007f1af20079f1 00007f1af20079a9 00007f1af2007939
0709 12:13:54.445743 (+ 10351us) write_op.cc:270] Start()
0709 12:13:54.468345 (+ 22602us) write_op.cc:276] Timestamp: P: 1783599233898138 usec, L: 0
0709 12:13:54.484766 (+ 16421us) op_driver.cc:348] REPLICATION: starting
0709 12:13:54.492273 (+  7507us) log.cc:844] Serialized 980 byte log entry
0709 12:13:54.747021 (+254748us) op_driver.cc:464] REPLICATION: finished
0709 12:13:54.917715 (+170694us) write_op.cc:301] APPLY: starting
0709 12:13:54.919373 (+  1658us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:54.938239 (+ 18866us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:54.942745 (+  4506us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:55.038799 (+ 96054us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:55.086296 (+ 47497us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:13:55.093782 (+  7486us) write_op.cc:312] APPLY: finished
0709 12:13:55.112374 (+ 18592us) log.cc:844] Serialized 29 byte log entry
0709 12:13:55.138952 (+ 26578us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:55.139070 (+   118us) write_op.cc:454] Released schema lock
0709 12:13:55.139128 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:55.139584 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:55.139615 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":114856,"apply.run_cpu_time_us":2999,"apply.run_wall_time_us":227589,"num_ops":2,"prepare.queue_time_us":857,"prepare.run_cpu_time_us":40795,"prepare.run_wall_time_us":825860,"replication_time_us":227214,"spinlock_wait_cycles":5062912,"thread_start_us":68814,"threads_started":1}]]}
I20260709 12:13:57.734670  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:57.688764  5346 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:57.806553  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:57.807638  5230 raft_consensus.cc:697] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:57.818997  5230 consensus_queue.cc:237] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:57.806957  3232 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:57.724771  3088 catalog_manager.cc:5697] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index -1 to 5, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 4 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.722759  5361 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:57.808228  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 215886us
I20260709 12:13:57.845656  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:57.814941  3340 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:13:57.823064  3088 catalog_manager.cc:5697] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 2 to 3, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.848989  3265 raft_consensus.cc:2368] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7.
I20260709 12:13:57.850039  3088 catalog_manager.cc:5697] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:57.850548  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.851617  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:57.851979  3088 catalog_manager.cc:5697] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 1 to 3, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:57.854406  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:57.822026  5309 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:57.828055  5406 raft_consensus.cc:3055] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:57.799957  5413 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:57.828926  5401 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:57.829173  5402 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:57.864918  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:57.865679  3340 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.830551  4840 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:57.831226  5385 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.832134  5311 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:57.835237  5410 log.cc:927] Time spent T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:13:57.835826  5210 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:57.837610  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:13:57.838192  5365 consensus_meta.cc:287] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.003s
W20260709 12:13:57.846066  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 146125us
I20260709 12:13:57.886575  3339 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.894222  3339 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:57.896005  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:57.896656  3339 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:57.899065  5311 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:57.899751  5311 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.900060  3896 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:57.901800  5311 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:57.859483  3232 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:13:57.902909  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 46012.4us
I20260709 12:13:57.903002  5296 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:13:57.903630  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:57.903587  5296 raft_consensus.cc:697] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:57.904322  5374 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:57.855180  3265 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.899183  5225 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:13:57.902060  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:57.847460  5412 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:57.812788  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 78250.8us
I20260709 12:13:57.910280  3895 leader_election.cc:400] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7.
I20260709 12:13:57.910641  3895 leader_election.cc:403] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:13:57.908588  3930 raft_consensus.cc:1240] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:57.910176  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:57.857748  5406 raft_consensus.cc:740] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:57.868103  5303 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:57.904778  5296 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.880048  5385 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.904837  5374 raft_consensus.cc:697] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
W20260709 12:13:57.924330  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 326056us
I20260709 12:13:57.869048  5392 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:13:57.909636  5346 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.937017  3339 pending_rounds.cc:85] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 5
I20260709 12:13:57.949388  3339 pending_rounds.cc:107] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:13:57.937117  3231 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:57.908569  5310 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:57.917433  5222 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7.
I20260709 12:13:57.932732  5385 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:57.933893  5271 consensus_meta.cc:287] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.838s	user 0.004s	sys 0.009s
I20260709 12:13:57.949672  3339 raft_consensus.cc:2889] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:57.950747  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:57.963406  3333 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.952099  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:57.954049  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:57.967293  3261 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.955333  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.942031  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:57.952172  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.960961  5359 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:57.944509  5378 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.954619  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:57.979833  3266 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:57.937825  3265 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:13:57.972179  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:57.982527  3895 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:57.954224  3340 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:13:57.937853  5082 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.954325  3231 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:57.987480  3338 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:13:57.874334  5402 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:57.869966  5401 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:57.958477  5336 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:57.984723  5103 raft_consensus.cc:1064] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:13:57.934890  5225 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:57.977982  5271 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5.
I20260709 12:13:57.984609  3261 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:13:58.005913  3333 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:13:57.991834  5346 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:57.989499  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:57.999282  5363 consensus_meta.cc:287] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.755s	user 0.013s	sys 0.000s
I20260709 12:13:57.962390  5310 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:58.003731  5350 consensus_meta.cc:287] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.001s
I20260709 12:13:57.979735  5406 consensus_queue.cc:260] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:58.031150  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 95101.2us
I20260709 12:13:58.004930  4995 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:58.030036  5339 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.043196  3305 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:57.989220  5378 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.045099  3305 leader_election.cc:400] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4.
I20260709 12:13:57.989900  5359 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:58.050323  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:58.046878  5339 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:58.051631  5417 log.cc:927] Time spent T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:13:58.052600  5359 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:58.053004  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:58.049264  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:58.053969  3268 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.055060  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:58.057293  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:58.057941  3186 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:13:58.059995  3260 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:13:58.036720  5413 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.037933  5350 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4.
I20260709 12:13:58.034121  5346 raft_consensus.cc:697] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:58.062696  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:58.040248  5361 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:58.069757  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:58.067447  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:58.073021  3186 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:13:58.048439  5415 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:58.079818  3190 raft_consensus.cc:2393] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:58.049566  4995 raft_consensus.cc:697] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:58.084837  3191 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:58.062403  5311 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:58.089039  3268 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:13:58.090098  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:58.060429  5288 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:58.047899  5363 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 12:13:58.082917  5420 log.cc:927] Time spent T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:13:58.098167  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:58.098421  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:58.101487  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:58.107219  3191 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:13:58.108592  3261 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.116801  3231 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:58.122843  3156 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:58.030233  5374 consensus_queue.cc:237] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.125309  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:58.129667  3231 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:58.130999  3895 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:58.090579  5361 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:58.143453  5427 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.084275  5359 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:13:58.137984  5303 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:58.150293  3261 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:13:58.127817  5392 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:58.155445  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 314055us
I20260709 12:13:58.068466  5413 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.132747  5350 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:58.144110  5242 raft_consensus.cc:3055] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:13:58.137287  5388 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:58.138406  5339 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:58.137418  4840 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:58.132793  3156 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:13:58.158516  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.141362  5336 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.139212  5425 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:58.105465  5311 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.114779  5288 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.172605  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:58.174466  3261 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:58.176497  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:58.164206  5418 log.cc:927] Time spent T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:13:58.162994  5350 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:58.164808  5242 raft_consensus.cc:740] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:58.168227  5388 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.215809  5401 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:58.216928  5378 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:58.217727  5310 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:58.218568  5423 log.cc:927] Time spent T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:13:58.219183  5419 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.219794  5419 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.222122  5419 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:58.170722  4840 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.144172  5427 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.152474  5346 consensus_queue.cc:237] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.199519  5225 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:58.195497  5336 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.223869  5430 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.166503  4995 consensus_queue.cc:237] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:58.236096  5270 consensus_meta.cc:287] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 12:13:58.209283  5350 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.203241  5402 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:13:58.238149  5358 consensus_meta.cc:287] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.626s	user 0.000s	sys 0.008s
W20260709 12:13:58.242753  5360 consensus_meta.cc:287] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.001s
I20260709 12:13:58.178048  5412 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:58.244818  5311 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:58.175411  5339 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.179864  5425 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:58.247200  4998 consensus_meta.cc:287] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.583s	user 0.002s	sys 0.006s
I20260709 12:13:58.229636  3923 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
W20260709 12:13:58.230985  5426 log.cc:927] Time spent T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:13:58.345918  5340 consensus_queue.cc:1059] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:13:58.346937  5339 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.352571  4998 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.354736  4998 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:58.346349  5425 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.354740  5339 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:58.356123  5427 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:58.301770  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:58.360846  3190 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.243301  5385 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.365284  5359 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:58.285233  4840 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:58.366026  5359 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.368472  3263 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:58.284842  3191 raft_consensus.cc:2393] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:58.344712  5360 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.372228  5360 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:58.383831  5288 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:58.385560  3157 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:58.386683  5311 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:58.387099  5311 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.387404  5359 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:58.387681  5311 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.388100  5385 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:58.389556  5336 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:58.390616  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 1818) took 1300 ms. Trace:
I20260709 12:13:58.394752  5413 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:58.397083  5397 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.397599  5397 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.398020  3157 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:58.400102  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:58.402696  3232 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:58.405648  5103 consensus_queue.cc:237] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.387037  3334 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:13:58.390998  3260 rpcz_store.cc:276] 0709 12:13:57.090408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.090523 (+   115us) service_pool.cc:224] Handling call
0709 12:13:58.390457 (+1299934us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b54003aa2d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:58.390559 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2145598720}
I20260709 12:13:58.345630  3305 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:58.411356  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 65865.9us
I20260709 12:13:58.226188  5388 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.413290  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:58.414000  3340 raft_consensus.cc:2393] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:58.414423  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:58.415066  3268 raft_consensus.cc:1275] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:58.415390  3261 raft_consensus.cc:2368] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5.
I20260709 12:13:58.416306  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.417320  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:58.417511  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:58.418030  3338 raft_consensus.cc:2368] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4.
I20260709 12:13:58.419914  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.420907  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.421307  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.421913  3338 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:13:58.422235  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.422523  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:58.422827  3342 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:58.423079  3335 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.425155  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.425743  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:58.425935  3337 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 1.
I20260709 12:13:58.426487  3929 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:58.431941  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:58.432114  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:58.435142  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.438051  3190 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:13:58.442130  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.442809  3338 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
W20260709 12:13:58.442868  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.445989  3340 raft_consensus.cc:1240] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:58.446981  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:58.447754  3264 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:58.448767  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:58.449889  3340 raft_consensus.cc:2368] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5.
I20260709 12:13:58.450990  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.451857  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.453030  3340 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:13:58.453188  3338 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:13:58.383327  5350 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.461364  5350 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:58.463315  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.467818  3232 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:58.471814  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:58.472721  3266 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:58.473891  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:58.474037  3265 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:58.475765  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:58.476524  3266 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:13:58.477200  3265 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:58.479686  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:58.480530  3264 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:58.481627  5385 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.417881  5230 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:58.487761  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.484858  3232 leader_election.cc:400] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4.
I20260709 12:13:58.488410  3333 raft_consensus.cc:1240] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:58.488699  3232 leader_election.cc:403] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:13:58.485549  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:58.428570  5428 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:58.409785  5412 raft_consensus.cc:697] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:13:58.501478  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:58.503000  3335 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:13:58.505296  3232 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:58.506016  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 78692.2us
I20260709 12:13:58.433849  5336 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:58.505409  3306 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:58.512472  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 54676.1us
I20260709 12:13:58.435779  5310 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:58.299940  5270 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.309559  5358 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.301277  5430 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.487875  5230 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.520437  3896 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:58.503947  5428 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.507899  5385 raft_consensus.cc:2749] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4.
I20260709 12:13:58.514549  5397 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:58.546527  3262 raft_consensus.cc:2393] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:58.546239  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.527537  3232 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:58.514118  5427 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.525604  5261 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:58.548197  3335 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:58.521489  5336 raft_consensus.cc:697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:58.531265  5230 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:58.555732  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.540934  5402 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:58.540982  5428 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.556211  5288 raft_consensus.cc:2804] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:58.552091  5386 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:58.557643  3232 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:58.564368  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:58.570531  3232 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:58.549072  5261 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.506956  5425 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.526247  5310 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.554461  5210 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.573288  3232 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:58.566797  5288 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:58.577688  3232 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:58.568958  5386 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:58.556778  5345 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:58.566264  5404 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:58.552168  5427 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.569527  3927 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:58.572698  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:58.582369  5288 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:58.574405  5359 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:58.574158  5385 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:58.599893  5401 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:58.591599  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:58.589944  5296 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:58.590433  5210 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.590704  5386 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.591269  5402 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:58.607776  5299 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:58.639626  5402 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.640107  5402 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.580987  5442 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:58.633783  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:58.597273  5404 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.648022  3333 raft_consensus.cc:2393] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:58.636085  3924 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:13:58.612316  5310 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:58.594471  5345 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.649672  5404 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:58.619292  5378 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:58.607797  5359 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:58.640540  5296 raft_consensus.cc:697] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:13:58.619167  5311 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.564739  5412 consensus_queue.cc:237] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.653712  5261 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:58.639812  5299 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.661054  5346 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:13:58.654680  5359 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.668442  5345 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:58.654341  5378 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.623122  5401 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.674124  5430 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:58.674335  5210 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:58.619474  5336 consensus_queue.cc:237] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.682514  4840 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.666051  5271 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:13:58.653275  5442 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.800444  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:58.808280  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:58.803267  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:58.801366  3333 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:13:58.688200  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:58.669150  5340 raft_consensus.cc:3055] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:58.807974  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:13:58.784175  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.819638  3193 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:58.823561  3186 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:13:58.818423  3192 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:58.822573  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:58.824126  3261 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:58.673158  5270 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:58.836566  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:58.680523  5358 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:58.791257  5406 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:58.847225  3267 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:13:58.683667  5427 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:58.848994  3333 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:13:58.786067  5311 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:58.688200  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:58.816253  5392 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:58.835397  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:58.819648  5385 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:13:58.821434  5340 raft_consensus.cc:740] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:58.860123  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:58.768453  5288 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.726914  5388 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:58.736539  5296 consensus_queue.cc:237] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:58.862257  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:58.878161  5359 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.151387  3264 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:13:58.909873  3268 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:58.995781  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:59.168788  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.924289  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:59.202385  3261 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
W20260709 12:13:59.204879  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.943521  3333 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:59.213480  3263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 1824) took 1261 ms. Trace:
W20260709 12:13:58.888085  5454 log.cc:927] Time spent T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:13:58.852303  5270 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:59.206753  5385 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.217218  5270 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.211897  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:13:59.219197  5270 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.223050  3930 raft_consensus.cc:2393] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:59.206921  5346 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:59.227167  5346 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.227730  3191 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:59.229771  5346 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.049340  5311 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.236407  5311 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.238816  5311 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.239778  5442 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:13:59.240975  5230 consensus_meta.cc:287] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.673s	user 0.012s	sys 0.000s
I20260709 12:13:59.241467  5230 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.232522  5401 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.230736  5340 consensus_queue.cc:260] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.214146  3263 rpcz_store.cc:276] 0709 12:13:57.952151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.952257 (+   106us) service_pool.cc:224] Handling call
0709 12:13:59.213213 (+1260956us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5400174dd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:59.213399 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913758464}
I20260709 12:13:58.987080  5443 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.152259  5359 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:59.208281  3926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.005s	sys 0.007s
I20260709 12:13:59.250078  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:59.250485  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:13:58.923002  5299 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.219141  5385 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:13:59.219738  5455 log.cc:927] Time spent T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.421s	user 0.001s	sys 0.001s
I20260709 12:13:59.262619  3925 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
W20260709 12:13:59.253573  3926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.005s	sys 0.007s
W20260709 12:13:59.282763  5386 consensus_meta.cc:287] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
I20260709 12:13:59.209231  5392 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.255595  5340 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.260270  5427 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.294625  5386 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.259934  5461 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:59.300683  3260 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:13:58.988137  5242 consensus_queue.cc:260] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.301856  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40120 (request call id 392) took 1451 ms. Trace:
I20260709 12:13:59.256007  5443 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.303486  5378 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.306164  5388 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:59.300334  5427 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.300625  3190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40494 (request call id 1502) took 1204 ms. Trace:
W20260709 12:13:59.298784  5263 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.018s	sys 0.069s
I20260709 12:13:59.302937  3262 rpcz_store.cc:276] 0709 12:13:57.850947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.851316 (+   369us) service_pool.cc:224] Handling call
0709 12:13:59.301561 (+1450245us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400450954. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:59.301793 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1595985152}
I20260709 12:13:59.308051  3190 rpcz_store.cc:276] 0709 12:13:58.096094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.098138 (+  2044us) service_pool.cc:224] Handling call
0709 12:13:59.300448 (+1202310us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54000bd454. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:59.300566 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583129472}
W20260709 12:13:59.308141  5428 consensus_meta.cc:287] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.733s	user 0.012s	sys 0.000s
I20260709 12:13:59.305387  5230 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.308439  5242 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:13:59.308652  5263 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.018s	sys 0.069s
I20260709 12:13:59.322360  5386 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.320453  5428 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.326593  5443 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:59.335212  5288 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.358078  3339 raft_consensus.cc:2393] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:13:59.364466  5428 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:13:59.357236  5402 consensus_meta.cc:287] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.698s	user 0.013s	sys 0.000s
I20260709 12:13:59.379662  5392 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.382423  5230 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.383993  5230 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.386256  5230 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:59.380852  5402 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.388890  5402 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.390442  5425 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:59.392511  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:59.393285  3929 raft_consensus.cc:2393] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:59.394888  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:59.396775  4840 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.396813  5427 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:59.409688  3262 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:59.425209  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:59.425858  3260 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.431850  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:59.432431  3342 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.431864  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:59.433487  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:59.434257  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:59.436420  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:59.435896  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:59.442427  3260 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:13:59.445017  3263 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:13:59.448623  3188 raft_consensus.cc:2393] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:59.447402  3189 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:59.456028  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:59.432286  5425 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:59.467753  3925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55438 (request call id 675) took 1557 ms (client timeout 2063 ms). Trace:
I20260709 12:13:59.467772  5425 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.470376  5425 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.472078  3193 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:13:59.473995  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:59.475015  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:59.476276  3193 raft_consensus.cc:1275] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:13:59.476327  3896 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:59.457506  3895 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:13:59.456686  5467 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:13:59.457093  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:59.480510  3335 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:59.478781  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:59.453408  5366 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:59.465591  5442 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:59.443169  5230 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:59.456915  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:59.478499  3342 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:13:59.478997  5429 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:59.479043  5450 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:59.481902  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:59.483753  3896 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:59.468232  3925 rpcz_store.cc:269] 0709 12:13:57.910757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.231402 (+320645us) service_pool.cc:224] Handling call
0709 12:13:59.467557 (+1236155us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b54006e0354. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:59.467698 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050066816}
I20260709 12:13:59.487471  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:59.496230  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:59.496954  3189 raft_consensus.cc:2393] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:59.497252  3187 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:59.497432  5444 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:59.495699  3184 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:13:59.499469  5444 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.499933  5444 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.486672  5366 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.502228  5366 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:59.498404  5388 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 12:13:59.504987  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:59.505364  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.494324  5442 raft_consensus.cc:697] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:59.492559  5210 raft_consensus.cc:2804] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:59.493920  5429 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.508178  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:59.493194  5450 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.508576  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:59.517283  3305 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:59.518013  5299 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:59.518352  3184 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:59.518463  5450 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.492758  5230 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.511725  5210 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.519702  5210 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.511147  5388 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:59.520713  5230 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.515962  5365 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:59.522022  5365 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:13:59.522308  3334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52822 (request call id 479) took 2216 ms (client timeout 1977 ms). Trace:
W20260709 12:13:59.522913  3334 rpcz_store.cc:269] 0709 12:13:57.305996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.310788 (+  4792us) service_pool.cc:224] Handling call
0709 12:13:59.522076 (+2211288us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54001d79d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:59.522219 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1471984512}
I20260709 12:13:59.513729  5392 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:13:59.525100  5429 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:59.525668  5429 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:59.526021  5429 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.526343  5429 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.527396  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:59.528293  3187 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.518185  5427 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:59.520809  3190 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:13:59.531984  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:59.531978  5427 raft_consensus.cc:697] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:59.535820  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:59.536652  3188 raft_consensus.cc:2393] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:13:59.536176  5427 consensus_queue.cc:237] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.517359  5263 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:13:59.510934  5442 consensus_queue.cc:237] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.512022  3896 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:59.540143  5443 raft_consensus.cc:2804] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:59.540629  5443 raft_consensus.cc:697] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:59.541512  5443 consensus_queue.cc:237] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.515579  5366 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:59.543385  5366 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.545014  3896 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:59.546886  5462 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:59.549077  5462 raft_consensus.cc:697] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:13:59.549463  5388 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.550020  5462 consensus_queue.cc:237] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.532079  5365 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:59.551705  5388 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.554798  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:59.555671  3342 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:13:59.557336  3896 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:13:59.558162  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 44925.2us
I20260709 12:13:59.559248  3156 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:13:59.578074  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 60824us
I20260709 12:13:59.580284  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:59.581670  5474 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:59.583037  5474 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.584180  5474 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.589689  3305 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:59.596048  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 681) took 1027 ms. Trace:
W20260709 12:13:59.625154  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 71887.3us
I20260709 12:13:59.625871  3932 rpcz_store.cc:276] 0709 12:13:58.568344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.590138 (+ 21794us) service_pool.cc:224] Handling call
0709 12:13:58.597069 (+  6931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:58.846986 (+249917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:58.847017 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:58.847058 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:58.847089 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.595746 (+748657us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54003e1a54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:13:59.595806 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:59.595974 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574221184}
I20260709 12:13:59.600378  3339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58568 (request call id 1929) took 1179 ms. Trace:
W20260709 12:13:59.604288  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.609040  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:59.628340  3262 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.611024  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:59.617386  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:59.618019  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:59.618419  3261 raft_consensus.cc:1275] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:59.630821  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:59.631669  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:59.618954  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:59.622342  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:13:59.622465  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 63319.9us
I20260709 12:13:59.634842  3263 raft_consensus.cc:2393] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:13:59.636392  3156 leader_election.cc:400] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5.
I20260709 12:13:59.636708  3156 leader_election.cc:403] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:13:59.642081  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.586647  4995 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:59.627122  3339 rpcz_store.cc:276] 0709 12:13:58.421245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.421374 (+   129us) service_pool.cc:224] Handling call
0709 12:13:59.600131 (+1178757us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b540036cc54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:13:59.600304 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2055422848}
I20260709 12:13:59.644189  3157 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:59.646256  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:59.650928  5482 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:59.646960  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:59.653829  3260 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:59.662727  3260 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:13:59.663724  5482 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.664955  5482 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.666455  5474 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.653090  5481 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:59.667923  5481 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.627005  5230 raft_consensus.cc:2804] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:59.693774  3262 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:59.650209  4995 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:59.676879  5443 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.679905  5412 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5.
I20260709 12:13:59.678169  5481 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.700943  5365 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.708204  5474 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:59.625653  5444 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.680631  5366 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:59.687363  5340 consensus_queue.cc:1059] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:13:59.675508  5406 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:13:59.702880  4995 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.696547  5230 raft_consensus.cc:697] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:13:59.736927  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 99636.1us
W20260709 12:13:59.745003  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.705960  5294 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:59.746249  3156 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:13:59.731170  5388 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:59.715145  5443 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.758623  3923 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:59.760041  5230 consensus_queue.cc:237] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:13:59.753391  5263 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:59.763952  5263 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.764472  5263 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.765903  4995 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.755216  5412 consensus_queue.cc:1048] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:13:59.769013  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:59.771293  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:59.772403  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:59.858057  3190 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.773205  5388 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:59.775797  5473 log.cc:927] Time spent T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:13:59.782065  5296 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:59.735599  5365 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.760617  3932 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:59.803385  5482 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.804885  5429 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.806660  5242 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.813395  3339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "132b388f4bf24fd482334847aadc601a"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:46076
I20260709 12:13:59.817026  5444 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.821009  5467 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.799485  5428 raft_consensus.cc:3055] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:13:59.824548  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:13:59.825569  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:59.870534  3262 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:59.823236  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 179110us
W20260709 12:13:59.827512  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 175622us
I20260709 12:13:59.874643  3305 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:59.833504  3087 catalog_manager.cc:5697] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 3, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 3 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:59.767169  5450 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.820744  5474 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:13:59.815243  5210 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:13:59.862601  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.867556  3339 raft_consensus.cc:606] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:13:59.884366  3339 raft_consensus.cc:614] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:59.875295  3190 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:13:59.878968  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:13:59.886461  3185 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:13:59.882449  3262 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:13:59.876071  3157 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:59.863538  5486 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.890544  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:13:59.891449  3342 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:13:59.903488  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:59.904309  3929 raft_consensus.cc:2393] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 5: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:13:59.905723  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:59.898411  5486 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.898175  5350 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:59.908106  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:13:59.908387  5486 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:59.906459  3926 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:13:59.912075  3926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "7ac63b674f204bc4805ab989f8c965d3"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:13:59.913252  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:59.916332  5485 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:59.916867  5485 raft_consensus.cc:697] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:59.917788  5485 consensus_queue.cc:237] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.918434  3335 raft_consensus.cc:1240] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:59.919929  3932 raft_consensus.cc:1240] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:59.920809  3306 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:13:59.869868  5428 raft_consensus.cc:740] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:13:59.867470  5296 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.922415  5428 consensus_queue.cc:260] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.922930  5443 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.924100  5402 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:59.924271  5392 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:59.924796  3187 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:13:59.924712  5402 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:13:59.885216  5467 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.926097  4995 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.869686  5242 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.927101  5467 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.924813  5392 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:13:59.927237  5402 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.924139  3087 catalog_manager.cc:5697] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:59.928431  5210 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.930198  3268 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:59.913596  5429 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:59.936228  3087 catalog_manager.cc:5697] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 4 to 5, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 5 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:13:59.898063  5301 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:59.962812  3306 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:13:59.931588  3926 raft_consensus.cc:606] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Received request to transfer leadership to TS 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:13:59.992767  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:13:59.993703  3333 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.929241  5388 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.932025  5340 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:59.932250  5288 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:59.946588  5450 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:59.960165  5350 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:00.013083  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:13:59.956275  5296 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:13:59.967653  5428 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:59.997555  3926 raft_consensus.cc:614] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:00.020584  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:13:59.945487  5263 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.021327  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:00.065076  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.023339  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.022845  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.023603  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.001682  3896 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:00.067292  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 65789.5us
I20260709 12:14:00.062002  3188 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.028954  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:00.033912  3338 raft_consensus.cc:1240] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:00.069624  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:00.069911  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:00.070389  3341 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.070657  3338 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:14:00.071781  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.035876  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.037940  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:00.073357  3268 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:13:59.937757  5482 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:59.966441  5392 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:13:59.965143  5365 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:13:59.984754  5366 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:00.040829  3262 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.009470  3333 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:13:59.992767  5401 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:13:59.996670  5427 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:59.985001  5474 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:13:59.946563  5481 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.061517  3337 raft_consensus.cc:1275] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:00.066205  3192 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:14:00.123838  3896 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:00.056757  5461 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.075708  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.022944  5402 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:00.077939  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.078619  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:00.039594  5429 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:00.039650  5288 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:00.143090  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 259575us
I20260709 12:14:00.057144  5350 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.177450  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.178893  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:00.180519  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.078329  5462 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:00.080869  3157 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:00.185968  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:00.120868  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 43780.7us
I20260709 12:14:00.125188  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.099478  3193 raft_consensus.cc:1275] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:00.074790  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:00.186890  3156 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:00.106341  5366 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:00.078397  3191 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:00.128604  3341 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:00.128784  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.110809  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.190920  3896 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:00.190864  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.191749  3341 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:00.192584  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.193171  3341 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:00.058657  5487 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.138116  3231 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:00.181288  3930 raft_consensus.cc:2368] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5.
I20260709 12:14:00.057646  5446 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:00.109766  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.187393  3338 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:00.107355  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:00.212194  3186 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.187459  3342 raft_consensus.cc:1240] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:00.078146  5450 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:00.216609  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 78599.9us
I20260709 12:14:00.178368  5222 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:00.074558  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:00.180596  5230 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:00.199914  3189 raft_consensus.cc:2368] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3.
I20260709 12:14:00.200487  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:00.100595  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:00.201884  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:00.237583  3341 raft_consensus.cc:2368] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5.
I20260709 12:14:00.238544  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.109398  5296 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:00.179021  3927 raft_consensus.cc:1240] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:00.126968  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:00.058938  5412 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.180400  5482 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:00.220760  3231 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:00.153926  3262 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:00.218782  5442 raft_consensus.cc:2804] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:00.236515  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.185799  5462 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
W20260709 12:14:00.242383  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.254205  3337 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:00.199807  5366 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:00.246917  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 60105.1us
I20260709 12:14:00.230453  3338 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:14:00.127512  5474 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:00.129142  5401 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:00.252100  3231 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:00.179474  5402 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.177145  5461 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.216454  5242 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:00.246481  5222 raft_consensus.cc:697] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:00.185562  5429 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.263816  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.267223  3186 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:00.241770  5425 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:00.270327  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:00.248492  3259 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:14:00.220109  5378 raft_consensus.cc:2764] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:14:00.232077  5450 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:00.277063  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:00.277766  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 91394.8us
I20260709 12:14:00.285764  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.258054  5462 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:00.271911  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:00.128338  5427 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:00.320361  3337 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:00.274767  5442 raft_consensus.cc:697] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:00.296438  3156 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:00.391788  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 95466.4us
W20260709 12:14:00.323246  5495 log.cc:927] Time spent T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:14:00.323122  5242 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.323477  5222 consensus_queue.cc:237] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:00.324841  5491 log.cc:927] Time spent T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:14:00.325573  5494 log.cc:927] Time spent T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:14:00.326673  5498 log.cc:927] Time spent T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:14:00.327955  5497 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:14:00.332818  5429 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:00.336433  5461 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:00.338718  5402 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:00.340261  5263 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:00.341217  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 301512us
I20260709 12:14:00.342499  5392 raft_consensus.cc:2764] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:14:00.342847  5474 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:00.253043  5412 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.227679  5446 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:00.343629  5481 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:00.343786  5504 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:00.216216  5487 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.347555  3929 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.347913  5450 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:00.258539  5482 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.348460  5288 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:00.350965  5401 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:00.351179  3087 catalog_manager.cc:5697] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 3, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:00.354765  3088 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48764 (request call id 295) took 8438 ms. Trace:
I20260709 12:14:00.245484  5296 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.247552  5230 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:00.260061  5271 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 12:14:00.359234  5506 log.cc:927] Time spent T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.072s	user 0.003s	sys 0.000s
I20260709 12:14:00.286715  5406 raft_consensus.cc:2764] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:14:00.368191  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.373373  3231 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:00.386025  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 114202us
I20260709 12:14:00.389021  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:00.469442  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 96232.9us
I20260709 12:14:00.469726  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:00.470466  3337 raft_consensus.cc:2368] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6.
I20260709 12:14:00.470548  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:00.471271  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:00.321053  3338 raft_consensus.cc:2368] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3.
I20260709 12:14:00.471800  3340 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:00.472726  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.474097  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.474771  3338 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:14:00.475494  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:00.475756  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.476418  3342 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:00.476511  3338 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:00.477308  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.477909  3338 raft_consensus.cc:1240] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:00.405411  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 324563us
I20260709 12:14:00.480618  3157 leader_election.cc:400] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5.
I20260709 12:14:00.480775  3231 leader_election.cc:400] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3.
I20260709 12:14:00.481266  3231 leader_election.cc:403] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:00.482522  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:00.387768  5340 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:00.411461  3895 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:00.395771  5489 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:00.437644  3087 catalog_manager.cc:5697] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 3 to 4, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 4 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:00.459270  3188 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:00.522141  5489 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.522571  5489 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:00.523582  5288 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:00.523017  3087 catalog_manager.cc:5697] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 3, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 3 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:00.524113  5288 raft_consensus.cc:697] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:00.524936  5288 consensus_queue.cc:237] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:00.541477  5487 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:00.544294  5412 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:00.547122  5446 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:00.548727  3341 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:14:00.549935  5482 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:00.553239  5296 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:00.554046  5481 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:00.418900  5504 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:00.555753  5504 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.557274  5392 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:00.428701  5299 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 12:14:00.561313  5427 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:00.472826  3259 raft_consensus.cc:1275] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:00.397372  5242 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:00.465449  5508 log.cc:927] Time spent T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:14:00.568111  3334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 505) took 1022 ms. Trace:
I20260709 12:14:00.568555  3334 rpcz_store.cc:276] 0709 12:13:59.546124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.546460 (+   336us) service_pool.cc:224] Handling call
0709 12:13:59.546901 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:59.866291 (+319390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:59.870127 (+  3836us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:59.946563 (+ 76436us) log.cc:844] Serialized 26 byte log entry
0709 12:14:00.060512 (+113949us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:00.060543 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.060603 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:00.567888 (+507285us) raft_consensus.cc:1685] finished
0709 12:14:00.567908 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:00.568045 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4982,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":429458,"threads_started":2,"wal-append.queue_time_us":254413}
I20260709 12:14:00.575600  5401 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:00.578059  5242 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:00.435590  3088 rpcz_store.cc:276] 0709 12:13:51.916124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.916365 (+   241us) service_pool.cc:224] Handling call
0709 12:13:51.996338 (+ 79973us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5400002490. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a90b2 00007f1af4422759 00007f1af43baa76 00007f1af438bd58 00007f1af448a04e 00007f1af294b2a4 00007f1af294b232 00007f1af294b161 00007f1af294b0dc
0709 12:14:00.354696 (+8358358us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:58.025522 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:58.136905 (+111383us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:58.138784 (+  1879us) write_op.cc:435] Acquired schema lock
0709 12:13:58.142114 (+  3330us) tablet.cc:662] Decoding operations
0709 12:13:58.222094 (+ 79980us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:58.222154 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:58.222181 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:13:58.222745 (+   564us) tablet.cc:701] Row locks acquired
0709 12:13:58.222764 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:13:58.222915 (+   151us) write_op.cc:270] Start()
0709 12:13:58.223043 (+   128us) write_op.cc:276] Timestamp: P: 1783599238222871 usec, L: 0
0709 12:13:58.223066 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:13:58.226538 (+  3472us) log.cc:844] Serialized 2897 byte log entry
0709 12:13:58.573011 (+346473us) op_driver.cc:464] REPLICATION: finished
0709 12:13:58.818547 (+245536us) write_op.cc:301] APPLY: starting
0709 12:13:58.824422 (+  5875us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:58.917786 (+ 93364us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:58.984401 (+ 66615us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:59.223954 (+239553us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:59.224199 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:13:59.224260 (+    61us) write_op.cc:312] APPLY: finished
0709 12:13:59.224550 (+   290us) log.cc:844] Serialized 59 byte log entry
0709 12:13:59.224721 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:59.224836 (+   115us) write_op.cc:454] Released schema lock
0709 12:13:59.224876 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:59.225390 (+   514us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:59.225428 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":104275,"reported_tablets":30,"spinlock_wait_cycles":23366016,"child_traces":[["op",{"apply.queue_time_us":206894,"apply.run_cpu_time_us":4345,"apply.run_wall_time_us":435798,"num_ops":7,"prepare.queue_time_us":109793,"prepare.run_cpu_time_us":11844,"prepare.run_wall_time_us":277224,"raft.queue_time_us":253051,"raft.run_cpu_time_us":22627,"raft.run_wall_time_us":114193,"replication_time_us":336714,"spinlock_wait_cycles":1280,"thread_start_us":379857,"threads_started":4,"wal-append.queue_time_us":63523,"wal-append.run_cpu_time_us":57580,"wal-append.run_wall_time_us":1940464}]]}
W20260709 12:14:00.587731  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 90929.8us
I20260709 12:14:00.408591  5461 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:00.484851  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:00.479293  3338 raft_consensus.cc:1240] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:00.492691  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 81331.7us
I20260709 12:14:00.617601  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.618476  3189 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:00.514168  3231 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:00.491999  5263 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:00.521415  5509 consensus_queue.cc:1059] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:00.629153  3895 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:00.627166  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 142405us
I20260709 12:14:00.408258  5425 raft_consensus.cc:697] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:00.631698  3929 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:00.635656  3188 raft_consensus.cc:3055] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:00.433971  5311 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:00.396559  5366 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:00.665131  3188 raft_consensus.cc:740] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:00.681455  3157 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:00.714218  5378 consensus_queue.cc:1059] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 12:14:00.696275  5499 log.cc:927] Time spent T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.421s	user 0.000s	sys 0.004s
I20260709 12:14:00.721378  3342 raft_consensus.cc:2393] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:14:00.727919  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 213844us
W20260709 12:14:00.728260  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 90719.8us
I20260709 12:14:00.711886  3188 consensus_queue.cc:260] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:00.732021  3156 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:00.645706  5514 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:00.736387  3157 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:00.647264  5461 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:00.637669  5487 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 12:14:00.741390  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 112327us
I20260709 12:14:00.756816  3895 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:00.716215  5505 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:00.716478  5402 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.716676  5392 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3.
I20260709 12:14:00.744731  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:00.715597  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.745551  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:00.749092  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:00.749465  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:00.750631  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:00.764905  5445 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:00.728312  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.766368  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:00.767040  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:00.767866  3260 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.694974  5311 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.712348  5478 consensus_queue.cc:1059] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:14:00.735702  5242 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:00.791924  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.790777  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.611830  5442 consensus_queue.cc:237] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:00.791115  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:00.787869  3232 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:00.754696  5401 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:00.833259  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:00.840159  3260 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:00.739686  5412 consensus_queue.cc:1059] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 12:14:00.834879  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:00.722352  5515 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:14:00.835728  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:00.755963  5271 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.664459  5425 consensus_queue.cc:237] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.830581  5514 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:00.846897  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 59150.7us
I20260709 12:14:00.833901  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:00.848845  3265 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:00.841058  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:00.841447  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.844290  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:00.844548  3261 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:14:00.766251  5388 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:00.765983  5512 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:00.845381  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 81332.4us
I20260709 12:14:00.766597  5513 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:00.835172  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:00.837258  5242 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.836445  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:00.851226  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.842954  5478 consensus_queue.cc:1243] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer eb49d92feeb14382b3baa49d696b6141 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:14:00.861955  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:00.853461  5366 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:00.768944  5402 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:00.850683  5401 raft_consensus.cc:697] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:14:00.845896  5428 consensus_meta.cc:287] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.779s	user 0.010s	sys 0.001s
I20260709 12:14:00.859508  3895 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:00.843168  5523 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:00.848886  5514 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:00.851575  5392 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:00.849218  5271 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.012954  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41262 (request call id 8) took 1102 ms. Trace:
I20260709 12:14:01.013296  5271 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.014207  5271 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:00.959967  3184 raft_consensus.cc:2393] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:00.956969  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 184275us
I20260709 12:14:01.016489  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.018653  5294 raft_consensus.cc:3055] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:01.018805  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.965162  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.020939  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.022145  3187 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:00.966178  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:01.024375  3184 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:00.840539  3192 raft_consensus.cc:2393] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:01.028110  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.847900  3232 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:01.029788  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.838359  3193 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:14:01.030768  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 182826us
I20260709 12:14:00.973766  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:01.032142  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:00.856739  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:00.976287  3188 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.033712  3232 leader_election.cc:400] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5.
I20260709 12:14:01.034231  3232 leader_election.cc:403] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:14:01.034528  3266 raft_consensus.cc:2393] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:00.982003  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:00.852080  3260 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:00.865178  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:01.035903  5296 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.036988  3232 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.037698  5301 raft_consensus.cc:1064] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:14:01.038334  3339 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:01.038429  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.039623  3187 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:01.040330  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.042068  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55426 (request call id 445) took 1060 ms. Trace:
I20260709 12:14:01.042433  3189 raft_consensus.cc:1275] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:01.004578  3338 raft_consensus.cc:1275] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:00.995509  3337 raft_consensus.cc:2410] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:01.015309  5271 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.045568  4995 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:01.046168  4995 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:01.046940  4995 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.050778  3305 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:01.051791  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 48385.7us
I20260709 12:14:01.053539  3305 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:01.053893  5301 consensus_queue.cc:237] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.055877  3334 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:01.042516  3925 rpcz_store.cc:276] 0709 12:13:59.981085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.984786 (+  3701us) service_pool.cc:224] Handling call
0709 12:14:01.040455 (+1055669us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:14:01.040944 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.041461 (+   517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.041493 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.041561 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:01.041618 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.041677 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.041823 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116273024}
I20260709 12:14:01.013602  3926 rpcz_store.cc:276] 0709 12:13:59.910019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.911920 (+  1901us) service_pool.cc:224] Handling call
0709 12:14:01.012456 (+1100536us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b54004ee8d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5c7853 00007f1af359560a 00007f1aecb1b7d4 00007f1aecb1b762 00007f1aecb1b691 00007f1aecb1b60c 00007f1aecb1a8c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:01.012669 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43245440}
I20260709 12:14:01.019153  5294 raft_consensus.cc:740] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:00.964793  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.059094  3928 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:01.060123  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55426 (request call id 444) took 1080 ms. Trace:
I20260709 12:14:01.060215  5294 consensus_queue.cc:260] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.060593  3928 rpcz_store.cc:276] 0709 12:13:59.980203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.984910 (+  4707us) service_pool.cc:224] Handling call
0709 12:14:01.058203 (+1073293us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8eee 000000000036eb39 00007f1af351c1e0 00007f1af35e50c4 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:14:01.058581 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.059739 (+  1158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.060055 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40371072}
I20260709 12:14:01.062736  5294 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.064442  3338 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:00.837122  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:01.027246  5230 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:00.899927  5311 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.069345  5340 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.070222  5340 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:00.998282  3335 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:14:01.008272  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 148849us
I20260709 12:14:01.072933  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 443) took 1093 ms. Trace:
I20260709 12:14:01.073463  3895 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:01.073973  5340 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:01.074604  5340 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:00.995160  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:01.075229  5340 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.076105  3333 raft_consensus.cc:2410] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:01.057250  3334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 1863) took 1021 ms. Trace:
I20260709 12:14:01.033720  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.076776  3334 rpcz_store.cc:276] 0709 12:14:00.036014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.570329 (+534315us) service_pool.cc:224] Handling call
0709 12:14:01.055359 (+485030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.056343 (+   984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.057038 (+   695us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b540007a650. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:01.057182 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114576640}
I20260709 12:14:01.078038  5340 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:00.898556  5350 consensus_meta.cc:287] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.708s	user 0.005s	sys 0.004s
I20260709 12:14:01.009284  5242 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:01.079784  5350 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.080520  5366 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:01.031744  5263 consensus_queue.cc:1048] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:01.081231  5366 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.082284  5242 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:01.082784  5350 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:01.082854  5242 raft_consensus.cc:697] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:01.067658  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:01.009063  3341 raft_consensus.cc:1275] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:00.883144  5392 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:01.105719  5392 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.893196  5401 consensus_queue.cc:237] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.896709  5402 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:00.908511  5461 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:00.913970  5462 consensus_meta.cc:287] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.001s
I20260709 12:14:01.156114  5462 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:00.922179  5484 raft_consensus.cc:3055] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:01.158443  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:01.158808  5484 raft_consensus.cc:740] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:01.062664  3896 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:01.160643  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 98371.1us
I20260709 12:14:01.160449  5484 consensus_queue.cc:260] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.162348  5484 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.025091  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.067579  3928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "7ac63b674f204bc4805ab989f8c965d3"
 from {username='slave'} at 127.0.0.1:41262
W20260709 12:14:00.904384  5488 log.cc:927] Time spent T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.719s	user 0.010s	sys 0.013s
I20260709 12:14:00.910683  5489 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:00.903187  5504 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.194172  5504 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:00.920251  5510 log.cc:927] Time spent T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.460s	user 0.003s	sys 0.009s
I20260709 12:14:00.923010  5511 raft_consensus.cc:3055] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:01.196944  5511 raft_consensus.cc:740] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:01.198395  5511 consensus_queue.cc:260] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.200214  3268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1861) took 1065 ms. Trace:
I20260709 12:14:00.865286  5512 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:01.202641  5520 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.866186  5513 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.204422  3336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 1930) took 2782 ms. Trace:
I20260709 12:14:01.205473  3265 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:00.884112  5514 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:00.915077  5516 log.cc:927] Time spent T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.454s	user 0.014s	sys 0.000s
I20260709 12:14:01.104820  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:01.030771  3192 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:01.085244  3895 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:01.213271  3262 raft_consensus.cc:1240] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:01.213418  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 128465us
I20260709 12:14:01.046083  5271 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:01.216152  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 442) took 1237 ms. Trace:
I20260709 12:14:01.078719  5340 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.217423  5340 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.218910  5512 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.083918  5350 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:01.219631  5350 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.220062  5350 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:01.221216  5513 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.216588  3932 rpcz_store.cc:276] 0709 12:13:59.979195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.979345 (+   150us) service_pool.cc:224] Handling call
0709 12:14:00.004066 (+ 24721us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:00.005892 (+  1826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:00.005924 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:00.006376 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:14:00.354028 (+347652us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b180036ce20. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4c2e07 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1aee16720b 00007f1aee16cd23 00007f1aee16d0d1 00007f1aee588a0f
0709 12:14:00.433895 (+ 79867us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:00.433939 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.434006 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:00.914431 (+480425us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:01.215720 (+301289us) raft_consensus.cc:1685] finished
0709 12:14:01.215763 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.215981 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1415,"raft.queue_time_us":2172,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":34481,"spinlock_wait_cycles":29020288,"thread_start_us":79548,"threads_started":1,"wal-append.queue_time_us":442743}
I20260709 12:14:01.084342  5366 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:01.073377  3923 rpcz_store.cc:276] 0709 12:13:59.979778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.984786 (+  5008us) service_pool.cc:224] Handling call
0709 12:14:01.071660 (+1086874us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:14:01.071965 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.072383 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.072419 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.072483 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:01.072528 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.072605 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.072745 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43099904}
I20260709 12:14:01.224373  5340 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:01.204932  3336 rpcz_store.cc:276] 0709 12:13:58.421637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.421824 (+   187us) service_pool.cc:224] Handling call
0709 12:13:58.422110 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:58.430704 (+  8594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:58.430735 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:59.482012 (+1051277us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b180041c7a0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4ae2a6 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aecec6a11 00007f1aeced6372 00007f1aee608a01 00007f1aee5cd43a
0709 12:13:59.623274 (+141262us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b2c000e61b8. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aecec6a11 00007f1aeced6372 00007f1aee608a01 00007f1aee5cd43a 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2
0709 12:13:59.649831 (+ 26557us) log.cc:844] Serialized 26 byte log entry
0709 12:13:59.887655 (+237824us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:59.887702 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.887786 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:00.903632 (+1015846us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:01.203949 (+300317us) raft_consensus.cc:1685] finished
0709 12:14:01.203989 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.204215 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9332,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":47606,"spinlock_wait_cycles":22909696,"thread_start_us":191378,"threads_started":1,"wal-append.queue_time_us":394218}
I20260709 12:14:01.200773  3268 rpcz_store.cc:276] 0709 12:14:00.134358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.134609 (+   251us) service_pool.cc:224] Handling call
0709 12:14:00.134992 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:00.135454 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:00.135500 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:00.180985 (+ 45485us) log.cc:844] Serialized 26 byte log entry
0709 12:14:00.367664 (+186679us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:00.367708 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.367804 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:00.919621 (+551817us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:01.199540 (+279919us) raft_consensus.cc:1685] finished
0709 12:14:01.199581 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.199917 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":583,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":8916,"spinlock_wait_cycles":26291072,"thread_start_us":136591,"threads_started":1,"wal-append.queue_time_us":194788}
W20260709 12:14:01.142205  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 88911us
I20260709 12:14:01.144110  3929 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:14:01.127490  5299 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:14:01.217083  5489 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.153283  5402 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.233482  5402 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:01.234025  5402 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.153635  5388 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.240447  5511 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.154309  5378 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5.
I20260709 12:14:01.151118  5242 consensus_queue.cc:237] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.173820  3928 raft_consensus.cc:606] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Received request to transfer leadership to TS 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.174750  5462 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:01.175534  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.173908  5526 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:14:01.177600  3188 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:01.223526  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:01.241559  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 82880.6us
I20260709 12:14:01.223088  4995 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.235762  5296 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.244598  3928 raft_consensus.cc:614] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:01.263243  3305 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:01.266062  5378 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:01.274837  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 238137us
I20260709 12:14:01.277223  3232 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:01.278815  3232 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:01.284096  5513 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:01.284327  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:01.284934  5513 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.285158  3923 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:14:01.291642  3232 leader_election.cc:400] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6.
I20260709 12:14:01.292047  3232 leader_election.cc:403] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:14:01.302534  5521 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.303289  3192 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:01.305994  3231 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:01.307832  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:01.308310  5271 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:01.308913  5271 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.309168  5378 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.311095  5271 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.313035  5350 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.314260  4995 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.297411  5512 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6.
I20260709 12:14:01.299057  5520 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:01.318104  3231 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:01.318883  5504 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:01.319221  5504 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:01.319657  5504 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.319881  5392 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.322093  5392 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.323037  3259 raft_consensus.cc:2410] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:14:01.297199  5428 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:01.324406  5428 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:01.324656  3185 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:01.324858  5428 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.349047  3232 leader_election.cc:400] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3.
W20260709 12:14:01.350019  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 92122.6us
I20260709 12:14:01.348886  5538 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:01.351547  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 49859.1us
I20260709 12:14:01.352922  3232 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.353557  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:01.355746  5401 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:01.356207  5401 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:01.356631  5401 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.351727  5538 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.359390  5538 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:01.351953  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:01.313061  5402 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.361135  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:01.363880  5402 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.369587  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:01.369859  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:01.311257  5378 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:01.373983  3262 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:01.374601  5521 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:01.375062  5521 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.314347  5271 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:01.377228  5271 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:01.377647  3268 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:01.378525  5350 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:01.383531  5514 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.384002  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:01.385100  3190 raft_consensus.cc:1240] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:01.386220  5514 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.377681  5271 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:01.388880  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 90903.4us
I20260709 12:14:01.367496  5402 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:01.379184  5513 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.405334  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:01.403906  5222 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:14:01.420890  5521 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:01.424222  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.425233  3342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:46076
I20260709 12:14:01.425819  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:01.427882  3926 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:01.428171  5427 raft_consensus.cc:2804] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:01.424142  5521 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.442024  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:01.442883  5520 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:01.430229  5427 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:01.444252  5427 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.448745  5428 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.450357  5504 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.451025  5428 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:01.453300  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 663983us
I20260709 12:14:01.455168  3259 raft_consensus.cc:2410] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:01.456835  3339 raft_consensus.cc:1275] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:01.457316  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:01.459409  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.453744  5401 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.461027  3305 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.462762  3923 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:01.463146  5242 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.463770  3342 raft_consensus.cc:606] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:01.464027  5242 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.464179  3342 raft_consensus.cc:614] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:01.468436  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.469949  3268 raft_consensus.cc:1240] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:01.473671  3926 raft_consensus.cc:1240] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:01.477178  4995 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:01.477807  4995 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.478464  3895 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:01.479892  5442 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:01.479883  5520 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:01.482492  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:01.490851  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:01.495724  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 59653.3us
I20260709 12:14:01.522702  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:01.533914  3340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 1948) took 1306 ms. Trace:
I20260709 12:14:01.572883  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:01.574565  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 75227.5us
I20260709 12:14:01.534071  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:01.576653  3338 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:01.535805  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:01.578022  3267 raft_consensus.cc:2393] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:01.578786  3342 raft_consensus.cc:2393] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:14:01.580256  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 59792.5us
I20260709 12:14:01.581209  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.484525  5513 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:01.561859  5485 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:01.493602  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:01.572997  3340 rpcz_store.cc:276] 0709 12:14:00.221945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.102475 (+880530us) service_pool.cc:224] Handling call
0709 12:14:01.141659 (+ 39184us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:01.248137 (+106478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.248169 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:01.271501 (+ 23332us) log.cc:844] Serialized 26 byte log entry
0709 12:14:01.400370 (+128869us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:01.400419 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.400499 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:01.526205 (+125706us) raft_consensus.cc:1685] finished
0709 12:14:01.526228 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.526380 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72083,"raft.queue_time_us":72670,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":71133,"threads_started":1,"wal-append.queue_time_us":218782}
I20260709 12:14:01.589608  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:01.580367  3186 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:01.584483  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:01.586891  3268 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:01.524489  5511 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:01.562618  5378 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:01.540890  5484 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:01.587697  4995 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.604589  5484 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.598440  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:01.598919  5513 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.606173  5378 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.587954  5514 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.607851  5514 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.608436  5513 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:01.602867  5296 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:01.609301  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.609263  5296 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.609973  5514 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:01.611307  5504 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.611765  5485 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.612563  5484 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.613152  5296 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.491559  5402 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.608450  5378 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.615518  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.616006  5402 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:01.616952  5485 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.611833  3261 raft_consensus.cc:1275] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:01.619553  3266 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:01.622042  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:01.623315  3923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:14:01.623857  5271 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.619052  3306 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.628906  3268 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:01.633630  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:01.631703  3923 raft_consensus.cc:606] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:01.638177  5406 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:01.638301  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:01.594645  5366 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:01.638453  3231 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:01.640483  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:01.643990  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:01.650625  3267 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:01.657312  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:01.658407  3261 raft_consensus.cc:2393] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:01.646633  5511 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.657413  5401 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:01.668673  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 49878.7us
I20260709 12:14:01.672809  3334 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:01.680190  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:01.683749  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.675894  5242 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.688475  3341 raft_consensus.cc:1240] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:01.670485  5301 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:01.689790  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 49438.5us
I20260709 12:14:01.689941  5301 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.690783  3157 leader_election.cc:400] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5.
I20260709 12:14:01.691075  3157 leader_election.cc:403] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:01.692230  5301 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:01.692888  5301 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:01.693059  3157 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:01.693588  5301 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5.
I20260709 12:14:01.694576  5525 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:01.641095  5425 consensus_queue.cc:1059] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:14:01.698725  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:01.698994  5484 consensus_queue.cc:1059] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:01.700040  5514 consensus_queue.cc:1059] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:01.717589  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 129316us
I20260709 12:14:01.675768  5402 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.678378  4995 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:14:01.731101  5402 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.731566  5402 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.732286  5484 raft_consensus.cc:3055] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:01.732816  5484 raft_consensus.cc:740] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:01.733867  5484 consensus_queue.cc:260] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.734828  5511 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:01.736178  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:01.736563  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.736941  3185 raft_consensus.cc:2393] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:01.737814  3305 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.738943  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.739131  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.697412  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:01.670650  5350 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:01.701540  3157 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:01.719664  5521 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:01.721105  3929 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEARNER]: Advancing to term 4
I20260709 12:14:01.722215  3264 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:01.722919  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:01.723924  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:01.725384  3932 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:01.725896  3189 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.726583  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.727294  3895 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.739787  3193 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:14:01.705307  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:01.745457  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:01.740401  5484 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.771286  3338 raft_consensus.cc:1240] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:01.772193  3341 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:01.773429  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.742632  5350 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:01.774127  3185 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:01.779574  3306 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:01.796736  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:01.746917  5538 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:01.777280  5366 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:01.805687  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 65259.2us
I20260709 12:14:01.804553  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:01.808525  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:01.808746  3187 raft_consensus.cc:2393] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:01.812531  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 85299.1us
I20260709 12:14:01.772357  5525 raft_consensus.cc:697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:01.781956  5271 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.794828  5350 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.751838  5485 consensus_queue.cc:1048] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:14:01.746246  5388 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:14:01.799485  5406 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.831037  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.840097  3232 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:01.841086  5392 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:01.841636  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:01.822204  5538 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:01.844143  5538 raft_consensus.cc:697] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:01.798766  5442 consensus_queue.cc:1059] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:14:01.824396  5288 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.851483  3087 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34704 (request call id 179) took 5128 ms. Trace:
I20260709 12:14:01.851974  5525 consensus_queue.cc:237] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.852710  3266 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:01.838907  5402 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:01.853751  5294 raft_consensus.cc:3055] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:14:01.854054  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 152653us
I20260709 12:14:01.854266  5294 raft_consensus.cc:740] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:01.854908  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:01.855777  3192 raft_consensus.cc:3055] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:01.856186  3192 raft_consensus.cc:740] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:01.856761  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.857196  3192 consensus_queue.cc:260] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.858475  3192 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.820009  5443 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:14:01.865123  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:01.864174  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:01.821422  3189 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:01.823408  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:01.824622  3334 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:01.863360  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:01.875443  5535 consensus_queue.cc:1059] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:01.876434  5535 raft_consensus.cc:3055] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:01.876762  5535 raft_consensus.cc:740] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:01.856060  5402 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:01.881816  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:01.883324  3186 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.884392  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.886080  3929 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:01.863075  5230 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:01.901399  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:01.903383  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:01.904201  3193 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.889668  5340 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:01.851910  3087 rpcz_store.cc:276] 0709 12:13:56.722926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.737391 (+ 14465us) service_pool.cc:224] Handling call
0709 12:14:01.850334 (+5112943us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:00.866879 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:00.893432 (+ 26553us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:00.893475 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:14:00.893493 (+    18us) tablet.cc:662] Decoding operations
0709 12:14:00.894353 (+   860us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:00.894414 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:00.894440 (+    26us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:14:00.894940 (+   500us) tablet.cc:701] Row locks acquired
0709 12:14:00.894956 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:14:00.895091 (+   135us) write_op.cc:270] Start()
0709 12:14:00.895211 (+   120us) write_op.cc:276] Timestamp: P: 1783599240895048 usec, L: 0
0709 12:14:00.895232 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:14:00.915039 (+ 19807us) log.cc:844] Serialized 2430 byte log entry
0709 12:14:01.395046 (+480007us) op_driver.cc:464] REPLICATION: finished
0709 12:14:01.525048 (+130002us) write_op.cc:301] APPLY: starting
0709 12:14:01.525184 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:01.525447 (+   263us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:01.525591 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:01.564964 (+ 39373us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:01.565376 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:14:01.565465 (+    89us) write_op.cc:312] APPLY: finished
0709 12:14:01.566039 (+   574us) log.cc:844] Serialized 53 byte log entry
0709 12:14:01.566311 (+   272us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:01.566513 (+   202us) write_op.cc:454] Released schema lock
0709 12:14:01.566581 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:01.567122 (+   541us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:01.567155 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1330020,"reported_tablets":13,"spinlock_wait_cycles":27392,"child_traces":[["op",{"apply.queue_time_us":129587,"apply.run_cpu_time_us":4144,"apply.run_wall_time_us":42029,"num_ops":6,"prepare.queue_time_us":318709,"prepare.run_cpu_time_us":26250,"prepare.run_wall_time_us":444686,"raft.queue_time_us":101821,"raft.run_cpu_time_us":1305,"raft.run_wall_time_us":5163,"replication_time_us":499620,"thread_start_us":573061,"threads_started":4,"wal-append.queue_time_us":353271}]]}
W20260709 12:14:01.915585  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 92262.4us
I20260709 12:14:01.913228  3090 catalog_manager.cc:5697] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.920197  3193 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:01.896401  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:01.925189  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:01.950661  5559 log.cc:927] Time spent T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:14:01.956272  5560 log.cc:927] Time spent T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:01.914777  5340 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.958724  5340 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:01.961041  3192 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260709 12:14:01.978313  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 61813.8us
I20260709 12:14:01.961556  3192 pending_rounds.cc:85] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3: Aborting all ops after (but not including) 5
I20260709 12:14:01.886049  5538 consensus_queue.cc:237] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:01.984706  3895 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:01.980093  3192 pending_rounds.cc:107] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3: Aborting uncommitted NO_OP operation due to leader change: 3.6
W20260709 12:14:01.988356  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 208885us
I20260709 12:14:01.990007  3192 raft_consensus.cc:2889] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:01.980810  5242 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.984017  3090 catalog_manager.cc:5697] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 2 to 3, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.992345  4995 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:01.961879  5230 consensus_queue.cc:1059] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:14:01.991781  5520 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:14:02.011969  3090 catalog_manager.cc:5697] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 2 to 3, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:01.997100  5442 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:14:02.035264  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:02.036098  3192 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.041576  5535 consensus_queue.cc:260] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:02.043001  5535 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.049083  5294 consensus_queue.cc:260] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:02.050496  5294 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.052146  5288 raft_consensus.cc:3055] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:02.052578  5288 raft_consensus.cc:740] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:02.053447  5288 consensus_queue.cc:260] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:02.054335  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:02.055569  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:02.055660  3232 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 2.056s (SENT) [suppressed 1 similar messages]
I20260709 12:14:02.060024  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:02.029371  5567 consensus_queue.cc:1059] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:14:02.064266  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:02.064599  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:02.064927  3185 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:02.065537  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:02.065950  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:02.066154  3185 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:02.066514  3264 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.066895  3267 raft_consensus.cc:1240] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:02.067689  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:02.067987  3090 catalog_manager.cc:5697] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 4 to 5, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 5 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:02.069921  3929 raft_consensus.cc:1240] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:02.070786  5290 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:14:02.071731  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:02.072980  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:02.054653  5288 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:02.059389  3157 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:02.079964  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:02.070118  3090 catalog_manager.cc:5697] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 5 to 6, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 6 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:02.083176  3268 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
W20260709 12:14:02.089376  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.090629  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:02.087852  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:02.088047  3090 catalog_manager.cc:5697] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 4, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 4 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:02.091804  3265 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:02.092314  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:02.047062  5350 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:02.104394  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 66670.2us
I20260709 12:14:02.107031  3193 raft_consensus.cc:1275] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:14:02.110751  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.114817  3186 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:02.115518  3185 raft_consensus.cc:1240] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:02.108502  3090 catalog_manager.cc:5697] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:02.106793  5427 consensus_meta.cc:287] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.662s	user 0.011s	sys 0.002s
I20260709 12:14:02.122211  3192 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:02.122630  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:02.126822  3191 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.127807  3925 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:02.131629  3188 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:02.136705  3184 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:02.127384  5427 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:02.148023  3340 raft_consensus.cc:1240] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:02.148557  3191 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
W20260709 12:14:02.148823  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.147123  5427 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:02.147616  3187 raft_consensus.cc:1240] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:02.143127  5340 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:02.232142  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 70721.1us
I20260709 12:14:02.147791  5525 consensus_queue.cc:1059] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:14:02.236425  3157 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:02.241982  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 186335us
I20260709 12:14:02.234972  5290 consensus_queue.cc:1048] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:14:02.235162  5378 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.248008  5378 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:02.248787  5340 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:02.250073  5378 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:02.252262  3895 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:02.253302  5350 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:02.253551  5443 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:02.234375  5514 consensus_queue.cc:1048] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:14:02.257223  5401 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:02.257561  5558 log.cc:927] Time spent T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.308s	user 0.000s	sys 0.002s
I20260709 12:14:02.257822  5401 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:02.260706  5401 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:02.266564  3190 raft_consensus.cc:1240] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:14:02.266767  3264 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:02.270396  3925 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:02.271988  5563 log.cc:927] Time spent T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.311s	user 0.000s	sys 0.004s
I20260709 12:14:02.273424  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:02.274006  5301 raft_consensus.cc:3055] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:02.274418  5301 raft_consensus.cc:740] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:02.271981  5565 raft_consensus.cc:3055] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:02.275362  5301 consensus_queue.cc:260] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:02.276264  5565 raft_consensus.cc:740] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:02.276790  5301 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.277379  5565 consensus_queue.cc:260] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:02.279057  5565 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:02.283900  5296 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.284560  3335 raft_consensus.cc:1240] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:02.284504  5296 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:02.286986  5296 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:02.309903  5296 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:14:02.310312  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 74072.7us
I20260709 12:14:02.310727  5484 raft_consensus.cc:3055] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:02.311137  5484 raft_consensus.cc:740] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:02.311295  5290 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.311743  3157 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:02.311978  5484 consensus_queue.cc:260] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:02.312958  3232 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:02.313272  5484 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:02.310442  5401 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:02.313832  5378 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.275709  3156 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:02.318709  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 232955us
W20260709 12:14:02.319919  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 262989us
I20260709 12:14:02.324486  5520 raft_consensus.cc:993] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:14:02.321141  5514 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:02.325981  5350 consensus_queue.cc:1059] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:02.326908  5350 raft_consensus.cc:3055] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:02.327250  5350 raft_consensus.cc:740] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:02.333060  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:02.334976  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:02.335705  3342 raft_consensus.cc:2393] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:14:02.338337  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 107934us
I20260709 12:14:02.341109  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:02.345566  5350 consensus_queue.cc:260] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:02.346662  5301 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:02.348235  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.348453  5294 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.349366  5505 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:02.350281  3156 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:02.355206  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 43517.4us
I20260709 12:14:02.362790  3157 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:02.359629  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 46796us
I20260709 12:14:02.357587  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:02.364499  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:02.355930  5442 raft_consensus.cc:1081] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:14:02.367199  3264 raft_consensus.cc:1240] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:02.371546  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:02.361073  5301 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:02.352066  5366 consensus_queue.cc:1059] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:14:02.414044  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:02.429373  3335 raft_consensus.cc:2410] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:14:02.420109  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 57427.6us
I20260709 12:14:02.425982  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:02.428301  3895 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:02.440654  5296 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:14:02.485170  3259 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:02.486694  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:02.488965  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 116587us
W20260709 12:14:02.494141  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.514055  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:02.368722  5514 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:02.504914  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:02.505852  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 77638.9us
I20260709 12:14:02.367159  5294 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:02.425153  5425 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.535290  5222 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:02.536157  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:02.536762  3335 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.426601  5301 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.515231  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:02.524506  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:02.539225  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:02.539876  3334 raft_consensus.cc:2368] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7.
W20260709 12:14:02.532826  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 99937.9us
I20260709 12:14:02.552973  3193 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:02.560889  3231 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:02.562114  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:02.567997  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.570130  3188 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:02.576660  5582 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:02.577935  3157 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:02.560029  5514 raft_consensus.cc:697] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:02.580061  5588 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.581799  3334 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:14:02.538832  5350 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:02.549166  5586 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.624239  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:02.629011  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 196440us
I20260709 12:14:02.634262  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:02.602490  5290 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:02.626479  5582 raft_consensus.cc:697] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
W20260709 12:14:02.665256  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.672057  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:02.674063  5290 consensus_queue.cc:1059] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:02.632004  5569 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:02.692080  3335 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:02.630065  5588 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:02.660162  5296 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:02.718951  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:02.724712  3335 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:02.646420  5586 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:02.729383  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.693406  5230 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:02.746287  3334 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:14:02.746505  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 111009us
W20260709 12:14:02.755398  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 104395us
I20260709 12:14:02.690796  5569 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:02.729890  5340 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:02.766026  5578 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.766466  3262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:40120
I20260709 12:14:02.767220  3262 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:02.766860  5578 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:02.767654  3262 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.769734  5578 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:02.770390  5585 log.cc:927] Time spent T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:14:02.775943  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:02.679067  5514 consensus_queue.cc:237] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:02.791958  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 211406us
W20260709 12:14:02.796314  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 235401us
I20260709 12:14:02.804814  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:02.764541  5505 raft_consensus.cc:3055] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:02.821779  3339 raft_consensus.cc:1240] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:02.824208  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:02.835034  5588 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:02.691222  5582 consensus_queue.cc:237] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:02.788098  5340 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:02.866158  5569 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:02.819568  3338 raft_consensus.cc:1275] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:02.824681  5586 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:02.825899  5378 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:02.740216  5296 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:02.823621  3341 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:14:02.890175  3341 pending_rounds.cc:85] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 3
I20260709 12:14:02.818471  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:02.890385  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:02.868311  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:02.862557  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:02.814373  3231 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:02.794175  5294 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:02.817196  3334 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:02.890496  3341 pending_rounds.cc:107] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 12:14:02.897907  3341 raft_consensus.cc:2917] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 12:14:02.897873  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:02.874568  5578 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:02.898536  3341 raft_consensus.cc:2889] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:02.898775  3334 raft_consensus.cc:2410] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:02.899159  5296 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:02.899976  5296 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.900063  3341 raft_consensus.cc:1240] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:14:02.855770  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:02.900482  5296 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:02.857396  3923 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:02.857260  5406 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:02.858804  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:02.880283  3335 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:02.804999  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:02.886274  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:02.820748  5505 raft_consensus.cc:740] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:02.829442  5535 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.903680  3337 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
W20260709 12:14:02.907964  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 93698.9us
I20260709 12:14:02.909919  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:02.912416  3929 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:02.914023  3231 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:02.889703  5378 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:02.907845  5577 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 12:14:02.959648  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 73747.3us
I20260709 12:14:02.901365  5301 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:02.962458  3232 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:02.902720  5603 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.902700  5296 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:02.988724  3231 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:02.952322  5586 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.997437  3157 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:02.999699  5603 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:03.000982  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.955973  5425 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.026903  3231 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:03.027318  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 164848us
I20260709 12:14:02.988437  5378 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:03.033792  3188 raft_consensus.cc:1240] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:02.898747  5578 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:02.892020  5605 consensus_queue.cc:1059] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 12:14:03.043370  3305 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:03.046375  3157 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:03.045871  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:03.047644  3338 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:03.048552  5565 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.048790  3305 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:03.050202  3305 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:02.958077  5535 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.000258  5505 consensus_queue.cc:260] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.032136  5401 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:03.112910  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 60916.2us
I20260709 12:14:03.035400  5514 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.132992  5401 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.157094  5401 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.133404  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:03.046345  5296 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:03.160104  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 113830us
I20260709 12:14:03.103798  5485 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:03.106251  5565 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.136870  3262 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.207496  5583 raft_consensus.cc:3055] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:03.208037  5583 raft_consensus.cc:740] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:03.209278  3262 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:03.209113  5583 consensus_queue.cc:260] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.213809  5604 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.174s
I20260709 12:14:03.215674  5605 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.215739  5608 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.216536  5608 raft_consensus.cc:697] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:03.217043  5513 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:03.217638  5513 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.217674  5608 consensus_queue.cc:237] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.219815  5591 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.220476  5591 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.221860  5578 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:03.221810  5598 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:03.222581  5598 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:03.222839  5340 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:03.223021  5598 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:03.229363  5617 log.cc:927] Time spent T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:14:03.152172  5603 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:03.159591  5614 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:14:03.190774  5294 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:03.232473  5294 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:03.253283  5578 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.253914  5578 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.254547  5401 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.256018  5513 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:03.256134  5578 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:03.260919  5378 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.158556  5425 consensus_queue.cc:1048] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:14:03.266278  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:03.266497  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:03.232967  5294 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:03.133144  5538 consensus_queue.cc:1059] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:14:03.274331  3929 raft_consensus.cc:2393] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 8: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
W20260709 12:14:03.302171  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 252896us
I20260709 12:14:03.244064  5586 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:03.311528  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 178151us
I20260709 12:14:03.321031  3305 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:03.322657  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:03.279500  5378 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:03.329232  3305 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:03.309768  5290 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.335600  5565 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.340898  5565 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:03.341423  5606 log.cc:927] Time spent T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:14:03.343101  5565 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:03.352346  5601 log.cc:927] Time spent T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:14:03.352648  5565 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:03.331957  5578 raft_consensus.cc:2804] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:03.353271  5578 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.353626  5578 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.354413  5583 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.346697  5598 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.348403  5340 raft_consensus.cc:3055] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:03.355749  5340 raft_consensus.cc:740] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:14:03.356354  5350 consensus_meta.cc:287] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.729s	user 0.004s	sys 0.008s
I20260709 12:14:03.319603  5586 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.357255  5586 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:03.356824  5340 consensus_queue.cc:260] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.358086  5340 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:03.351275  5590 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.450s	user 0.000s	sys 0.001s
I20260709 12:14:03.358924  5290 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.329567  5614 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.359901  5614 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.351802  5592 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 12:14:03.360539  3333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 543) took 1324 ms. Trace:
I20260709 12:14:03.330205  5538 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:03.362471  5624 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
W20260709 12:14:03.369091  3340 consensus_meta.cc:287] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.002s
I20260709 12:14:03.369532  3340 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:03.362409  3333 rpcz_store.cc:276] 0709 12:14:02.036482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.036671 (+   189us) service_pool.cc:224] Handling call
0709 12:14:02.045053 (+  8382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:02.318690 (+273637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:02.318725 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:02.320553 (+  1828us) log.cc:844] Serialized 26 byte log entry
0709 12:14:02.650710 (+330157us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:02.650748 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.650807 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.360302 (+709495us) raft_consensus.cc:1685] finished
0709 12:14:03.360322 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.360458 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73090,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":9925,"thread_start_us":581705,"threads_started":2,"wal-append.queue_time_us":429517}
I20260709 12:14:03.364601  5222 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.367935  5624 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:03.389464  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.390170  5614 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:03.396569  5594 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.397166  5594 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.353289  5565 raft_consensus.cc:697] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:03.401602  5565 consensus_queue.cc:237] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.400511  5598 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:03.367085  5301 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:03.406491  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 373814us
I20260709 12:14:03.407470  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:03.408975  3231 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:03.410811  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:03.412009  3232 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:03.383821  5230 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:03.416924  3232 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:03.418303  3232 leader_election.cc:400] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7.
I20260709 12:14:03.418977  3232 leader_election.cc:403] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:14:03.425383  3231 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:03.432343  3232 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:03.406858  5222 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.433539  5513 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7.
I20260709 12:14:03.435581  3232 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:03.448709  5513 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:03.449097  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:03.442921  3231 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:03.450044  5599 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:03.450598  5222 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:03.450193  5513 raft_consensus.cc:3055] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:03.441777  5591 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:03.451146  5599 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:03.451277  5513 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:03.452747  5513 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.453990  5591 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.455631  5602 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.443490  5578 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:03.454818  3231 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:03.456341  5513 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:03.457163  5401 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:03.457406  5602 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:03.447706  5597 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:03.455477  3232 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:03.460461  3305 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:03.424778  5230 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:03.464006  3305 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:03.429116  5378 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.415210  5535 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:03.466768  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:03.428718  5598 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.458601  5296 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:03.434695  5594 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:03.513027  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:03.516880  3189 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.463066  5602 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.515758  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:03.443006  5626 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.541445  3186 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:03.464214  5597 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:03.545679  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:03.545538  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:03.546077  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 59447.7us
I20260709 12:14:03.549362  3185 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.463194  5591 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:14:03.539516  5340 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.467101  5301 consensus_queue.cc:1059] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:14:03.565131  3262 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:03.556995  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:03.571640  5631 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.572086  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:03.572142  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:03.573105  3265 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:03.573400  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:03.574350  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:03.574779  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:03.575613  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 120217us
I20260709 12:14:03.576728  3186 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:03.577329  3232 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:03.577883  3189 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:03.582540  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:03.583644  3334 raft_consensus.cc:2393] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:03.585119  3342 raft_consensus.cc:1240] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:03.550513  5597 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:03.551718  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:03.546649  5602 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.592392  3232 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:03.550288  5401 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:03.590411  5631 consensus_queue.cc:1059] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:14:03.551833  5594 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:03.545095  5538 consensus_queue.cc:1048] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:14:03.550086  5583 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:14:03.565270  5598 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:03.556592  5296 raft_consensus.cc:697] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:14:03.599623  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 426034us
I20260709 12:14:03.589771  5626 raft_consensus.cc:697] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:03.603358  3157 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:03.564586  5350 consensus_queue.cc:1059] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:14:03.588083  5378 consensus_queue.cc:1059] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
W20260709 12:14:03.616444  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.601923  5406 raft_consensus.cc:3055] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:03.601419  5632 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:03.698549  5632 raft_consensus.cc:697] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:03.699445  5632 consensus_queue.cc:237] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:03.701774  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:03.637598  5622 log.cc:927] Time spent T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:14:03.616392  5610 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:03.641857  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:03.609027  5598 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.703476  5610 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.705535  5598 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:03.706404  5610 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:03.649513  3259 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:03.645756  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:03.708359  3187 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:03.657414  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:03.657565  3926 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:03.659552  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:03.710711  3931 raft_consensus.cc:3055] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:03.711095  3931 raft_consensus.cc:740] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:03.614622  5301 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:03.669564  5595 log.cc:927] Time spent T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.411s	user 0.003s	sys 0.002s
I20260709 12:14:03.598489  5401 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.672855  5296 consensus_queue.cc:237] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.675921  3340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58568 (request call id 1961) took 1312 ms. Trace:
I20260709 12:14:03.729642  3340 rpcz_store.cc:276] 0709 12:14:02.363960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.364087 (+   127us) service_pool.cc:224] Handling call
0709 12:14:03.675698 (+1311611us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400164ed4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:03.675827 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672177536}
I20260709 12:14:03.677367  5626 consensus_queue.cc:237] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.678571  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:03.734979  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 56517.9us
I20260709 12:14:03.735919  3305 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:03.683734  5340 consensus_queue.cc:1059] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:03.685207  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.726969  3185 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:03.621371  5406 raft_consensus.cc:740] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:03.688776  5505 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.691641  5624 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:03.692591  5442 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.693200  5443 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:03.693396  5520 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.693648  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:03.693192  5294 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.695246  5222 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.696869  5588 raft_consensus.cc:3055] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:03.697736  5631 raft_consensus.cc:3055] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:03.605373  5599 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.703609  3268 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.653774  5290 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:03.716434  3231 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:03.744956  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 137826us
W20260709 12:14:03.746942  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.712064  3931 consensus_queue.cc:260] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.720285  5301 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.763927  3265 raft_consensus.cc:2410] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:03.767786  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:03.767709  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:03.769029  5222 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.796756  3263 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:03.768958  5406 consensus_queue.cc:260] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.769961  5588 raft_consensus.cc:740] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:03.770377  5631 raft_consensus.cc:740] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:03.771462  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:03.772231  5401 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:03.773428  5586 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:03.774103  5294 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:03.788169  3931 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:03.794448  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 98061.9us
I20260709 12:14:03.867512  3231 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:03.749328  5350 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:03.748977  5593 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.749629  5583 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.820094  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:03.820447  3186 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:03.820165  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:03.803624  5569 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:03.821666  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:03.823901  3157 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:03.878005  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 54239.6us
I20260709 12:14:03.848974  5582 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:03.805439  5301 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:03.863649  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:03.760118  5442 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.869917  3231 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:03.870088  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:03.890095  3261 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:03.890139  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:03.813690  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 399801us
I20260709 12:14:03.891997  3231 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:03.893196  3231 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:03.816267  5598 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:03.875221  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:03.779068  5520 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.820899  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:03.864202  3260 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.301s	user 0.015s	sys 0.018s
I20260709 12:14:03.874363  5350 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.896126  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:03.779696  5443 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.872056  5401 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:03.899720  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:03.899988  3334 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:14:03.904973  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 315565us
I20260709 12:14:03.919562  3262 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:03.906064  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:03.921202  3336 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:03.903764  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:03.899457  3260 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.336s	user 0.016s	sys 0.018s
I20260709 12:14:03.905378  3929 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:03.906373  3340 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:03.879591  5594 raft_consensus.cc:3055] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:03.883003  5624 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.920042  3261 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:03.922638  3232 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:03.884125  5565 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:03.927680  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:03.897413  5598 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.899170  5378 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.903843  5599 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:03.947739  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.930718  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:03.956210  3333 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:03.905572  5615 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:03.918869  5350 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:03.881620  5593 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.960527  3333 raft_consensus.cc:1240] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:03.963207  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:03.963856  3336 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:03.906831  5401 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.883744  5569 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.967952  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:03.925865  5594 raft_consensus.cc:740] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:03.962453  3266 raft_consensus.cc:1240] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:03.963011  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:03.968896  3334 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:03.964359  3232 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:03.960973  3340 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:14:03.886266  5582 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:03.976706  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:03.977500  3185 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:03.954332  5598 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:03.985450  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:03.987891  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:03.988458  5638 log.cc:927] Time spent T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:14:03.989037  3927 raft_consensus.cc:2393] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 4: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:03.989714  5578 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:03.991866  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:03.992580  3340 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:03.993115  5520 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:03.994540  5222 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:03.994870  5582 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:03.995533  5615 raft_consensus.cc:697] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:03.996622  5615 consensus_queue.cc:237] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:04.001111  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.002777  3193 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:04.003221  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:03.959635  5599 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:04.002249  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:04.009604  3334 raft_consensus.cc:2368] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8.
W20260709 12:14:04.012636  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 48543.5us
I20260709 12:14:03.930414  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:03.973549  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:04.009711  3157 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:04.016477  3264 raft_consensus.cc:2393] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:03.972360  5401 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.968287  5378 raft_consensus.cc:697] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:04.020620  3157 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:04.077181  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 56621.1us
I20260709 12:14:04.078102  3157 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:03.962564  5565 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.002959  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:04.011861  5599 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.971467  5632 consensus_queue.cc:1059] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:14:03.931613  5588 consensus_queue.cc:260] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:04.106487  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:04.099565  5643 log.cc:927] Time spent T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:14:04.103816  5604 consensus_queue.cc:1059] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:04.025467  5591 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:04.076846  5525 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:04.071003  5513 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:04.079730  5296 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:04.082178  5637 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:04.136406  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:04.137207  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:04.132682  5525 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:04.138290  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.138531  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:04.139323  5645 log.cc:927] Time spent T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 12:14:04.139799  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:04.132117  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:04.162636  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:04.120935  5597 consensus_meta.cc:287] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
I20260709 12:14:04.129415  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:04.166353  3339 raft_consensus.cc:2393] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:04.125811  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:04.025274  5614 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:14:04.106917  5608 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:04.149134  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:04.152931  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:04.151829  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 247352us
I20260709 12:14:04.118333  5605 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.155543  3336 raft_consensus.cc:2393] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:04.157223  5624 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:04.096936  5290 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:04.162489  3930 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:04.169031  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:04.172363  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:04.152002  5637 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.147354  5591 raft_consensus.cc:697] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:04.116798  5610 consensus_queue.cc:1059] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:14:04.158406  5525 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:04.154961  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:04.175657  3337 raft_consensus.cc:2376] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6. Re-sending same reply.
I20260709 12:14:04.159621  5586 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:04.151415  5513 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.469484  3340 raft_consensus.cc:2393] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:04.170954  3924 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:04.164997  5296 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:04.471233  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:04.464216  3931 consensus_meta.cc:287] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.000s
I20260709 12:14:04.505939  3931 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:04.392822  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:04.244609  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:04.474841  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 319912us
W20260709 12:14:04.475139  3268 consensus_meta.cc:287] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.004s
I20260709 12:14:04.150528  5594 consensus_queue.cc:260] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:04.399096  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:04.541481  3189 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:04.541668  3268 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:04.586604  3268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56754 (request call id 1440) took 1038 ms. Trace:
I20260709 12:14:04.589048  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56754 (request call id 1448) took 1035 ms. Trace:
I20260709 12:14:04.173986  5597 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:04.398048  3259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 456) took 1630 ms. Trace:
I20260709 12:14:04.543272  3305 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:04.585309  3336 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:04.377427  5443 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:04.589479  3262 rpcz_store.cc:276] 0709 12:14:03.553471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.571715 (+ 18244us) service_pool.cc:224] Handling call
0709 12:14:04.588827 (+1017112us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54003d31d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:04.588993 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770354176}
I20260709 12:14:04.587128  3268 rpcz_store.cc:276] 0709 12:14:03.547857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.548477 (+   620us) service_pool.cc:224] Handling call
0709 12:14:03.641680 (+ 93203us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b58001c3898. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:04.586524 (+944844us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5501184}
I20260709 12:14:04.474009  5614 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:04.480783  5590 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:14:04.456403  5569 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:04.597182  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:04.618284  3264 raft_consensus.cc:1240] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:04.480788  5340 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:04.541774  5230 consensus_meta.cc:287] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 1.072s	user 0.006s	sys 0.006s
I20260709 12:14:04.183780  5290 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.579121  5632 raft_consensus.cc:3055] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:04.512363  5538 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:04.581728  5626 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:04.587692  5654 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.182278  5624 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:04.578096  5296 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:04.607322  5301 consensus_meta.cc:287] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.704s	user 0.007s	sys 0.004s
I20260709 12:14:04.540349  5637 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:04.174556  5378 consensus_queue.cc:237] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.626530  5593 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:04.638679  5290 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:04.649660  5660 consensus_queue.cc:1059] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 12:14:04.650239  5658 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.292s	user 0.000s	sys 0.000s
I20260709 12:14:04.651120  3189 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:04.642045  5565 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:04.638229  5632 raft_consensus.cc:740] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:04.641326  5538 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.643332  5610 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:04.652704  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:04.671594  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.653982  5624 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:04.700310  5513 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:04.185258  5605 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:04.704269  5513 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:04.704342  3268 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:04.705117  5513 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.707001  5605 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:04.707896  5513 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:04.640350  5340 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:04.641894  5230 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:04.666095  5296 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:04.684607  5593 raft_consensus.cc:3055] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:04.638608  5614 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.626968  5591 consensus_queue.cc:237] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:04.712034  5602 consensus_meta.cc:287] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 1.114s	user 0.014s	sys 0.000s
I20260709 12:14:04.654220  5626 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.608443  3259 rpcz_store.cc:276] 0709 12:14:02.761347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.763936 (+  2589us) service_pool.cc:224] Handling call
0709 12:14:02.767376 (+  3440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.707549 (+940173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.256541 (+548992us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b54003f07d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:04.391522 (+134981us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2028183808}
I20260709 12:14:04.696873  5565 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:04.708926  5538 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:04.664716  5301 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:04.747738  3188 raft_consensus.cc:2393] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:04.749699  3156 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.007s	sys 0.021s
W20260709 12:14:04.772825  3156 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.007s	sys 0.021s
I20260709 12:14:04.654479  5654 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:04.746172  5650 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:04.777805  5650 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:04.780103  5650 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:04.780463  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:04.781250  3339 raft_consensus.cc:2393] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:04.781371  3187 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:04.782588  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:04.736584  5593 raft_consensus.cc:740] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:04.783397  3336 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:04.783941  5593 consensus_queue.cc:260] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.785145  5593 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:04.773239  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 230056us
W20260709 12:14:04.748171  5505 consensus_meta.cc:287] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 1.004s	user 0.009s	sys 0.002s
I20260709 12:14:04.788466  3259 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:04.775749  5647 log.cc:927] Time spent T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.538s	user 0.000s	sys 0.001s
I20260709 12:14:04.789255  3192 raft_consensus.cc:2410] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:14:04.789804  5663 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:04.790659  3259 raft_consensus.cc:1240] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:04.777271  5654 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:04.791204  3305 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:04.714051  5610 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.709818  5569 consensus_queue.cc:1059] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:14:04.776717  5442 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:04.792523  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:04.790340  5663 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.793509  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:04.772710  5648 log.cc:927] Time spent T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.439s	user 0.000s	sys 0.001s
I20260709 12:14:04.812899  3342 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:04.818672  3190 raft_consensus.cc:1240] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:04.819016  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:04.818567  5668 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:04.825155  5654 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:04.827037  5668 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.828037  5664 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:04.828563  5664 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.814306  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:04.829341  5668 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:04.830597  5664 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:04.831168  5653 log.cc:927] Time spent T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.557s	user 0.001s	sys 0.000s
I20260709 12:14:04.831218  5631 consensus_queue.cc:260] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:04.832445  5565 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:04.832604  5631 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.834431  5654 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:04.829385  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:04.836333  5669 log.cc:927] Time spent T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:14:04.837395  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 702) took 1039 ms. Trace:
W20260709 12:14:04.837874  5662 log.cc:927] Time spent T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:14:04.839659  3187 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:04.831876  5663 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:04.837801  3923 rpcz_store.cc:276] 0709 12:14:03.798573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.804269 (+  5696us) service_pool.cc:224] Handling call
0709 12:14:03.884610 (+ 80341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:04.080169 (+195559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.081197 (+  1028us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:04.168166 (+ 86969us) log.cc:844] Serialized 26 byte log entry
0709 12:14:04.587555 (+419389us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:04.606779 (+ 19224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.620258 (+ 13479us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:04.837151 (+216893us) raft_consensus.cc:1685] finished
0709 12:14:04.837177 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.837336 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46290,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":11425,"thread_start_us":508088,"threads_started":2,"wal-append.queue_time_us":462236}
I20260709 12:14:04.841295  3264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1895) took 1247 ms. Trace:
I20260709 12:14:04.842051  3264 rpcz_store.cc:276] 0709 12:14:03.594137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.582281 (+988144us) service_pool.cc:224] Handling call
0709 12:14:04.617780 (+ 35499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:04.629462 (+ 11682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.841083 (+211621us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b54001a2550. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:04.841202 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79433088}
I20260709 12:14:04.843612  3264 raft_consensus.cc:1240] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:04.844192  5535 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.844769  5535 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.845631  5593 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.846096  5593 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.846858  5535 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:04.848910  5603 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:04.852213  5667 log.cc:927] Time spent T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:14:04.855576  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.871400  3896 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:04.748804  5296 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.860853  5614 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:04.793939  5650 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:04.197873  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:04.753033  5632 consensus_queue.cc:260] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.890729  3896 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:04.881672  3157 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.009s	sys 0.014s
W20260709 12:14:04.893623  3157 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.009s	sys 0.015s
W20260709 12:14:04.894308  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 795110us
I20260709 12:14:04.896524  3157 leader_election.cc:400] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8.
I20260709 12:14:04.896919  3157 leader_election.cc:403] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:14:04.894326  3896 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:04.874161  5597 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:04.749207  5602 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:04.878394  3159 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.008s	sys 0.007s
I20260709 12:14:04.901901  5443 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:04.899662  5582 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:04.870638  5442 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:14:04.906523  4995 raft_consensus.cc:3055] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:04.882582  5520 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:04.909893  3159 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.009s	sys 0.008s
W20260709 12:14:04.909132  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 78631.7us
I20260709 12:14:04.866237  3232 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:04.916285  3190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40510 (request call id 1824) took 1215 ms. Trace:
W20260709 12:14:04.923651  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:04.924049  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.925601  3267 raft_consensus.cc:1240] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:04.926057  3157 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:04.923872  3190 rpcz_store.cc:276] 0709 12:14:03.696837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.697733 (+   896us) service_pool.cc:224] Handling call
0709 12:14:03.698117 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:04.819059 (+1120942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.911989 (+ 92930us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003e0b54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:04.912178 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2573678848}
I20260709 12:14:04.882262  5603 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.933526  3187 raft_consensus.cc:1240] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:04.913861  5443 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:04.942942  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 76822.1us
I20260709 12:14:04.944535  3232 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:04.938758  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:04.916713  5632 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:04.916663  5582 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.945793  3187 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:04.927578  5520 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.947630  5683 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:04.926163  4995 raft_consensus.cc:740] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:04.951087  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:04.952576  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:04.959708  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:04.959995  3264 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:14:04.960147  3187 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
I20260709 12:14:04.928794  5565 raft_consensus.cc:697] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:04.954016  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:04.946174  5597 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:04.952862  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.940367  5230 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:04.945585  5604 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.961900  3334 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:04.943652  5443 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:04.951886  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 48757.1us
I20260709 12:14:04.944175  5535 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.954931  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1903) took 1035 ms. Trace:
I20260709 12:14:04.963002  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:04.963908  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:04.965062  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.957960  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:04.939939  5684 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8.
I20260709 12:14:04.967368  5682 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.969080  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:04.971287  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:04.972259  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:04.956532  5520 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.965605  5301 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:04.948411  5505 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:04.997552  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:04.983546  3187 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:04.990358  5691 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:04.991720  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:04.998224  3263 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:04.992986  3334 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:04.952692  5582 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.952131  5685 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:04.980633  3262 rpcz_store.cc:276] 0709 12:14:03.919585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.633133 (+713548us) service_pool.cc:224] Handling call
0709 12:14:04.633450 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.633663 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:04.863302 (+229639us) log.cc:844] Serialized 14 byte log entry
0709 12:14:04.954453 (+ 91151us) log.cc:844] Serialized 14 byte log entry
0709 12:14:04.954607 (+   154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:04.954653 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:04.954700 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.954774 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.954875 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":265725,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":109,"raft.queue_time_us":2550,"raft.run_wall_time_us":2232,"spinlock_wait_cycles":41520256,"thread_start_us":304670,"threads_started":2}
I20260709 12:14:04.995479  3336 raft_consensus.cc:2393] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:05.007040  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:05.008384  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:05.002897  3895 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:05.010280  5692 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:04.966176  5626 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:05.015843  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:05.015928  5682 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.016631  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:04.957690  5687 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:05.010845  5692 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:04.996757  5610 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:04.997722  5683 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:05.012161  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:04.957192  4995 consensus_queue.cc:260] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.991624  5535 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.033034  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:05.012928  5505 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:04.989270  5604 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:05.308574  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.080147  3190 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:14:05.718055  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 715230us
W20260709 12:14:05.721839  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.151124  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.723124  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.728984  4995 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:05.732527  3342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.001s	sys 0.012s
W20260709 12:14:05.733058  3342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.001s	sys 0.012s
I20260709 12:14:05.757937  5696 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:05.758602  5696 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.080086  5593 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:05.469280  5525 consensus_meta.cc:287] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.965s	user 0.012s	sys 0.000s
W20260709 12:14:05.636410  5598 consensus_meta.cc:287] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 1.617s	user 0.009s	sys 0.003s
W20260709 12:14:05.462715  5690 log.cc:927] Time spent T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.347s	user 0.000s	sys 0.000s
I20260709 12:14:05.033844  5692 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:05.342125  5637 consensus_meta.cc:287] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.664s	user 0.006s	sys 0.003s
W20260709 12:14:05.609233  5695 log.cc:927] Time spent T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 12:14:05.638399  5350 consensus_meta.cc:287] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 1.559s	user 0.009s	sys 0.003s
W20260709 12:14:05.644076  5443 consensus_meta.cc:287] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.000s
W20260709 12:14:05.637859  5631 consensus_meta.cc:287] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.805s	user 0.010s	sys 0.002s
W20260709 12:14:05.614014  5401 consensus_meta.cc:287] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 1.534s	user 0.013s	sys 0.000s
W20260709 12:14:05.706725  5599 consensus_meta.cc:287] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 1.581s	user 0.010s	sys 0.003s
W20260709 12:14:05.641530  5538 consensus_meta.cc:287] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.836s	user 0.008s	sys 0.001s
I20260709 12:14:05.115744  5378 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.092445  5626 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:05.768363  5624 consensus_meta.cc:287] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 1.070s	user 0.019s	sys 0.008s
I20260709 12:14:05.478886  5602 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:05.408519  5680 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:05.337464  5442 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:05.136590  5597 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:05.734827  5296 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:05.733204  5603 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:05.733769  5650 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:05.807487  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 351842us
W20260709 12:14:05.808116  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 623189us
I20260709 12:14:05.835893  3305 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:05.799506  5700 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:14:05.033924  5290 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:05.813844  3307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.010s	sys 0.011s
W20260709 12:14:05.838955  3307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.010s	sys 0.012s
I20260709 12:14:05.028570  5691 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:05.773505  5682 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:05.825605  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:05.827932  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:05.862052  3305 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:05.798381  5525 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.769418  5683 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:05.801684  5598 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.829823  5679 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:05.813448  5538 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.136965  5687 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:05.882706  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:05.807621  5637 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.893121  3333 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:05.815775  5378 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.894673  3333 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:05.885028  3185 raft_consensus.cc:2368] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7.
I20260709 12:14:05.135353  5565 consensus_queue.cc:237] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.810904  5599 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.808827  5443 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:05.809078  5350 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.886984  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:05.880157  3193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40494 (request call id 1565) took 2071 ms (client timeout 2102 ms). Trace:
W20260709 12:14:05.901504  3193 rpcz_store.cc:269] 0709 12:14:03.802001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.948046 (+146045us) service_pool.cc:224] Handling call
0709 12:14:05.872629 (+1924583us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b54000e56d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:05.873027 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66236672}
I20260709 12:14:05.871052  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:05.902582  3337 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
W20260709 12:14:05.890477  3929 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37962 (request call id 467) took 2231 ms (client timeout 2102 ms). Trace:
I20260709 12:14:05.891098  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:05.903702  3339 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
W20260709 12:14:05.903330  3929 rpcz_store.cc:269] 0709 12:14:03.656863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.657120 (+   257us) service_pool.cc:224] Handling call
0709 12:14:05.888191 (+2231071us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54004ef554. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:05.888317 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450217216}
W20260709 12:14:05.841945  5582 consensus_meta.cc:287] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.820s	user 0.009s	sys 0.003s
I20260709 12:14:05.818626  5624 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:05.811022  5401 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.819846  5626 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.836766  5631 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:05.822177  5699 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.943060  5703 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:05.911947  3184 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:05.912205  5294 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.943851  5703 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:05.913064  5632 consensus_meta.cc:287] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.960s	user 0.009s	sys 0.003s
W20260709 12:14:05.914405  5657 log.cc:927] Time spent T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 1.820s	user 0.025s	sys 0.033s
I20260709 12:14:05.949925  3264 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:05.867751  5650 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.894187  5702 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:05.940264  3335 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:05.952133  3265 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:05.832953  5442 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:05.909134  3341 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:05.947919  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:05.826922  5680 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:05.944280  5703 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:05.929731  5582 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:05.839103  5597 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:05.944306  5294 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:05.945935  5520 consensus_meta.cc:287] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.933s	user 0.009s	sys 0.002s
W20260709 12:14:05.958638  3186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40494 (request call id 1564) took 2157 ms (client timeout 1944 ms). Trace:
I20260709 12:14:05.965972  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 701) took 2168 ms. Trace:
I20260709 12:14:05.969839  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:05.969528  3186 rpcz_store.cc:269] 0709 12:14:03.801659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.885207 (+ 83548us) service_pool.cc:224] Handling call
0709 12:14:05.947758 (+2062551us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b5800002a98. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:05.958525 (+ 10767us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2889472}
I20260709 12:14:05.970053  3932 rpcz_store.cc:276] 0709 12:14:03.792600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.804065 (+ 11465us) service_pool.cc:224] Handling call
0709 12:14:03.856629 (+ 52564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.863361 (+  6732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:03.863397 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:03.869807 (+  6410us) log.cc:844] Serialized 26 byte log entry
0709 12:14:04.098557 (+228750us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:04.098594 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.098672 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.913833 (+1815161us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:05.956266 (+ 42433us) raft_consensus.cc:1685] finished
0709 12:14:05.956287 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.961151 (+  4864us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6311,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6960,"spinlock_wait_cycles":6306176,"thread_start_us":173464,"threads_started":1,"wal-append.queue_time_us":210577}
I20260709 12:14:05.977126  3232 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:05.959959  5505 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:05.974854  5670 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:05.957455  5708 raft_consensus.cc:2804] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:05.946367  5631 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:05.980652  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 118729us
I20260709 12:14:05.961236  5485 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:05.982527  5582 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:05.894538  5679 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:05.968075  5296 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.991256  5680 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:05.992290  3186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47276 (request call id 327) took 1036 ms. Trace:
I20260709 12:14:06.005390  3186 rpcz_store.cc:276] 0709 12:14:04.955752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.979989 (+1024237us) service_pool.cc:224] Handling call
0709 12:14:05.991756 (+ 11767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.991947 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:05.991975 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:05.992019 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:05.992063 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.992117 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.992230 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:05.993767  5442 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:05.986464  5708 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:06.007938  5708 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:05.955550  5702 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.009353  3340 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:05.994787  5597 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:05.968585  5696 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.010548  5696 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.011132  5696 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.002779  3232 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:05.970171  5604 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.007112  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:06.015893  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:06.017215  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:06.017875  3340 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:06.018450  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:06.019649  3186 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:06.021139  3186 raft_consensus.cc:1275] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:06.024641  3186 raft_consensus.cc:1275] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:06.025309  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.987453  5525 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:05.951234  5699 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:06.047685  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 44976.5us
I20260709 12:14:06.049961  3232 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:05.975461  5520 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.053673  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:06.056118  3338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 557) took 2137 ms. Trace:
I20260709 12:14:06.032037  5670 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:06.064343  3190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47276 (request call id 320) took 1124 ms. Trace:
I20260709 12:14:06.069576  3190 rpcz_store.cc:276] 0709 12:14:04.939664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.763906 (+824242us) service_pool.cc:224] Handling call
0709 12:14:05.795378 (+ 31472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.797493 (+  2115us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:05.971314 (+173821us) log.cc:844] Serialized 14 byte log entry
0709 12:14:06.063981 (+ 92667us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:06.064043 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:06.064104 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.064164 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.064284 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11064,"thread_start_us":244943,"threads_started":2}
I20260709 12:14:06.080926  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:06.064612  3338 rpcz_store.cc:276] 0709 12:14:03.919494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.919761 (+   267us) service_pool.cc:224] Handling call
0709 12:14:03.931364 (+ 11603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.144549 (+213185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.144581 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:04.144622 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:04.144652 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.052270 (+1907618us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54000eef54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:06.052326 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.056030 (+  3704us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489793792}
I20260709 12:14:06.084787  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:06.085875  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:06.046417  5290 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.035961  5682 consensus_queue.cc:1059] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:14:06.002311  5485 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.057850  5680 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:06.032044  5296 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.036765  5603 consensus_queue.cc:1059] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:14:06.096640  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:06.100538  3190 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.068575  5711 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:06.064061  5712 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:06.098620  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 55038.3us
I20260709 12:14:06.099143  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:06.108319  3186 raft_consensus.cc:1275] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:14:06.085844  5716 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:06.082813  5598 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.041177  5709 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:14:06.109565  3186 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:06.112115  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55426 (request call id 468) took 2094 ms. Trace:
I20260709 12:14:06.112696  3895 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:06.113560  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1575) took 1166 ms. Trace:
I20260709 12:14:06.088474  5294 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.116822  5668 raft_consensus.cc:3055] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:06.129612  3190 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:06.118418  5296 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.098811  5722 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:06.096276  5637 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.094059  5443 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.142608  3895 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:06.136183  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.143334  3191 rpcz_store.cc:276] 0709 12:14:04.946710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.814206 (+867496us) service_pool.cc:224] Handling call
0709 12:14:05.828527 (+ 14321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:05.828994 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:05.829036 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:05.875262 (+ 46226us) log.cc:844] Serialized 26 byte log entry
0709 12:14:05.996790 (+121528us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:05.996842 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.996929 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:06.113362 (+116433us) raft_consensus.cc:1685] finished
0709 12:14:06.113383 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.113504 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":9542,"thread_start_us":87601,"threads_started":1,"wal-append.queue_time_us":195804}
W20260709 12:14:06.147203  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 93608.2us
W20260709 12:14:06.147372  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.146569  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 96698.4us
I20260709 12:14:06.102800  5378 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.118661  5703 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.102376  5682 consensus_queue.cc:1243] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:06.141638  5350 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.108378  5401 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.107266  5538 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:06.167403  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.126801  5663 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:06.103706  5711 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:06.146672  4995 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:06.158422  3232 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:06.106462  5680 raft_consensus.cc:697] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:06.175765  5602 raft_consensus.cc:2804] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:06.175897  3232 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:06.176220  5602 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:06.176085  5680 consensus_queue.cc:237] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.176709  5602 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:06.179313  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:06.148090  5626 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.147876  5668 raft_consensus.cc:740] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:06.180631  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:06.180517  5668 consensus_queue.cc:260] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.181574  5668 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:06.181969  3342 raft_consensus.cc:3055] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:06.182332  3342 raft_consensus.cc:740] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:06.183068  3342 consensus_queue.cc:260] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.184000  3342 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.179466  5401 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:06.186065  5401 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:06.186574  5401 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.108229  5624 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:06.188091  3333 raft_consensus.cc:1275] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:06.194214  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:06.195163  5711 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.196472  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:06.198032  5679 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.119189  5708 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.198115  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:06.199904  5708 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:06.200049  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.200619  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.200953  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.154302  5683 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:06.205842  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:06.207232  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:06.208271  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:06.168179  5443 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:06.171303  5718 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.141961  5716 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.212093  5443 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.125149  5712 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:06.217756  5720 log.cc:927] Time spent T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:14:06.162040  5296 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:14:06.214062  5679 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:06.204741  5538 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.223019  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:06.201253  5663 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.220520  5443 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:06.226650  3333 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:14:06.212180  5708 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.144410  3926 rpcz_store.cc:276] 0709 12:14:04.017330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.111057 (+2093727us) service_pool.cc:224] Handling call
0709 12:14:06.111401 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.111641 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:06.111690 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:06.111753 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:06.111833 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.111916 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.112047 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:06.226207  3191 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:06.232721  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.234994  5485 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.236888  5340 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.225776  5679 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:06.219780  5718 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.231182  5520 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.230232  5538 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.234118  5631 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.155333  5722 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.255374  3191 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:06.253051  5727 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.244397  5679 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:06.256892  5727 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.269649  5712 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:06.270547  5538 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.233523  5708 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.224453  5692 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.282915  5722 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:06.284075  5721 log.cc:927] Time spent T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:14:06.307085  3268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1451) took 2406 ms. Trace:
I20260709 12:14:06.307574  3268 rpcz_store.cc:276] 0709 12:14:03.901105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.626593 (+725488us) service_pool.cc:224] Handling call
0709 12:14:04.626974 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.705864 (+ 78890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.306819 (+1600955us) spinlock_profiling.cc:243] Waited 76.9 ms on lock 0x7b54003d45d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:06.307014 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176954112}
I20260709 12:14:06.311102  5222 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:06.313616  5727 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:06.317031  5714 log.cc:927] Time spent T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
I20260709 12:14:06.274132  5401 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.317093  5535 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:06.334383  3264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40120 (request call id 463) took 1369 ms (client timeout 1570 ms). Trace:
W20260709 12:14:06.367555  3192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40494 (request call id 1556) took 2578 ms (client timeout 2124 ms). Trace:
W20260709 12:14:06.335237  3188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40494 (request call id 1558) took 2545 ms (client timeout 1567 ms). Trace:
W20260709 12:14:06.387382  3264 rpcz_store.cc:269] 0709 12:14:04.964617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.991480 (+ 26863us) service_pool.cc:224] Handling call
0709 12:14:06.334109 (+1342629us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b54003aa7d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:06.334250 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2187809152}
I20260709 12:14:06.331110  3267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1444) took 2778 ms. Trace:
W20260709 12:14:06.387671  3188 rpcz_store.cc:269] 0709 12:14:03.790131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.790278 (+   147us) service_pool.cc:224] Handling call
0709 12:14:06.334963 (+2544685us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b54000e5bd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:06.335131 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012625792}
W20260709 12:14:06.388236  3192 rpcz_store.cc:269] 0709 12:14:03.789419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.791525 (+  2106us) service_pool.cc:224] Handling call
0709 12:14:06.367285 (+2575760us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54002de6d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:06.367459 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105486976}
I20260709 12:14:06.388831  3267 rpcz_store.cc:276] 0709 12:14:03.552253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.554198 (+  1945us) service_pool.cc:224] Handling call
0709 12:14:03.575389 (+ 21191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.926002 (+1350613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.330734 (+1404732us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003a8ed4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:06.330994 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3104681344}
I20260709 12:14:06.317814  5425 raft_consensus.cc:3055] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:14:06.383117  5661 log.cc:927] Time spent T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 2.285s	user 0.006s	sys 0.016s
W20260709 12:14:06.383911  5583 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:14:06.322400  5711 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.390759  5718 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:06.318897  5222 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.336800  5663 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:06.448060  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 245114us
I20260709 12:14:06.421885  5602 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.423767  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1890) took 3901 ms. Trace:
W20260709 12:14:06.453982  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.404217  5425 raft_consensus.cc:740] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:06.425494  5679 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.416503  5718 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:06.368034  5703 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.432891  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:06.433666  3266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 467) took 1408 ms. Trace:
W20260709 12:14:06.434767  3335 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58568 (request call id 1990) took 2298 ms (client timeout 1775 ms). Trace:
I20260709 12:14:06.437140  3157 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:06.437798  3895 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:06.464816  3895 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:06.438311  3341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58568 (request call id 1991) took 2284 ms (client timeout 1798 ms). Trace:
W20260709 12:14:06.465842  3341 rpcz_store.cc:269] 0709 12:14:04.153729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.158496 (+  4767us) service_pool.cc:224] Handling call
0709 12:14:06.438124 (+2279628us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540035d9d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:06.438242 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3198003456}
I20260709 12:14:06.338089  5708 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.323318  5716 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:06.445472  3265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 1897) took 2843 ms (client timeout 1938 ms). Trace:
W20260709 12:14:06.325603  3184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40494 (request call id 1562) took 2534 ms (client timeout 3237 ms). Trace:
I20260709 12:14:06.393134  5406 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.419646  5711 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:06.477398  3265 rpcz_store.cc:269] 0709 12:14:03.599079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.879874 (+280795us) service_pool.cc:224] Handling call
0709 12:14:06.441842 (+2561968us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b54001e8554. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:06.441969 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4699234176}
I20260709 12:14:06.390799  5443 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:06.460353  5655 log.cc:927] Time spent T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 2.061s	user 0.018s	sys 0.025s
I20260709 12:14:06.486109  3192 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:06.452318  3260 rpcz_store.cc:276] 0709 12:14:02.522063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.522369 (+   306us) service_pool.cc:224] Handling call
0709 12:14:02.522730 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.922435 (+1399705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:03.922467 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:03.973095 (+ 50628us) log.cc:844] Serialized 26 byte log entry
0709 12:14:04.095319 (+122224us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:04.095380 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.095493 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:06.367985 (+2272492us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:06.423501 (+ 55516us) raft_consensus.cc:1685] finished
0709 12:14:06.423521 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.423701 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19270,"raft.queue_time_us":274142,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":54984,"spinlock_wait_cycles":23679744,"thread_start_us":1460801,"threads_started":2,"wal-append.queue_time_us":101760}
W20260709 12:14:06.462867  3335 rpcz_store.cc:269] 0709 12:14:04.136650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.152671 (+ 16021us) service_pool.cc:224] Handling call
0709 12:14:06.434536 (+2281865us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b5400033ed4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:06.434666 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4057439488}
I20260709 12:14:06.480674  5659 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:06.481066  4995 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:06.431207  5401 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:06.482285  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 45234us
I20260709 12:14:06.461655  3266 rpcz_store.cc:276] 0709 12:14:05.025405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.798861 (+773456us) service_pool.cc:224] Handling call
0709 12:14:05.799195 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.971134 (+171939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:05.971165 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:05.971205 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:05.971244 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.433437 (+462193us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54003d3bd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:06.433481 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.433607 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394933120}
W20260709 12:14:06.487610  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.476414  5685 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:06.493660  3895 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:06.495460  5739 log.cc:927] Time spent T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:14:06.482944  5718 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.497445  5687 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:06.476594  5583 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:06.500437  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 464) took 1514 ms. Trace:
I20260709 12:14:06.505487  3262 rpcz_store.cc:276] 0709 12:14:04.985919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.007172 (+ 21253us) service_pool.cc:224] Handling call
0709 12:14:05.007454 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.899345 (+891891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:05.899378 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:05.899421 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:05.899482 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.500169 (+600687us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54003d36d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:06.500214 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.500360 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050692352}
I20260709 12:14:06.504180  3157 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:06.481485  5602 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:06.506649  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:06.509585  3266 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.482105  5586 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:06.507867  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:06.483404  3184 rpcz_store.cc:269] 0709 12:14:03.800324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.975237 (+174913us) service_pool.cc:224] Handling call
0709 12:14:06.325304 (+2350067us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54002f4254. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:06.325499 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4116388224}
I20260709 12:14:06.513090  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:06.494213  5663 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:06.515743  3335 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:14:06.515841  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:06.514077  3267 raft_consensus.cc:1240] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:06.523049  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:06.523327  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:06.523919  3337 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:06.523974  3265 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:06.525259  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:06.526208  3337 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:06.527057  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:06.527773  3340 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:14:06.520871  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:06.530122  3335 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:06.532899  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:06.533512  3342 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:06.511957  5583 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.513506  5586 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.545627  3341 raft_consensus.cc:1240] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:06.546101  5583 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.546798  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:06.533052  5592 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:06.547382  3341 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:06.547716  5222 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.536682  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:06.553566  3266 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:06.548909  5718 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.548542  5592 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.519987  5514 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:06.566529  3341 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:14:06.555485  3342 raft_consensus.cc:1240] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:14:06.555706  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:06.512141  5484 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:06.561045  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:06.533138  5599 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.569748  3232 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:06.582428  3337 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:06.583698  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:06.583314  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:06.579941  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.555761  5602 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:06.546144  5586 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.516579  5425 consensus_queue.cc:260] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:06.585287  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:06.628510  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 134936us
I20260709 12:14:06.734341  3342 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.734902  3339 raft_consensus.cc:2393] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:06.678493  3336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 571) took 1660 ms. Trace:
I20260709 12:14:06.733306  5741 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:06.744990  3895 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:06.738116  3341 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
W20260709 12:14:06.754248  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 184561us
W20260709 12:14:06.586037  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.735642  3336 rpcz_store.cc:276] 0709 12:14:05.018106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.018223 (+   117us) service_pool.cc:224] Handling call
0709 12:14:05.719673 (+701450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:05.819011 (+ 99338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:05.819053 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:05.825930 (+  6877us) log.cc:844] Serialized 26 byte log entry
0709 12:14:06.418403 (+592473us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b18002fe4e0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4c2e07 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1aee16720b 00007f1aee16cd23 00007f1aee16d0d1 00007f1aee588a0f
0709 12:14:06.503500 (+ 85097us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:06.503540 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.503604 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:06.678183 (+174579us) raft_consensus.cc:1685] finished
0709 12:14:06.678202 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.678432 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122449,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":16471,"spinlock_wait_cycles":13129472,"thread_start_us":183636,"threads_started":2,"wal-append.queue_time_us":731345}
I20260709 12:14:06.736967  3157 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:06.763576  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.764225  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.565747  5685 raft_consensus.cc:2764] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:06.766261  3895 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:06.766872  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:06.763203  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:06.770280  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:06.770836  3336 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.553179  5663 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.770402  3157 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:06.570271  5514 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:06.770859  3339 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.698231  5610 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:06.663987  5651 log.cc:927] Time spent T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 2.529s	user 0.016s	sys 0.039s
I20260709 12:14:06.696372  5718 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.704823  5691 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:06.780992  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:06.696530  5679 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:06.790160  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:06.768767  5401 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:06.604910  5682 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:06.796362  3342 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:06.797435  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:06.628417  5290 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.633505  4995 raft_consensus.cc:697] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:06.677950  5608 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:06.633947  5637 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:06.769004  5624 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:06.582048  5680 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.200s
I20260709 12:14:06.682425  5592 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.780573  5514 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.765820  5602 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:06.769874  5603 consensus_queue.cc:1059] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:14:06.841495  3341 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:06.872898  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:06.873628  3341 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:06.789304  5659 raft_consensus.cc:697] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:06.795078  5294 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:06.785527  5733 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:06.774799  5484 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.831252  5685 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:06.795918  5682 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:06.845918  5624 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.844835  5608 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:06.844158  5691 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.788755  5610 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.831874  5401 raft_consensus.cc:697] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:06.874902  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:06.896970  3342 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:14:06.869388  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 99272.8us
I20260709 12:14:06.793794  5718 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:06.841879  5290 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.869920  5443 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.881305  5733 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.924276  5401 consensus_queue.cc:237] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:06.884033  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 117822us
I20260709 12:14:06.926329  3895 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:06.928900  5425 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.860790  5637 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:06.886396  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:06.874142  5535 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:06.890527  5624 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.877895  5294 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:06.883879  5685 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.885656  5682 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:06.902556  5484 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:06.905350  5743 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:06.909742  5718 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.910867  3337 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:06.912359  3342 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:06.898481  5742 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:06.897595  5745 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:06.893229  4995 consensus_queue.cc:237] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.921005  5290 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:06.924793  5663 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:06.871897  5588 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.932523  3339 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
W20260709 12:14:06.874393  5615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.774s	user 0.025s	sys 0.084s
I20260709 12:14:06.994572  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:06.996011  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:07.029698  3336 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
W20260709 12:14:07.127018  5615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.026s	user 0.029s	sys 0.089s
I20260709 12:14:07.128224  5742 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
W20260709 12:14:07.129310  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 187484us
W20260709 12:14:07.073993  3305 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.098s (SENT) [suppressed 28 similar messages]
W20260709 12:14:07.055192  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 152632us
W20260709 12:14:07.146286  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 72346.4us
W20260709 12:14:07.146430  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.997728  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.941061  3264 raft_consensus.cc:1240] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:07.138583  5222 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:07.043829  5741 raft_consensus.cc:697] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:07.004076  5659 consensus_queue.cc:237] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.985287  5350 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.139863  3341 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:07.140065  5752 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:06.898396  5691 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:07.140650  3265 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:07.144171  3339 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:07.142295  5743 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.985617  5294 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:07.136828  5685 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:07.054260  5696 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:06.992219  5599 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:07.127509  5637 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:07.148859  5733 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:07.175608  5741 consensus_queue.cc:237] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:07.176198  3342 raft_consensus.cc:1275] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:07.177528  5683 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.180594  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:07.176611  5350 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:06.939702  5443 consensus_queue.cc:1059] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.232s
I20260709 12:14:06.985126  5535 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:07.147090  5742 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:07.178223  3189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1568) took 3051 ms. Trace:
I20260709 12:14:07.170802  5602 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:07.267874  3265 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:07.598001  3339 raft_consensus.cc:2393] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:14:07.587034  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 411819us
W20260709 12:14:07.386855  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 55935.9us
W20260709 12:14:07.564574  5608 consensus_meta.cc:287] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.000s
I20260709 12:14:07.597684  3189 rpcz_store.cc:276] 0709 12:14:04.113836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.686738 (+572902us) service_pool.cc:224] Handling call
0709 12:14:04.733005 (+ 46267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:04.756195 (+ 23190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.756225 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:04.794302 (+ 38077us) log.cc:844] Serialized 26 byte log entry
0709 12:14:06.728678 (+1934376us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b18003daaa0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4c2e07 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1aee16720b 00007f1aee16cd23 00007f1aee16d0d1 00007f1aee588a0f
0709 12:14:06.873937 (+145259us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:06.873996 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.874287 (+   291us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:07.155489 (+281202us) raft_consensus.cc:1685] finished
0709 12:14:07.155507 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.164752 (+  9245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3162,"raft.queue_time_us":54067,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":30958,"spinlock_wait_cycles":80115200,"thread_start_us":144551,"threads_started":1,"wal-append.queue_time_us":2205756}
I20260709 12:14:07.599921  5608 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:07.212822  5599 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:07.456791  5749 log.cc:927] Time spent T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 12:14:07.602224  5608 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:07.214133  5752 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:07.395399  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:07.323117  3185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40510 (request call id 1825) took 2508 ms (client timeout 1754 ms). Trace:
W20260709 12:14:07.601368  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:07.610896  3305 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.567s (SENT)
I20260709 12:14:07.611549  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:07.605947  3185 rpcz_store.cc:269] 0709 12:14:04.815134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.816466 (+  1332us) service_pool.cc:224] Handling call
0709 12:14:07.322855 (+2506389us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000bde54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:07.323027 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2449727360}
W20260709 12:14:07.593871  5425 consensus_meta.cc:287] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.664s	user 0.010s	sys 0.003s
I20260709 12:14:07.661562  3185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:14:07.666589  3185 raft_consensus.cc:606] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:07.416003  5514 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:07.667790  3185 raft_consensus.cc:614] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:07.604221  5637 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:07.678323  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.603830  5599 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:07.674643  5514 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:07.686964  3333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58568 (request call id 2009) took 1490 ms (client timeout 1976 ms). Trace:
I20260709 12:14:07.650403  5733 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:07.650141  5484 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:07.649749  5222 raft_consensus.cc:697] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:07.669515  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:07.273167  5683 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:07.696703  5610 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:07.693470  5699 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:07.688388  5637 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:07.694908  3333 rpcz_store.cc:269] 0709 12:14:06.196120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.196254 (+   134us) service_pool.cc:224] Handling call
0709 12:14:07.686742 (+1490488us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b540036d654. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:07.686887 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67255552}
I20260709 12:14:07.707615  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:07.685304  5425 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:07.708590  3342 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:07.695662  5755 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.713465  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:07.713788  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:07.714255  3340 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:07.709910  3339 raft_consensus.cc:1240] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:07.649430  5745 consensus_queue.cc:1059] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:14:07.708266  5691 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:07.720796  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:07.721552  3341 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:07.723191  3342 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:07.713047  3333 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:07.728767  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:07.729390  3333 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:07.716377  5743 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:07.733520  3335 raft_consensus.cc:1240] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:07.732388  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:07.745151  3339 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:07.756037  3340 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:07.758273  3341 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:07.712317  5484 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:07.712369  5425 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:07.717849  5755 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:07.777735  5760 log.cc:927] Time spent T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:14:07.783658  5761 log.cc:927] Time spent T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:14:07.789033  5743 raft_consensus.cc:3055] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:07.789605  5743 raft_consensus.cc:740] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:07.789705  5350 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:07.790580  5743 consensus_queue.cc:260] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:07.811100  5743 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:07.798962  5752 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:07.802924  5710 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 1.828s	user 0.006s	sys 0.010s
I20260709 12:14:07.814172  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 475) took 1307 ms. Trace:
I20260709 12:14:07.814695  3262 rpcz_store.cc:276] 0709 12:14:06.507178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.507293 (+   115us) service_pool.cc:224] Handling call
0709 12:14:06.507604 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.788428 (+280824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:06.788456 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:06.788493 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:06.788540 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.813859 (+1025319us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400407254. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:07.813921 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.814097 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645259520}
I20260709 12:14:07.764202  5750 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:07.873358  5624 consensus_meta.cc:287] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.880s	user 0.010s	sys 0.000s
I20260709 12:14:07.873847  5624 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:07.877048  5755 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:07.880239  5294 consensus_meta.cc:287] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.000s
I20260709 12:14:07.880717  5294 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:07.882969  5294 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:07.898382  5683 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:07.899586  5680 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:07.899928  5637 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:07.900326  5680 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:07.901789  5484 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:07.902690  5296 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:07.821170  3156 connection.cc:256] RPC call timeout handler was delayed by -1.2740500329998667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 12:14:07.895249  3231 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:07.908279  3333 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
W20260709 12:14:07.904811  3156 connection.cc:256] RPC call timeout handler was delayed by -1.0355500329999359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
I20260709 12:14:07.930644  3231 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:07.899163  5683 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:07.859047  5588 consensus_meta.cc:287] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.718s	user 0.005s	sys 0.005s
I20260709 12:14:07.940932  3334 raft_consensus.cc:1275] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:14:07.941442  3334 pending_rounds.cc:85] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 2
I20260709 12:14:07.903216  5680 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:07.941782  3334 pending_rounds.cc:107] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:14:07.944778  3334 raft_consensus.cc:2889] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:07.762044  5222 consensus_queue.cc:237] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:07.932709  5608 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:07.926513  5294 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:07.941067  5637 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.903231  5296 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:07.968644  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.922037  5750 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:07.935812  5401 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:14:07.952579  5701 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.938414  5683 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:07.956245  5680 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:07.963073  5514 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:07.954483  5610 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:07.979504  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 314813us
I20260709 12:14:07.939028  5670 consensus_queue.cc:1059] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:14:07.992125  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:07.992981  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.993026  3333 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
W20260709 12:14:07.972657  5685 consensus_meta.cc:287] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.733s	user 0.008s	sys 0.009s
W20260709 12:14:07.988940  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 58377us
I20260709 12:14:08.017639  3231 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:08.023524  5741 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.031409  5741 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.035808  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.037417  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.038187  3931 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:08.039070  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.040014  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.041188  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:07.964897  5294 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:08.039635  5682 consensus_meta.cc:287] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.902s	user 0.006s	sys 0.013s
I20260709 12:14:07.976224  5637 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:08.058497  3895 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:08.065718  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:08.067042  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.990753  5514 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.000586  5610 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.026135  5685 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:07.982406  5701 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:08.025295  5608 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:14:08.036697  5602 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:14:08.259714  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.040870  5670 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:08.137209  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 78786.9us
W20260709 12:14:08.127970  3090 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48786 (request call id 303) took 12472 ms (client timeout 15000 ms). Trace:
I20260709 12:14:08.261001  3925 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
W20260709 12:14:08.262439  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 202068us
I20260709 12:14:08.282807  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:08.283664  3192 raft_consensus.cc:1240] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:14:08.284193  3189 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:08.284855  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:08.067587  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.287787  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:08.171173  5766 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:08.289160  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.289481  5766 raft_consensus.cc:697] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:08.289940  3184 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:08.286103  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:08.293892  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.294166  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.294714  3193 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:08.067126  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.297941  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:08.299355  3189 raft_consensus.cc:2393] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:08.299865  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.299962  5650 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:08.055147  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.238468  5484 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.171859  5593 raft_consensus.cc:3055] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:08.060220  5442 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:08.256321  5296 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:08.071830  5637 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:08.246757  5750 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:08.070140  5294 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:08.306092  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:08.367314  3189 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:08.368295  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.307668  5594 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.309346  5719 raft_consensus.cc:3055] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:08.068288  5401 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:08.076614  3088 catalog_manager.cc:5697] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 4, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 4 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:08.372375  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.243531  5741 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:08.079527  5702 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:08.314973  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.319885  3928 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:08.311559  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:08.320626  5593 raft_consensus.cc:740] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:08.323073  5484 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:08.325387  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.325649  5610 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:08.327023  5759 raft_consensus.cc:3055] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:08.328868  5692 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:08.322949  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.389349  3188 raft_consensus.cc:2393] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:08.333065  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.320235  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:08.273331  3090 rpcz_store.cc:269] 0709 12:13:55.655808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.682531 (+ 26723us) service_pool.cc:224] Handling call
0709 12:14:08.127850 (+12445319us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:02.251759 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:02.252464 (+   705us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:02.252523 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:14:02.252539 (+    16us) tablet.cc:662] Decoding operations
0709 12:14:02.253476 (+   937us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:02.253564 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:02.253601 (+    37us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:14:02.254322 (+   721us) tablet.cc:701] Row locks acquired
0709 12:14:02.254367 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:14:02.254522 (+   155us) write_op.cc:270] Start()
0709 12:14:02.254661 (+   139us) write_op.cc:276] Timestamp: P: 1783599242254462 usec, L: 0
0709 12:14:02.254681 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:14:02.255352 (+   671us) log.cc:844] Serialized 2844 byte log entry
0709 12:14:02.535157 (+279805us) op_driver.cc:464] REPLICATION: finished
0709 12:14:02.904060 (+368903us) write_op.cc:301] APPLY: starting
0709 12:14:02.906599 (+  2539us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:02.990829 (+ 84230us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:03.046602 (+ 55773us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:03.316355 (+269753us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:03.316578 (+   223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:14:03.316628 (+    50us) write_op.cc:312] APPLY: finished
0709 12:14:03.316899 (+   271us) log.cc:844] Serialized 59 byte log entry
0709 12:14:03.317092 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:03.317217 (+   125us) write_op.cc:454] Released schema lock
0709 12:14:03.317270 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:03.317717 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:03.317747 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":875662,"reported_tablets":24,"spinlock_wait_cycles":225024,"child_traces":[["op",{"apply.queue_time_us":291422,"apply.run_cpu_time_us":4228,"apply.run_wall_time_us":436444,"num_ops":7,"prepare.queue_time_us":102881,"prepare.run_cpu_time_us":3997,"prepare.run_wall_time_us":12702,"replication_time_us":280318,"thread_start_us":247921,"threads_started":2}]]}
I20260709 12:14:08.336555  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:08.337839  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:08.339382  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:08.339783  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.339674  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:08.373703  5294 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:08.340896  3305 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.944s (SENT)
I20260709 12:14:08.341022  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.343400  3232 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:08.052670  5742 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.344712  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:08.408238  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.408414  3191 raft_consensus.cc:2393] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:08.409005  3193 raft_consensus.cc:2393] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:08.344619  5442 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.303380  5766 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.345675  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.409140  3192 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:08.410041  3186 raft_consensus.cc:2393] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 5: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:08.346401  5670 consensus_queue.cc:1059] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:08.348002  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.414441  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:08.302129  5668 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.346524  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:08.073570  5776 consensus_queue.cc:1048] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.242s
I20260709 12:14:08.300836  5603 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:08.072360  5682 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.350956  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.352277  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:08.355924  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:08.430207  3185 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:08.430318  3340 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:08.430673  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.363037  3339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:46076
I20260709 12:14:08.431756  3339 raft_consensus.cc:606] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:08.431880  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.432235  3339 raft_consensus.cc:614] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:08.432905  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.364470  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.434864  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:08.123818  5767 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.435693  5484 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:08.436193  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.435802  5767 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.437491  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.438323  5442 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:08.438568  5767 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:08.438813  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.373153  3189 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:08.440629  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.441718  3189 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:08.376044  3088 catalog_manager.cc:5697] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 5, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 5 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.372244  5719 raft_consensus.cc:740] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:08.350354  5683 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:08.386171  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:08.411734  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 68378.8us
I20260709 12:14:08.411691  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:08.408267  3341 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:08.408383  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:08.415192  3342 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:08.446198  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 105372us
I20260709 12:14:08.413975  5593 consensus_queue.cc:260] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.443207  3088 catalog_manager.cc:5697] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 3 to 5, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 5 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.449635  3336 raft_consensus.cc:2393] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:08.447189  3925 raft_consensus.cc:2376] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5. Re-sending same reply.
I20260709 12:14:08.450042  3088 catalog_manager.cc:5697] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.422166  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.414597  3923 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.419442  5608 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:08.457753  3185 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:14:08.419559  3896 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:08.426685  3334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 1996) took 2601 ms. Trace:
I20260709 12:14:08.459123  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.459304  3334 rpcz_store.cc:276] 0709 12:14:05.825422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.825532 (+   110us) service_pool.cc:224] Handling call
0709 12:14:05.825762 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:07.952152 (+2126390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:08.426349 (+474197us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b540036c754. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:08.426601 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4863593728}
I20260709 12:14:08.363080  5698 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:08.439718  3188 raft_consensus.cc:2393] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:08.445235  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:08.441118  3929 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
W20260709 12:14:08.447965  3305 leader_election.cc:336] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 2.102s (SENT)
I20260709 12:14:08.421674  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.449335  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.386246  5759 raft_consensus.cc:740] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:08.454864  3088 catalog_manager.cc:5697] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.473654  3088 catalog_manager.cc:5697] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.474454  3232 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:08.474768  3342 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:08.475296  3088 catalog_manager.cc:5697] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 3, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 3 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:08.476167  3262 raft_consensus.cc:1240] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:08.460069  3185 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:08.463450  3187 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:08.467813  3932 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:14:08.468909  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:08.477739  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:08.465068  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 45614.6us
I20260709 12:14:08.381628  5401 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.476825  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.479936  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.480015  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:08.453428  5702 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.481578  3185 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:08.481572  3188 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.481405  3930 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:08.478370  5296 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:08.482540  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.472374  5593 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.428946  5668 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.483047  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:08.483317  5779 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:14:08.446898  5603 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.478799  3088 catalog_manager.cc:5697] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.538516  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:08.420569  5294 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:08.483506  5683 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:08.486317  5680 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:14:08.452383  5670 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:14:08.476934  5698 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.492764  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.548818  3185 raft_consensus.cc:2393] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:08.549885  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.539141  3088 catalog_manager.cc:5697] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.550637  3185 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:08.493204  5296 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:08.494892  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.449162  3926 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:08.488471  5711 raft_consensus.cc:2804] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:08.472584  5484 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.498402  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.472911  5767 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:08.509972  3188 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:08.515803  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.516203  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.519656  5599 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.577101  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.540817  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.625728  3932 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 1.
I20260709 12:14:08.543792  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.552151  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.626847  3264 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
W20260709 12:14:08.572088  3306 leader_election.cc:336] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Timed out: RequestConsensusVote RPC to 127.1.248.68:43599 timed out after 2.102s (SENT)
I20260709 12:14:08.620468  3192 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:08.620675  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.628531  3188 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:08.628664  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.629418  3192 raft_consensus.cc:2393] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 5: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
W20260709 12:14:08.553566  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 497237us
I20260709 12:14:08.621387  3267 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 1.
I20260709 12:14:08.610792  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.598047  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.630795  3306 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:08.631069  3187 raft_consensus.cc:2393] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:08.599071  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.631865  3190 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:08.501469  3305 leader_election.cc:336] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 2.124s (SENT)
I20260709 12:14:08.626833  3185 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
W20260709 12:14:08.566123  3156 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.938s (SENT)
W20260709 12:14:08.632324  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 130874us
W20260709 12:14:08.632911  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 66837.3us
I20260709 12:14:08.556326  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:08.641238  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 69187.3us
I20260709 12:14:08.561554  3929 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:08.648061  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.648334  3231 leader_election.cc:400] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7.
I20260709 12:14:08.648783  3231 leader_election.cc:403] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:08.648252  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.648967  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.649864  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.650141  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.648005  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.650885  3185 raft_consensus.cc:2393] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:08.650884  3305 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:08.636881  5484 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.657306  5484 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:08.622175  5711 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:08.658064  5711 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:08.648959  5599 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:08.658748  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.659794  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:08.660024  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:08.660392  3264 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:08.660854  3191 raft_consensus.cc:2410] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:14:08.661423  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.661710  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.662854  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:08.662993  5785 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:08.553659  5296 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.637676  3184 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.663763  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.663829  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.664446  3268 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:08.664670  3187 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:08.665453  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.665781  3187 raft_consensus.cc:1275] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:08.666181  3185 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:08.666538  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:08.666867  3187 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:08.667196  3185 raft_consensus.cc:1240] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:08.655150  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.649075  5723 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.667265  3268 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:08.667368  5594 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:14:08.671926  3192 raft_consensus.cc:2393] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:08.672946  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.667654  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.674866  3190 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:08.668301  3185 raft_consensus.cc:1240] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:08.668776  5733 raft_consensus.cc:2804] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:08.676059  5668 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:08.676286  5733 raft_consensus.cc:697] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:08.676860  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.674894  5624 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:08.668823  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:08.689180  3263 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:08.677862  3191 raft_consensus.cc:2410] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:08.669389  3188 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:08.692339  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:08.692447  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.693214  3193 raft_consensus.cc:2393] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:08.677220  5733 consensus_queue.cc:237] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.694372  5296 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.695366  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:08.696184  3341 raft_consensus.cc:2410] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:08.696055  5711 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:08.696658  5296 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:08.668232  3305 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:08.678519  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.699395  3266 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:14:08.700198  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.678850  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.650297  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:08.701321  3260 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:08.670059  3265 raft_consensus.cc:2393] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:08.702158  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.702572  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.704327  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.599732  5514 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:08.706012  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 213733us
I20260709 12:14:08.698310  3305 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:08.707751  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:08.709779  3260 raft_consensus.cc:2393] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:08.684016  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:08.711831  3265 raft_consensus.cc:2393] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:14:08.706365  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.685542  3264 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:08.709885  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:08.718650  3260 raft_consensus.cc:1275] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:08.719712  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.722864  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:08.723469  3334 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.724638  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.718297  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:08.726538  3268 raft_consensus.cc:1240] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:08.647646  3928 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:08.669661  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.677629  5742 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:08.543300  5719 consensus_queue.cc:260] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:08.738916  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:09.044104  3342 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:09.040905  5401 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:09.042207  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:09.041883  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:08.871675  5691 consensus_queue.cc:1059] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.179s
W20260709 12:14:09.051733  3305 leader_election.cc:336] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.124s (SENT)
W20260709 12:14:08.896323  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 180757us
I20260709 12:14:08.845587  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:09.064532  3341 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
W20260709 12:14:08.799319  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.892648  3334 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:08.810982  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:09.067036  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.880944  3184 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:09.068784  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.069623  3931 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:08.706673  5688 raft_consensus.cc:2764] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:14:09.062714  3896 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:09.065816  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.851648  5608 raft_consensus.cc:697] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:14:09.041143  5788 log.cc:927] Time spent T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.313s	user 0.000s	sys 0.000s
W20260709 12:14:09.080780  3923 consensus_meta.cc:287] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.001s
I20260709 12:14:09.081281  3923 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:09.081985  3925 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:09.082571  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.083036  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:08.724552  5699 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:09.084851  5699 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.085212  5699 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.086233  5780 raft_consensus.cc:3055] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:09.086673  5780 raft_consensus.cc:740] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:09.087891  5603 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:09.087595  5780 consensus_queue.cc:260] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:09.083779  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:09.088884  5442 consensus_queue.cc:1175] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "eb49d92feeb14382b3baa49d696b6141" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:08.814203  5650 consensus_queue.cc:1048] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.277s
I20260709 12:14:09.023260  5766 consensus_queue.cc:1059] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:14:09.042107  5294 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:09.079116  5608 consensus_queue.cc:237] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.042467  5535 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:09.083864  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.092942  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.094079  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.118526  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:08.718559  5594 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.731379  5723 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:09.096609  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:09.099012  3232 leader_election.cc:336] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Timed out: RequestConsensusVote RPC to 127.1.248.68:43599 timed out after 1.515s (SENT)
W20260709 12:14:09.127976  3232 leader_election.cc:336] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Timed out: RequestConsensusVote RPC to 127.1.248.68:43599 timed out after 1.676s (SENT)
I20260709 12:14:09.128391  3232 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:09.099864  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.130057  3263 raft_consensus.cc:2393] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:09.073199  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:09.100535  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.104665  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.008685  5682 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:09.026144  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.052920  5711 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:08.780283  5702 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:09.123957  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:08.845721  5697 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.271s
I20260709 12:14:09.107194  5742 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:09.088682  5780 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.103453  5733 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.187000  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.187855  3263 raft_consensus.cc:2393] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:09.187923  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.190770  3266 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 1.
I20260709 12:14:09.171712  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:09.194320  5593 consensus_meta.cc:287] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.696s	user 0.002s	sys 0.007s
I20260709 12:14:09.195199  3189 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:09.189417  5425 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:09.170490  5680 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:09.126442  5723 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.203814  5723 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.207535  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.192433  5702 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:09.208518  5702 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.208956  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.210182  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.212550  5685 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:09.212435  5733 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.214530  5733 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:09.216867  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55438 (request call id 713) took 1204 ms. Trace:
I20260709 12:14:09.217303  3926 rpcz_store.cc:276] 0709 12:14:08.012496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.016433 (+  3937us) service_pool.cc:224] Handling call
0709 12:14:08.364351 (+347918us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8eee 000000000036eb39 00007f1af351c1e0 00007f1af35e50c4 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:09.171868 (+807517us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b54006d56d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:09.216773 (+ 44905us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21814272}
I20260709 12:14:09.239203  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:09.240191  3259 raft_consensus.cc:2368] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9.
I20260709 12:14:09.188663  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.242403  3263 raft_consensus.cc:2410] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:09.136449  5691 raft_consensus.cc:3055] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:09.106588  5755 consensus_queue.cc:1059] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:14:09.167222  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:09.191764  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.253676  3260 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:09.253870  3266 raft_consensus.cc:2410] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:09.188925  5742 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:09.197790  5759 consensus_queue.cc:260] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:09.270707  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.271842  3266 raft_consensus.cc:2393] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 5: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:09.258009  5796 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:09.283948  3187 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:09.253113  5691 raft_consensus.cc:740] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:09.286226  3188 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:09.255684  5599 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:09.258100  5742 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.293143  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.294111  3187 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:09.297473  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:09.286595  5759 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.283720  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.306186  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.307092  3266 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:09.307293  3262 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:09.308147  3895 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:09.311249  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:09.310979  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 181594us
W20260709 12:14:09.317938  3232 leader_election.cc:336] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Timed out: RequestConsensusVote RPC to 127.1.248.68:43599 timed out after 1.524s (SENT)
I20260709 12:14:09.318580  3232 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:09.319002  5767 consensus_queue.cc:1059] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:09.320552  5770 raft_consensus.cc:3055] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:09.321048  5770 raft_consensus.cc:740] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:09.322059  5770 consensus_queue.cc:260] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.330382  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:09.324123  3232 leader_election.cc:336] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Timed out: RequestConsensusVote RPC to 127.1.248.68:43599 timed out after 1.574s (SENT)
I20260709 12:14:09.327414  3261 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:09.329164  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 277459us
W20260709 12:14:09.331948  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 213230us
I20260709 12:14:09.334307  3334 raft_consensus.cc:1240] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:09.308413  5709 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:09.335592  3306 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:09.337074  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.337934  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:09.338011  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:09.328591  5755 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:09.330745  5599 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:09.336835  3232 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:09.338783  3266 raft_consensus.cc:2376] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8. Re-sending same reply.
I20260709 12:14:09.340795  5733 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:09.341984  5750 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:09.328890  5608 consensus_queue.cc:1048] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:14:09.339840  5755 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.344151  5755 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.346594  5702 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:09.337025  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.330979  5799 consensus_queue.cc:1059] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:14:09.348520  5799 raft_consensus.cc:3055] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:09.348879  5799 raft_consensus.cc:740] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:09.349939  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:09.349664  5799 consensus_queue.cc:260] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.350834  5799 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.350898  3187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:14:09.351621  3187 raft_consensus.cc:606] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:09.352000  3187 raft_consensus.cc:614] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:09.354588  5594 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7.
I20260709 12:14:09.331133  5691 consensus_queue.cc:260] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.355729  5685 raft_consensus.cc:2764] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:14:09.359068  5691 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.360139  3157 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:09.368522  5755 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.370209  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:09.377506  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:09.378059  3342 raft_consensus.cc:2393] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:09.378160  3333 raft_consensus.cc:2376] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6. Re-sending same reply.
I20260709 12:14:09.370882  3306 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:09.336103  5709 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:09.372009  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 47927.9us
I20260709 12:14:09.374786  3157 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:09.381551  3232 leader_election.cc:336] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Timed out: RequestConsensusVote RPC to 127.1.248.68:43599 timed out after 1.875s (SENT)
I20260709 12:14:09.381953  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:09.377184  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:09.382443  3157 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:09.341245  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.384268  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:09.331522  5766 consensus_queue.cc:1059] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:14:09.385370  5682 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:09.385677  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:09.382771  3335 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:14:09.387780  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:09.390353  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 48624.3us
I20260709 12:14:09.330663  5659 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:14:09.389628  5682 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.393296  5682 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.371779  5770 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.391004  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:09.398502  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.398833  3333 raft_consensus.cc:2393] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:09.392148  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.392627  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:09.390669  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:09.394690  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.395328  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.400630  3266 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:09.401120  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.395982  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.401818  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.396004  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.397632  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:09.402945  3341 raft_consensus.cc:2376] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3. Re-sending same reply.
I20260709 12:14:09.403573  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.404218  3341 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:09.400445  3335 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:14:09.404767  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.390983  5683 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:09.406201  3265 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:09.399175  5805 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:09.386662  5535 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:09.407294  5701 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:09.407483  3259 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:09.407816  5535 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:09.408252  5535 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.378777  5685 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:09.411209  5685 raft_consensus.cc:697] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:09.412184  5685 consensus_queue.cc:237] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:09.413910  5699 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:09.415285  3336 raft_consensus.cc:2393] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:09.416162  3264 raft_consensus.cc:2410] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:09.404767  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:09.416846  3340 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:09.404251  3333 raft_consensus.cc:1240] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:14:09.378937  5608 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:09.370414  5723 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:09.399323  3232 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:09.419628  3333 raft_consensus.cc:1240] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:14:09.420675  3306 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:09.388824  5709 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.422510  3232 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:09.422765  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:09.425515  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:09.425195  3232 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:09.427901  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:09.428534  5787 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.502s	user 0.000s	sys 0.004s
I20260709 12:14:09.429157  3340 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:09.430648  3340 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:09.431595  5683 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:09.432046  5683 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.432540  5683 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.434644  5723 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:09.399374  5425 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:09.439625  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.435132  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:09.437206  3342 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:14:09.426242  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:09.441715  3333 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:09.443111  3333 raft_consensus.cc:1240] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:09.425379  5805 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:09.443739  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:09.455467  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.451068  3896 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:09.451421  3268 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:09.457258  3333 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:09.452009  3263 raft_consensus.cc:1240] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:09.455092  3265 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:09.458614  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.456434  3264 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:09.454237  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:09.426988  5780 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:09.467022  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:09.466200  5780 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:09.468007  5780 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:09.469103  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:09.470732  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:09.470957  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:09.472011  3189 raft_consensus.cc:2393] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:09.476698  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:09.476897  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 51785.9us
I20260709 12:14:09.478860  5743 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:09.479614  3232 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:09.480348  3184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40494 (request call id 1586) took 1168 ms. Trace:
I20260709 12:14:09.480698  3184 rpcz_store.cc:276] 0709 12:14:08.311937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.314901 (+  2964us) service_pool.cc:224] Handling call
0709 12:14:09.480191 (+1165290us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54001b26d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:09.480294 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490422528}
W20260709 12:14:09.482296  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.480916  3232 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:09.481506  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:09.485551  3189 raft_consensus.cc:2376] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6. Re-sending same reply.
I20260709 12:14:09.486552  3338 raft_consensus.cc:1240] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:14:09.487121  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.488803  5632 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:09.481946  5442 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:14:09.475401  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.465720  5767 consensus_queue.cc:1059] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:14:09.449587  5742 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.461376  5222 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:09.493494  5742 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:09.495636  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.495854  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.496857  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:09.497080  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:09.497640  3259 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:09.498430  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.499740  5599 raft_consensus.cc:2804] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:09.499795  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.500268  5599 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:09.500666  5599 raft_consensus.cc:3060] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.500795  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.501658  3268 raft_consensus.cc:2410] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:14:09.502454  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.503136  3268 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:09.505722  3267 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:09.506232  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:09.506851  3268 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.507233  5602 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:09.507685  5602 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:09.508105  5602 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.453238  5288 raft_consensus.cc:3055] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:09.453409  5698 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:09.455271  5670 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:09.476140  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 147564us
I20260709 12:14:09.459765  5425 raft_consensus.cc:697] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:14:09.552664  3156 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.609s (SENT)
I20260709 12:14:09.553162  3156 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:09.533998  3232 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:09.554384  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:09.555202  3188 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:09.461154  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.555894  3895 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:09.568123  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:09.568496  3305 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:09.569255  3260 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:09.484825  5755 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:09.568852  3929 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:09.577265  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:09.517230  5288 raft_consensus.cc:740] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:09.581351  3932 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:09.584084  3186 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:09.563678  5603 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:09.516932  5709 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.573751  5806 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.573834  5767 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:09.596040  5799 consensus_queue.cc:1059] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:14:09.601145  5702 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:09.602497  5699 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:09.573783  3923 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
W20260709 12:14:09.608299  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.574040  5222 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:14:09.589692  5670 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:09.606455  3306 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:09.596297  5766 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:09.591497  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:09.626864  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 223911us
I20260709 12:14:09.593662  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:09.651340  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 45006.2us
I20260709 12:14:09.580557  5697 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:09.652962  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 84557.2us
W20260709 12:14:09.653822  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 119950us
I20260709 12:14:09.656036  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:09.656814  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 194785us
I20260709 12:14:09.667269  3268 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:09.679899  3305 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:09.657707  5288 consensus_queue.cc:260] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.681540  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.682650  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:09.676858  3266 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:09.684919  3338 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:09.685551  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.686189  3266 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
W20260709 12:14:09.686411  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 110834us
I20260709 12:14:09.687055  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.687884  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:09.688167  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:09.689298  3336 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.692795  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.694022  3306 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:09.694430  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.694957  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:09.657874  5766 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:09.697372  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.698792  3232 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:09.699627  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:09.672967  5697 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.703743  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.672710  5670 raft_consensus.cc:697] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:09.704887  3157 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:09.644091  5806 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.709311  3268 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:09.684021  5288 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.711215  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:09.727978  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.646473  5767 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.731199  3266 raft_consensus.cc:2410] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:09.726634  3157 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:09.690799  5702 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:09.738905  3232 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:09.739370  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:09.701720  5759 raft_consensus.cc:2804] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:09.701429  5608 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:09.741348  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.744076  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:09.745712  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:09.703809  5805 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:09.748876  5702 raft_consensus.cc:697] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:09.752717  3336 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:09.709444  5697 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.709267  5603 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:09.761736  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.741415  5685 raft_consensus.cc:2804] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:09.767158  3335 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:09.797801  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:09.796058  5685 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.757858  5759 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:09.799779  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.705920  5766 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.799985  5670 consensus_queue.cc:237] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.796686  5603 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:09.805300  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.804807  5535 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:09.725270  5594 raft_consensus.cc:2804] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:09.807643  5797 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:09.696779  5632 consensus_queue.cc:1059] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:14:09.736400  5723 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:09.809897  5659 raft_consensus.cc:3055] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:09.810392  5659 raft_consensus.cc:740] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:09.811442  5659 consensus_queue.cc:260] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.813212  5599 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.666882  5425 consensus_queue.cc:237] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.736023  5688 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:09.774966  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:09.829921  3337 raft_consensus.cc:2376] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7. Re-sending same reply.
I20260709 12:14:09.700292  5755 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:14:09.837996  5719 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.840050  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.839794  5702 consensus_queue.cc:237] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:09.840730  3264 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:09.841674  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:09.842849  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.740088  5513 raft_consensus.cc:2804] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:09.784679  3266 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:14:09.848382  5513 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:09.848516  3267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56754 (request call id 1466) took 1172 ms. Trace:
I20260709 12:14:09.849164  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.850051  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:09.850325  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.850775  3268 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:09.828438  3263 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:09.851588  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.856575  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.857834  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.851914  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.795276  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:09.859066  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.814502  5766 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.799949  5759 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.770927  5805 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.868278  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:09.868556  5805 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.869024  3184 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:09.868965  5766 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:09.728744  5296 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:14:09.870978  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:09.871721  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:09.819886  5682 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:09.872403  5683 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.873077  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.873661  3260 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:09.873723  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:09.874053  5682 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:09.874498  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.765630  5813 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:09.773607  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:09.832056  5821 log.cc:927] Time spent T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:14:09.832240  5709 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:09.832836  5814 log.cc:927] Time spent T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:14:09.743453  5776 consensus_queue.cc:1059] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 12:14:09.844404  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:09.845252  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:09.848861  3267 rpcz_store.cc:276] 0709 12:14:08.676491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.676602 (+   111us) service_pool.cc:224] Handling call
0709 12:14:09.848367 (+1171765us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54003a98d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:09.848464 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904839040}
I20260709 12:14:09.799800  5685 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.855786  3261 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
W20260709 12:14:09.859903  3305 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.520s (SENT)
I20260709 12:14:09.860184  3263 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:09.851397  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:09.761518  3157 leader_election.cc:336] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Timed out: RequestConsensusVote RPC to 127.1.248.68:43599 timed out after 1.700s (SENT)
I20260709 12:14:09.829444  5688 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.864882  5767 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:09.865643  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:09.866441  5806 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:09.866988  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:09.872280  3268 raft_consensus.cc:2376] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6. Re-sending same reply.
I20260709 12:14:09.876133  3265 raft_consensus.cc:2368] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5.
I20260709 12:14:09.901484  5813 raft_consensus.cc:697] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:09.907259  5535 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:09.837301  5780 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:09.908238  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:10.262691  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 501158us
I20260709 12:14:09.826393  5603 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:10.274041  5697 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.275468  3341 raft_consensus.cc:1240] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:10.157294  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.276667  5697 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:10.267508  3264 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:09.887204  5443 raft_consensus.cc:3055] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:09.848883  5513 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.263151  3260 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:10.271585  5780 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:10.272094  5813 consensus_queue.cc:237] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:10.296422  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:10.263461  3193 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:10.267915  3336 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:14:10.011900  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.277559  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:10.277784  5632 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.058825  3925 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
W20260709 12:14:10.085891  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.302127  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:10.282155  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 422248us
I20260709 12:14:10.301383  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:10.303416  3187 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:10.082906  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 344025us
I20260709 12:14:10.282285  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.282496  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.305778  3263 raft_consensus.cc:2410] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:14:10.283228  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:10.283286  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:10.306770  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:10.307552  5288 consensus_meta.cc:287] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.003s
I20260709 12:14:10.308499  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:10.309362  3188 raft_consensus.cc:2393] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:10.311661  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:10.313057  5288 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.313923  5288 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.316542  3926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:14:10.317526  3926 raft_consensus.cc:606] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
W20260709 12:14:10.318707  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.254863  5759 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.320147  5780 consensus_queue.cc:1059] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:10.320907  5759 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:10.285189  3895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.015s	sys 0.004s
I20260709 12:14:10.320995  5780 consensus_queue.cc:1059] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:10.321671  3895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.015s	sys 0.005s
I20260709 12:14:10.321748  5759 raft_consensus.cc:3055] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:10.322000  5836 raft_consensus.cc:3055] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:10.322163  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 724388us
W20260709 12:14:10.322515  3305 leader_election.cc:336] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.513s (SENT)
I20260709 12:14:10.321187  5288 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
W20260709 12:14:10.324229  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.324807  3895 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:10.285760  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:10.278213  5670 raft_consensus.cc:3055] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:10.285832  3896 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:09.973999  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.288620  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:10.332566  3157 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:10.288913  3156 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.552s (SENT)
I20260709 12:14:10.287071  5425 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.292192  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:10.201936  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:10.195703  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:10.667961  3928 raft_consensus.cc:2393] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:10.667847  5797 consensus_queue.cc:1059] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:14:10.668509  3928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55438 (request call id 729) took 1558 ms (client timeout 1948 ms). Trace:
W20260709 12:14:10.668103  5805 consensus_meta.cc:287] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.799s	user 0.012s	sys 0.007s
W20260709 12:14:10.668974  3928 rpcz_store.cc:269] 0709 12:14:09.110574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.202460 (+ 91886us) service_pool.cc:224] Handling call
0709 12:14:10.195456 (+992996us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:10.668447 (+472991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99513088}
I20260709 12:14:10.669267  5805 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:10.279366  5688 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:10.670500  5599 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:10.672041  5805 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:10.672329  3259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 1936) took 1162 ms. Trace:
I20260709 12:14:10.264194  5683 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:10.673297  3338 raft_consensus.cc:1240] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:14:10.296195  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:10.674170  3184 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:10.281030  5608 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:10.674497  5425 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.278863  5594 raft_consensus.cc:697] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:10.675344  3262 raft_consensus.cc:2376] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7. Re-sending same reply.
I20260709 12:14:10.675905  5594 consensus_queue.cc:237] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.676798  5425 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:10.282173  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.677757  3268 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
W20260709 12:14:10.678162  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 345638us
I20260709 12:14:10.322539  5836 raft_consensus.cc:740] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:10.291608  5776 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.333746  3156 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:10.338480  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 52746.1us
I20260709 12:14:10.291214  5443 raft_consensus.cc:740] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:10.330533  5670 raft_consensus.cc:740] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:10.330344  5759 raft_consensus.cc:740] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:10.331131  5632 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:10.321028  5691 consensus_meta.cc:287] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.960s	user 0.021s	sys 0.009s
I20260709 12:14:10.407895  3926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:14:10.645553  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:10.338562  5701 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:14:10.699910  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:09.925396  5602 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.650394  5659 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:10.650647  5682 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:10.330017  5810 raft_consensus.cc:2804] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:10.655263  3187 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:10.656944  5723 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:10.658704  5513 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:10.666682  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 331811us
I20260709 12:14:10.710964  3261 raft_consensus.cc:2393] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:10.712337  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:10.672771  3259 rpcz_store.cc:276] 0709 12:14:09.510248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.737516 (+227268us) service_pool.cc:224] Handling call
0709 12:14:10.201738 (+464222us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b58001c3898. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8eee 000000000036eb39 00007f1af351c1e0 00007f1af35e50c4 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:10.672253 (+470515us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8190336}
W20260709 12:14:10.298560  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.299306  3186 raft_consensus.cc:2393] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:10.326640  3232 leader_election.cc:336] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Timed out: RequestConsensusVote RPC to 127.1.248.68:43599 timed out after 2.120s (SENT)
W20260709 12:14:10.713723  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 387084us
W20260709 12:14:10.678833  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 343106us
I20260709 12:14:10.680533  3189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1628) took 1128 ms. Trace:
I20260709 12:14:10.686537  3336 raft_consensus.cc:1240] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:10.715342  3895 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:10.670866  5603 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.693445  3157 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:10.694305  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 405391us
I20260709 12:14:10.695488  3339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 600) took 1009 ms. Trace:
I20260709 12:14:10.693143  5813 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:10.698135  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.726356  3268 raft_consensus.cc:2393] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:10.698758  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:10.700799  5828 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:10.683760  5535 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.703625  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.736207  3260 raft_consensus.cc:2393] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:10.709865  5602 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:10.741981  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:10.742271  3895 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:10.710242  5810 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:10.700091  3927 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:10.725979  5691 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:10.710314  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.718331  3305 leader_election.cc:400] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9.
I20260709 12:14:10.727064  3263 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:10.701853  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.754473  3305 leader_election.cc:403] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:14:10.715821  3189 rpcz_store.cc:276] 0709 12:14:09.552539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.556302 (+  3763us) service_pool.cc:224] Handling call
0709 12:14:09.556578 (+   276us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:09.705123 (+148545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.705174 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:09.723665 (+ 18491us) log.cc:844] Serialized 52 byte log entry
0709 12:14:10.149639 (+425974us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:10.571390 (+421751us) log.cc:844] Serialized 14 byte log entry
0709 12:14:10.680248 (+108858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.680318 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.680359 (+    41us) raft_consensus.cc:1685] finished
0709 12:14:10.680369 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.680481 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33934,"prepare.queue_time_us":507375,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":128865,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":26656,"thread_start_us":813873,"threads_started":3,"wal-append.queue_time_us":560122}
I20260709 12:14:10.725332  3339 rpcz_store.cc:276] 0709 12:14:09.686091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.686463 (+   372us) service_pool.cc:224] Handling call
0709 12:14:09.686789 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:09.699110 (+ 12321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.699157 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:09.701022 (+  1865us) log.cc:844] Serialized 26 byte log entry
0709 12:14:09.905027 (+204005us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b18000303a0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4c2e07 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1aee16720b 00007f1aee16cd23 00007f1aee16d0d1 00007f1aee588a0f
0709 12:14:10.122242 (+217215us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:10.122302 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.122409 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.680937 (+558528us) raft_consensus.cc:1685] finished
0709 12:14:10.680957 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.695405 (+ 14448us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59941,"raft.queue_time_us":13585,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5588,"spinlock_wait_cycles":6188800,"thread_start_us":216935,"threads_started":1,"wal-append.queue_time_us":945533}
I20260709 12:14:10.691677  5826 consensus_queue.cc:1059] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:14:10.652269  5685 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:10.755635  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:10.756381  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:10.730734  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.707209  3926 raft_consensus.cc:606] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:10.700591  5834 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:10.703962  3334 raft_consensus.cc:2410] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:10.738483  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:10.765448  3335 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:10.693614  5776 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:10.704718  3924 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:10.740945  3185 raft_consensus.cc:2393] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:10.741905  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.691964  5753 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:10.692402  5599 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:10.778843  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.706818  5682 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:10.710407  5723 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.739843  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.780504  3268 raft_consensus.cc:2393] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:10.780787  5685 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:10.756204  5827 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:10.781349  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:10.782140  3268 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:10.782891  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.743414  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37962 (request call id 495) took 1347 ms. Trace:
I20260709 12:14:10.783593  3925 rpcz_store.cc:276] 0709 12:14:09.396418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.406292 (+  9874us) service_pool.cc:224] Handling call
0709 12:14:09.434962 (+ 28670us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:10.743251 (+1308289us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54005a1254. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:10.743358 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":977679104}
W20260709 12:14:10.741055  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 57363.1us
I20260709 12:14:10.743984  3932 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:10.708798  5759 consensus_queue.cc:260] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:10.758790  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:10.759783  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:10.813539  3340 raft_consensus.cc:2393] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:10.736610  5632 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:10.817452  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.750391  5767 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:14:10.762516  3341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 599) took 1078 ms. Trace:
I20260709 12:14:10.767393  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.724328  5797 consensus_queue.cc:1048] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:14:10.748770  5810 raft_consensus.cc:3060] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.771602  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:10.827955  5842 log.cc:927] Time spent T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:14:10.829089  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:10.830137  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:10.831080  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:10.750737  5766 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:10.753809  5425 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:10.758436  5691 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:10.755504  5733 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9.
I20260709 12:14:10.843600  5691 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.761272  5296 raft_consensus.cc:3055] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:10.844157  5296 raft_consensus.cc:740] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:10.845366  5805 raft_consensus.cc:3055] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:10.835925  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:10.763162  3926 raft_consensus.cc:614] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:10.847330  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:10.811854  3266 raft_consensus.cc:2410] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:10.810995  5599 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.849156  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 499) took 1180 ms. Trace:
I20260709 12:14:10.849539  3932 rpcz_store.cc:276] 0709 12:14:09.669231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.669808 (+   577us) service_pool.cc:224] Handling call
0709 12:14:10.743552 (+1073744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:10.784980 (+ 41428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.848970 (+ 63990us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54005a1250. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:10.849099 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2468392704}
I20260709 12:14:10.850903  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:10.791986  3268 raft_consensus.cc:2393] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:10.816753  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 61191us
I20260709 12:14:10.854444  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:10.854849  5750 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:10.856470  5852 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:10.740105  5443 consensus_queue.cc:260] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.857762  5603 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:10.858346  5443 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.864007  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:10.864545  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:10.865332  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:10.865247  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:10.866716  5719 consensus_meta.cc:287] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 1.028s	user 0.020s	sys 0.000s
I20260709 12:14:10.811142  5702 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:10.819188  3341 rpcz_store.cc:276] 0709 12:14:09.684229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.685436 (+  1207us) service_pool.cc:224] Handling call
0709 12:14:09.704150 (+ 18714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:10.275920 (+571770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.762284 (+486364us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54000244d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:10.762447 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313364352}
W20260709 12:14:10.821964  5831 log.cc:927] Time spent T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:14:10.788529  5682 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:10.821695  5608 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.868536  5608 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:10.824940  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.738879  5828 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.823006  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.726552  5836 consensus_queue.cc:260] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:10.873421  5836 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.873538  5828 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:10.747130  5535 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.874409  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:10.834039  3265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 1919) took 1340 ms. Trace:
I20260709 12:14:10.875530  5535 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:10.875572  3265 rpcz_store.cc:276] 0709 12:14:09.493343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.499549 (+  6206us) service_pool.cc:224] Handling call
0709 12:14:10.833871 (+1334322us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54002c7254. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:10.833986 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863378688}
I20260709 12:14:10.868698  3088 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34704 (request call id 180) took 7868 ms. Trace:
I20260709 12:14:10.777282  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55426 (request call id 504) took 1210 ms. Trace:
I20260709 12:14:10.876770  3924 rpcz_store.cc:276] 0709 12:14:09.566537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.570577 (+  4040us) service_pool.cc:224] Handling call
0709 12:14:10.311517 (+740940us) spinlock_profiling.cc:243] Waited 972 us on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8e9c 00007f1aeb4a8a5b 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:10.775749 (+464232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236288}
I20260709 12:14:10.841466  5513 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:10.842067  3334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52822 (request call id 585) took 1504 ms. Trace:
I20260709 12:14:10.878269  3334 rpcz_store.cc:276] 0709 12:14:09.337552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.337705 (+   153us) service_pool.cc:224] Handling call
0709 12:14:10.841886 (+1504181us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540007a654. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:10.842009 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3137834240}
I20260709 12:14:10.842824  5776 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:10.842935  3338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 2051) took 1134 ms. Trace:
I20260709 12:14:10.879868  3338 rpcz_store.cc:276] 0709 12:14:09.708218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.708354 (+   136us) service_pool.cc:224] Handling call
0709 12:14:09.708692 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:10.673669 (+964977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.842695 (+169026us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b540036c754. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:10.842878 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2217854848}
I20260709 12:14:10.834837  5759 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.844973  5296 consensus_queue.cc:260] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.884022  5296 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.756266  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.845788  5805 raft_consensus.cc:740] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:10.815691  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:10.888326  5805 consensus_queue.cc:260] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:10.889596  5805 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:10.854945  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:10.890775  3927 raft_consensus.cc:2368] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7.
I20260709 12:14:10.867259  3930 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:14:10.891554  5770 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:10.892204  3930 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55426 (request call id 494) took 2531 ms (client timeout 2120 ms). Trace:
W20260709 12:14:10.892638  3930 rpcz_store.cc:269] 0709 12:14:08.361201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.496084 (+134883us) service_pool.cc:224] Handling call
0709 12:14:10.892046 (+2395962us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b54006d0e54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:10.892141 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5152850176}
I20260709 12:14:10.773756  5807 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.893625  5807 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.895409  3932 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:10.886461  3088 rpcz_store.cc:276] 0709 12:14:03.000158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.052161 (+ 52003us) service_pool.cc:224] Handling call
0709 12:14:10.868628 (+7816467us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:09.197953 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:09.198510 (+   557us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:09.198548 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:14:09.198561 (+    13us) tablet.cc:662] Decoding operations
0709 12:14:09.199536 (+   975us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:09.199591 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:09.199623 (+    32us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:14:09.200329 (+   706us) tablet.cc:701] Row locks acquired
0709 12:14:09.200343 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:14:09.200491 (+   148us) write_op.cc:270] Start()
0709 12:14:09.200603 (+   112us) write_op.cc:276] Timestamp: P: 1783599249200443 usec, L: 0
0709 12:14:09.200619 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:14:09.201333 (+   714us) log.cc:844] Serialized 3574 byte log entry
0709 12:14:09.465616 (+264283us) op_driver.cc:464] REPLICATION: finished
0709 12:14:09.696503 (+230887us) write_op.cc:301] APPLY: starting
0709 12:14:09.696622 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:09.748782 (+ 52160us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:09.748939 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:09.750340 (+  1401us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:09.750757 (+   417us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:14:09.750837 (+    80us) write_op.cc:312] APPLY: finished
0709 12:14:09.751231 (+   394us) log.cc:844] Serialized 71 byte log entry
0709 12:14:09.758756 (+  7525us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:09.768498 (+  9742us) write_op.cc:454] Released schema lock
0709 12:14:09.773108 (+  4610us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:09.866977 (+ 93869us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:09.867023 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1571250,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":190135,"apply.run_cpu_time_us":4278,"apply.run_wall_time_us":163215,"num_ops":9,"prepare.queue_time_us":272941,"prepare.run_cpu_time_us":20993,"prepare.run_wall_time_us":113521,"raft.queue_time_us":53066,"raft.run_cpu_time_us":11882,"raft.run_wall_time_us":181640,"replication_time_us":262995,"thread_start_us":527344,"threads_started":4,"wal-append.queue_time_us":198085,"wal-append.run_cpu_time_us":9124,"wal-append.run_wall_time_us":1344133}]]}
I20260709 12:14:10.897986  5807 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:10.732617  5670 consensus_queue.cc:260] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:10.892040  5770 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.901283  3260 raft_consensus.cc:2410] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:10.902781  5770 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:10.905447  5670 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:10.912294  3263 raft_consensus.cc:2410] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:10.853029  3305 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:10.917747  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 64934us
I20260709 12:14:10.918605  3305 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:10.918401  5682 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.925968  3931 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:10.929538  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.930853  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:10.931463  3262 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.933095  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:10.919706  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 184071us
I20260709 12:14:10.934983  3261 raft_consensus.cc:1240] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:10.937443  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:10.938158  3261 raft_consensus.cc:2410] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:10.820623  3157 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:10.924629  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:10.905249  5691 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:10.927326  3265 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:10.928138  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:10.945569  3231 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:10.952802  3231 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:10.953222  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.948477  3232 leader_election.cc:400] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7.
I20260709 12:14:10.953950  3232 leader_election.cc:403] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:14:10.850955  5599 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:10.954041  3260 raft_consensus.cc:2393] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:14:10.945945  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 125374us
I20260709 12:14:10.940971  5852 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:10.962857  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.964313  3261 raft_consensus.cc:1275] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:10.925804  5813 raft_consensus.cc:697] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:10.920849  3305 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:10.967583  3266 raft_consensus.cc:2393] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:10.991227  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:10.968845  3231 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:10.922345  3932 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:10.972256  5759 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:10.976549  5753 raft_consensus.cc:697] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:10.982892  3263 raft_consensus.cc:2410] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:10.992926  3232 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:10.982672  5723 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:10.983508  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:10.984196  5766 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:10.977448  5294 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.977025  5780 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:10.987159  3931 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:10.949447  5425 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:10.988003  3336 raft_consensus.cc:1240] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:10.933921  5805 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:10.989622  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:10.994005  3231 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:10.996268  3156 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:10.996282  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 75493us
W20260709 12:14:11.024260  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 237516us
I20260709 12:14:10.985548  5852 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:11.031780  3266 raft_consensus.cc:1240] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:10.973762  5845 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:14:11.035358  5759 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:10.962127  3262 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:11.025058  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:11.026929  3231 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:11.026871  5753 consensus_queue.cc:237] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.027930  5670 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:10.996464  5296 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:11.028574  3928 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:10.815742  5827 raft_consensus.cc:697] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:10.990767  3923 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:11.046110  5827 consensus_queue.cc:237] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.047065  5425 raft_consensus.cc:697] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:11.038470  5776 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7.
I20260709 12:14:11.048197  5603 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:11.048054  5425 consensus_queue.cc:237] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:11.039750  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:11.040295  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 44085.6us
I20260709 12:14:11.040587  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:10.998126  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:10.997001  5801 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:11.044854  5535 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.041772  5688 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.048795  5685 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.052201  3156 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:10.978062  5846 consensus_queue.cc:1059] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:14:11.056245  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:11.026500  5836 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:11.044363  5682 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:11.057082  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:11.037114  5852 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:11.065342  3156 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:11.068701  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:11.069031  3156 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:11.065912  5850 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:14:11.042672  5849 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.072230  5702 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:11.074019  5702 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:11.074412  5702 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:11.069967  5836 raft_consensus.cc:697] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:11.026675  5294 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.077453  5294 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:11.078269  5807 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:11.065796  5813 consensus_queue.cc:237] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.079725  3896 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:11.081524  5801 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.081602  5770 consensus_queue.cc:1059] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:11.082064  5691 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:11.082132  5801 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.082799  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:11.082947  5770 raft_consensus.cc:3055] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:11.062606  5805 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.084071  3927 raft_consensus.cc:2393] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:11.084023  5770 raft_consensus.cc:740] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:11.084424  5801 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:11.064169  5608 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:11.085069  5770 consensus_queue.cc:260] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.086562  3925 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:11.086778  5608 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:11.063539  5685 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:11.087558  5810 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.088243  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:11.089316  5685 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:11.089522  5810 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:11.090310  3926 raft_consensus.cc:2393] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 2: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:11.092123  3305 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:11.095124  3156 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:11.097743  3156 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:11.101601  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.110785  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.086148  5770 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:11.105137  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:11.069931  5535 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:11.111810  3264 raft_consensus.cc:2393] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 2: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:11.106087  5846 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.113015  3305 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:11.113559  3156 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:11.082369  5837 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.115967  3305 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:11.094033  5682 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:11.132714  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:11.136042  3089 catalog_manager.cc:5697] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.137303  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:11.117709  3305 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:11.118525  5805 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:11.114099  5759 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.120042  3264 raft_consensus.cc:1240] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:11.119324  5836 consensus_queue.cc:237] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.124963  5688 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:11.127310  5807 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.127767  5691 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:11.152500  3089 catalog_manager.cc:5697] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 2 to 5, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 5 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:11.153986  3089 catalog_manager.cc:5697] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 3 to 5, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 5 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.154989  5851 raft_consensus.cc:3055] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:11.131518  5801 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:11.114595  5603 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:11.106609  5697 raft_consensus.cc:2749] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.100237  5685 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:11.146442  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.146368  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 156808us
I20260709 12:14:11.147739  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:11.092036  5776 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:14:11.152025  5806 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:11.143858  5805 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:11.158838  3932 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
W20260709 12:14:11.160470  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.160791  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 47293.3us
I20260709 12:14:11.175886  3156 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:11.168542  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:11.179746  3305 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:11.181383  3305 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:11.159788  5603 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:11.157644  3929 raft_consensus.cc:1240] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:11.155452  5851 raft_consensus.cc:740] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:11.178282  3156 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:11.184439  3156 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:11.187747  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:11.190214  3305 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:11.192157  3089 catalog_manager.cc:5697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 3 to 4, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 4 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.198231  3156 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:11.201510  3089 catalog_manager.cc:5697] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 4 to 5, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 5 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:11.206851  3089 catalog_manager.cc:5697] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.185822  5813 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:11.148818  5702 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:11.187278  5805 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:11.210189  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.186430  5846 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.187093  5535 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:11.216396  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.155828  5759 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.186455  5603 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:11.191270  5701 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:11.186262  5807 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:11.193261  5688 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.196365  5797 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:11.191494  5733 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:11.212508  5697 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.204708  5294 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:11.254832  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.329381  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.244716  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:11.288671  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.293190  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 103076us
I20260709 12:14:11.296492  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55438 (request call id 731) took 1016 ms. Trace:
I20260709 12:14:11.331323  3305 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:11.300590  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.314955  5834 raft_consensus.cc:3055] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:11.317936  3930 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:11.331140  3923 rpcz_store.cc:276] 0709 12:14:10.279798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.280000 (+   202us) service_pool.cc:224] Handling call
0709 12:14:11.296227 (+1016227us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b5400679154. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:11.296396 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":731167616}
I20260709 12:14:11.312371  5849 consensus_queue.cc:1059] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:11.333957  3341 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:14:11.285240  5846 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:11.294238  5608 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:11.352632  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:11.356504  3263 raft_consensus.cc:2410] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:11.352890  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:11.357200  3193 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:11.357322  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:11.353749  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:11.322335  5797 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.245119  5685 consensus_queue.cc:1059] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:14:11.360154  3264 raft_consensus.cc:2393] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:11.363865  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:11.364665  3261 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:11.366482  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:11.370059  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:11.335955  5723 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:11.345207  5856 log.cc:927] Time spent T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:11.338160  5776 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.337847  5688 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:11.344403  5846 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:11.337895  5834 raft_consensus.cc:740] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:14:11.411917  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 45534us
I20260709 12:14:11.411190  3306 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:11.329036  5294 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:11.422186  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 52233.7us
I20260709 12:14:11.371095  5697 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.373456  5849 consensus_queue.cc:1243] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer 6f0cdd57c5934921829c205d32b2b8a5 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:11.339702  5670 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:14:11.369481  5733 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:11.436240  5294 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:11.446652  5697 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:11.294857  5851 consensus_queue.cc:260] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.433624  5723 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:11.406436  5797 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:11.438436  5810 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:11.447201  5860 log.cc:927] Time spent T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:14:11.449393  5697 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:11.456518  5701 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:11.429652  5846 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:11.446661  5861 log.cc:927] Time spent T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:14:11.508599  5826 consensus_queue.cc:1059] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:14:11.513350  5826 raft_consensus.cc:3055] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:11.513775  5826 raft_consensus.cc:740] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:11.453863  5780 raft_consensus.cc:3055] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:11.449025  5848 raft_consensus.cc:993] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:14:11.375254  5608 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:11.407928  5750 consensus_queue.cc:1059] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:14:11.514720  5826 consensus_queue.cc:260] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.458387  5869 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:11.465549  5702 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:11.486213  5797 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:11.429051  5776 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.466985  5759 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:11.486989  5810 raft_consensus.cc:697] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:11.515611  5780 raft_consensus.cc:740] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:11.550125  5608 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:11.541105  5848 raft_consensus.cc:3055] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:11.550371  5780 consensus_queue.cc:260] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.551012  5848 raft_consensus.cc:740] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:11.551975  5848 consensus_queue.cc:260] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.531123  5742 raft_consensus.cc:1081] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:14:11.506747  5733 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:11.410175  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:11.457510  5294 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:11.756880  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.780148  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.768112  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.841003  5857 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.711640  3259 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:14:11.843791  3259 pending_rounds.cc:85] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 4
I20260709 12:14:11.745167  3193 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:11.854586  5780 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:11.857946  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.858238  3260 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.845954  3259 pending_rounds.cc:107] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:14:11.575044  5691 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.620880  5846 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:11.616488  5852 consensus_meta.cc:287] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.536s	user 0.005s	sys 0.006s
I20260709 12:14:11.862572  5852 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:11.863554  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 102044us
I20260709 12:14:11.865581  5852 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:11.865729  5294 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:11.680732  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 481901us
I20260709 12:14:11.724372  3261 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:11.613926  5813 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:11.727022  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 365980us
I20260709 12:14:11.873075  3259 raft_consensus.cc:2889] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:11.576030  5810 consensus_queue.cc:237] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.877063  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:11.877542  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.878171  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.553242  5776 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:11.881480  3185 raft_consensus.cc:1240] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:11.881331  5702 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.882292  5702 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.885979  3342 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:11.890379  3333 raft_consensus.cc:1275] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:11.535702  5869 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.891386  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:11.891933  5869 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:11.641683  5723 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.893765  3333 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:11.894261  5806 consensus_meta.cc:287] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.000s
I20260709 12:14:11.894919  5806 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:11.780993  5296 consensus_queue.cc:1059] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:14:11.902513  5296 raft_consensus.cc:3055] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:11.902638  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:11.902993  5296 raft_consensus.cc:740] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:11.903566  3927 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:11.891954  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:11.905314  3932 raft_consensus.cc:2410] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:14:11.794791  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 596486us
I20260709 12:14:11.894863  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:11.631094  5805 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:11.842200  5857 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:11.921754  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:11.922291  3923 raft_consensus.cc:2410] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:11.923022  3156 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:11.921756  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:11.923899  3342 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:11.924367  5813 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:11.924993  3156 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:11.926712  5813 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:11.928582  3185 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:11.929630  5805 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:11.929888  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:11.931173  3335 raft_consensus.cc:2393] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:11.934587  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:11.929646  3340 raft_consensus.cc:1240] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:11.938222  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:11.939345  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:11.941012  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:11.946930  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.936036  5826 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:11.904546  5296 consensus_queue.cc:260] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:11.949827  3932 raft_consensus.cc:1240] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:11.949972  5846 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:11.951063  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:11.952118  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:11.926941  3156 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:11.964648  3342 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
W20260709 12:14:11.966276  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 126914us
I20260709 12:14:11.970038  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:11.957113  5702 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:11.975019  3193 raft_consensus.cc:2393] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:11.975682  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.979527  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 52701.6us
W20260709 12:14:11.982607  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.986151  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.986785  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.987107  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.969945  5733 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:11.992455  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:11.993680  3335 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
W20260709 12:14:11.994640  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 480392us
I20260709 12:14:11.997602  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:12.000008  5294 raft_consensus.cc:2804] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:12.000238  5881 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:12.000492  5294 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.001019  5294 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:12.006130  5535 raft_consensus.cc:3055] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:12.006574  5535 raft_consensus.cc:740] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:12.007531  5849 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.007877  5535 consensus_queue.cc:260] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.008246  5849 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.009742  5535 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.010694  5776 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.011678  5776 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.013073  5857 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:12.014211  5776 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:12.014912  5807 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.019091  3336 raft_consensus.cc:1240] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:12.021260  3342 raft_consensus.cc:1240] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:12.022020  3335 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:12.000993  5881 raft_consensus.cc:697] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:12.026242  5881 consensus_queue.cc:237] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:12.027871  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 93532.6us
I20260709 12:14:12.029917  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:12.031749  5890 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:12.020000  5849 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:12.037770  5766 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:12.038170  3896 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:12.040520  5869 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:12.041771  5889 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.120s	user 0.004s	sys 0.000s
I20260709 12:14:12.042887  5869 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:12.043875  3157 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:12.044824  5834 consensus_queue.cc:260] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.045672  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:12.046449  5834 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:12.049757  5294 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.038940  5848 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:12.039299  3305 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:12.039831  5659 consensus_queue.cc:1059] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:12.067857  5770 raft_consensus.cc:2804] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:12.068462  5770 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:12.068921  5770 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:12.072599  5874 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:12.073972  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:12.076916  5659 raft_consensus.cc:3055] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:12.077322  5659 raft_consensus.cc:740] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:12.077747  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:12.078462  3930 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:12.078387  5659 consensus_queue.cc:260] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.080157  5685 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:12.084620  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 45503us
I20260709 12:14:12.085273  5688 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:12.085698  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:12.085924  5688 raft_consensus.cc:697] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:12.086742  5697 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:12.087729  5659 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.093410  3305 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:12.094396  5702 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:12.124480  3260 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
W20260709 12:14:12.148027  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 48623.8us
I20260709 12:14:12.174486  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:12.176177  5869 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:12.176252  5702 consensus_queue.cc:1059] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:12.176859  5869 raft_consensus.cc:697] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:12.177748  5888 raft_consensus.cc:3055] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:12.177821  3156 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:12.178308  5888 raft_consensus.cc:740] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:12.178112  5869 consensus_queue.cc:237] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.178911  5593 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.179502  3156 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:12.179549  5888 consensus_queue.cc:260] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.180709  5870 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:12.181183  5888 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:12.182273  5685 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:12.182610  3305 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:12.186280  5807 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:12.189358  3305 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:12.087111  5688 consensus_queue.cc:237] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.192998  5296 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.194326  5849 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.201664  3930 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
W20260709 12:14:12.195443  5603 consensus_meta.cc:287] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.802s	user 0.017s	sys 0.002s
I20260709 12:14:12.182891  5685 raft_consensus.cc:697] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:12.181282  3156 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:12.194145  5770 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.197924  5851 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.208770  3306 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:12.215165  5294 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:12.215042  3267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:40120
I20260709 12:14:12.218990  3267 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:12.219477  3267 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:12.229019  3231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 2.087s (SENT) [suppressed 93 similar messages]
I20260709 12:14:12.223587  5849 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.223639  5834 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:12.239822  5888 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:12.244200  5685 consensus_queue.cc:237] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:12.249693  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 60458.7us
I20260709 12:14:12.254545  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:12.256099  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.258279  5888 raft_consensus.cc:697] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:12.259258  3335 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:12.261617  3260 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:12.262859  3335 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:14:12.264165  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:12.265681  3336 raft_consensus.cc:1240] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:12.267025  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:12.267799  3336 raft_consensus.cc:2410] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:12.246318  3267 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.224915  5870 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:12.208688  5603 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:12.282845  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.290630  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 109470us
I20260709 12:14:12.292631  3260 raft_consensus.cc:1240] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:12.295297  3335 raft_consensus.cc:1240] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:12.278120  5849 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:12.305999  5593 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:12.307580  3262 raft_consensus.cc:1240] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:12.310060  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.313297  3261 raft_consensus.cc:1240] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:12.316016  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 268644us
I20260709 12:14:12.274585  5888 consensus_queue.cc:237] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.319715  3267 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:12.315304  5884 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.327256  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:12.327515  5884 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.328280  3930 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:12.328711  3334 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:14:12.330245  5884 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:12.327549  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:12.332098  3929 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:14:12.332373  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 55756.2us
I20260709 12:14:12.334931  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:12.348014  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.353703  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.335206  5780 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.370314  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:12.377328  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:12.377480  3334 raft_consensus.cc:1240] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:12.372951  5603 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:12.385313  5893 log.cc:927] Time spent T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4: Append to log took a long time: real 0.416s	user 0.001s	sys 0.002s
I20260709 12:14:12.385968  3336 raft_consensus.cc:1240] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:12.387585  5780 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.390043  5826 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:14:12.396625  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 75493.4us
I20260709 12:14:12.398525  3341 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:14:12.402662  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.405625  3157 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:12.407830  5593 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:12.408314  5593 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.408689  5593 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.413250  5834 consensus_queue.cc:1059] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:12.414649  3342 raft_consensus.cc:1240] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:12.414692  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:12.415560  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:12.389338  3928 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:12.395347  5296 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.430593  5294 consensus_queue.cc:1059] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:12.467971  5296 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.468854  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:12.469513  3262 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:12.437778  5905 log.cc:927] Time spent T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 12:14:12.471982  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:12.473102  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:12.473668  3339 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:12.418687  5874 consensus_queue.cc:1048] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:14:12.475840  5874 consensus_queue.cc:1243] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer eb49d92feeb14382b3baa49d696b6141 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:14:12.438517  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:12.477154  3262 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:12.477540  3338 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:12.439071  3337 raft_consensus.cc:1240] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:12.481751  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:12.482457  3337 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:12.427814  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:12.439460  3268 raft_consensus.cc:1240] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:12.440104  3341 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:12.440667  3335 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:12.442901  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:12.492274  3336 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:12.446957  3232 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:12.493372  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:12.493765  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:12.494035  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:12.494653  3259 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:12.448545  5780 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:12.494837  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:12.493060  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:12.496547  3262 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:12.447268  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:12.499998  3333 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:12.452857  5770 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:12.503854  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 56978.2us
I20260709 12:14:12.460628  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:12.504822  3930 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:12.463994  3928 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:12.462386  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:12.464799  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.521522  3930 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:12.521977  3262 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:12.466449  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:12.522716  3338 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:12.422451  5851 consensus_queue.cc:1059] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:14:12.494127  3261 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:12.454484  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:12.459311  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:12.514827  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.516127  5599 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:12.534981  3334 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:12.516943  5780 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:12.503912  5770 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:12.523059  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.526384  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.529111  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 113654us
I20260709 12:14:12.540535  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:12.540719  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:12.534310  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:12.544844  3333 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
W20260709 12:14:12.552004  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.553980  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 133027us
I20260709 12:14:12.540398  3157 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:12.568346  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:12.569267  3267 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
W20260709 12:14:12.569471  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.570433  3339 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:12.571949  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:12.575220  3185 raft_consensus.cc:2393] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:12.571765  3896 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:12.534541  5599 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.576459  5599 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.577593  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:12.567898  5870 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.568270  5776 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:12.579241  5776 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.579749  5776 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:12.579504  5770 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:12.580389  5535 consensus_meta.cc:287] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.003s
I20260709 12:14:12.578895  5870 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.582520  5870 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:12.584996  5845 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:12.585611  3190 raft_consensus.cc:1240] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:12.574002  5603 consensus_queue.cc:1048] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:14:12.587968  5750 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.588653  5294 raft_consensus.cc:3055] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:12.589111  5294 raft_consensus.cc:740] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:12.588454  5750 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.590179  5294 consensus_queue.cc:260] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.591526  3337 raft_consensus.cc:1240] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:12.591658  5750 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:12.595745  5296 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:12.596450  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.535408  5881 raft_consensus.cc:3055] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:12.599658  3156 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:12.600803  5834 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.601491  3156 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:12.603451  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:12.579697  3189 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:12.585026  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:12.609110  3259 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
W20260709 12:14:12.615633  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 43967.7us
W20260709 12:14:12.622932  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 82689.4us
I20260709 12:14:12.633934  3190 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:12.634896  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:12.636050  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:12.636679  3190 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:14:12.637487  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:12.599702  5881 raft_consensus.cc:740] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:12.641623  5881 consensus_queue.cc:260] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.644078  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:12.624176  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:12.649549  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:12.650431  3337 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:12.625252  5294 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:12.654191  3187 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:12.656682  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:12.657559  3187 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:12.658989  3187 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:12.626673  5826 raft_consensus.cc:2804] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:12.627672  5852 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:12.610776  5780 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:14:12.606877  5593 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.666152  3896 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:12.630594  5847 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:12.668193  3157 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:12.669708  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:12.660697  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:12.666996  5535 raft_consensus.cc:2804] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:12.683907  3187 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:14:12.683604  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 98674.1us
I20260709 12:14:12.671258  5750 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:12.671310  5826 raft_consensus.cc:697] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:12.677752  5874 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:12.678519  3928 raft_consensus.cc:3055] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:12.697141  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:12.692315  5685 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:12.691999  5750 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.713145  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:12.695206  5535 raft_consensus.cc:697] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:12.702486  5881 raft_consensus.cc:3060] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.700851  5770 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:12.718140  3157 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:12.710922  5890 consensus_queue.cc:1059] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:12.690302  5834 consensus_queue.cc:1059] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:14:12.694582  5847 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:14:12.727887  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:12.723816  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:12.719152  5603 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:14:12.688824  5884 consensus_queue.cc:1059] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:14:12.732455  3342 pending_rounds.cc:85] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 2
I20260709 12:14:12.705107  3928 raft_consensus.cc:740] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:12.745765  5845 raft_consensus.cc:2804] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:12.715799  5874 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:14:12.714190  5750 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:12.733842  5685 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.779403  5685 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:12.783825  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 76004.5us
I20260709 12:14:12.785028  3305 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:12.791684  5807 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:12.793711  5697 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:12.753489  3339 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:12.760043  3342 pending_rounds.cc:107] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:12.767762  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:12.768532  3184 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:12.803886  3342 raft_consensus.cc:2889] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:12.774387  5845 raft_consensus.cc:697] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:12.772303  3928 consensus_queue.cc:260] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:12.804561  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.753247  5870 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.811725  5870 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.814363  5870 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:12.815564  5912 log.cc:927] Time spent T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:12.816685  5535 consensus_queue.cc:237] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:14:12.820261  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 159744us
W20260709 12:14:12.823709  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.828243  3185 raft_consensus.cc:1240] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:12.832347  5807 raft_consensus.cc:697] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:12.833592  5807 consensus_queue.cc:237] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.834456  5770 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.835031  5770 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.838172  5770 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:12.839090  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 121044us
W20260709 12:14:12.855577  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 68310.2us
I20260709 12:14:12.763257  5593 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:12.859572  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:12.728998  5826 consensus_queue.cc:237] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.858161  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:12.798252  5688 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:12.871616  5834 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.874934  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:12.860472  5770 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:12.864886  3928 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:12.857892  5599 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:12.893424  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.872231  5874 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 12:14:12.941177  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.944978  3929 raft_consensus.cc:1240] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:12.948804  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 84688.8us
I20260709 12:14:12.900182  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:12.950623  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:12.903052  5848 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.907536  5602 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:12.959762  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:12.959713  5602 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.961223  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:12.962352  5884 raft_consensus.cc:2804] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:12.962916  5884 raft_consensus.cc:697] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:12.962971  5915 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:12.963897  5915 consensus_queue.cc:1059] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:12.964143  5884 consensus_queue.cc:237] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.964937  5915 raft_consensus.cc:3055] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:12.965338  5915 raft_consensus.cc:740] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:12.966217  5915 consensus_queue.cc:260] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.963016  3232 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:12.868144  5688 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.882990  5770 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.913601  3184 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:12.913967  5845 consensus_queue.cc:237] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.979562  5776 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.981678  5776 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:12.915978  5603 raft_consensus.cc:3055] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:12.916766  5296 raft_consensus.cc:3055] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:12.983315  5603 raft_consensus.cc:740] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:12.983471  5296 raft_consensus.cc:740] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:12.984275  5603 consensus_queue.cc:260] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.984541  5296 consensus_queue.cc:260] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.985419  5603 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:12.985793  5296 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:12.988219  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.916543  5685 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:12.921836  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:12.924361  5852 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:12.924602  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:12.927343  5847 raft_consensus.cc:3055] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:12.895586  5807 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:12.928138  5918 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:12.928344  3341 raft_consensus.cc:1240] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:12.930783  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:13.013042  3930 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:13.013280  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.932009  3339 raft_consensus.cc:1240] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:12.933435  5750 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:12.953303  3193 raft_consensus.cc:2393] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:12.956574  5911 log.cc:927] Time spent T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:14:12.972896  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:12.975740  5888 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.976380  5874 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:12.959051  5848 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:12.988642  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.996762  3189 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.997151  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:12.971690  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.016448  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.001916  5593 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.027464  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.027559  5593 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.028501  5685 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:13.028744  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.029140  5685 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:13.029381  3184 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:13.029901  5593 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:13.029687  5685 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:13.030231  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.032214  5688 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:13.032739  5848 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:13.033075  5776 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.033696  5776 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:13.031319  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:13.035629  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 72724.4us
I20260709 12:14:13.036164  3184 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:13.036646  5780 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:13.037230  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.038103  3193 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:13.038329  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.039032  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.040369  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.041342  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:13.042080  3268 raft_consensus.cc:2393] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:13.042950  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:13.044263  3930 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:13.044659  3262 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:13.046911  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.047580  5918 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:13.049989  5918 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:13.050132  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:13.050827  3336 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:13.001724  5849 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:13.048187  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.001111  5847 raft_consensus.cc:740] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:13.031025  3928 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:13.053005  5807 raft_consensus.cc:697] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:13.039348  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.055574  3929 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:13.055930  3184 raft_consensus.cc:2376] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4. Re-sending same reply.
W20260709 12:14:13.057693  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 87170.8us
I20260709 12:14:13.059726  5826 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.059973  3895 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:13.060043  5702 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:13.060266  5922 consensus_queue.cc:1059] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:13.060863  5702 raft_consensus.cc:697] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:13.061621  5869 raft_consensus.cc:3055] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:13.061528  5826 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:13.061964  5702 consensus_queue.cc:237] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.060956  5599 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:13.063614  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.059278  3305 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:13.064906  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.021240  5834 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.070523  3896 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:13.072501  3305 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:13.068305  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.068426  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.068912  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.024363  5915 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:13.074066  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.076296  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.077298  5810 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.077575  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.076190  5780 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.078996  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.077853  5810 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.079762  5810 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.080082  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.081067  3184 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:13.081907  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.082403  3184 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:13.083089  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.078824  5780 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.089694  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.089922  5780 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:13.090924  5688 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.001649  5890 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:14:13.059368  5685 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:13.062024  5869 raft_consensus.cc:740] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:13.102491  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.097573  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.094606  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:13.067173  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:13.106550  3185 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.100311  5443 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:13.059743  5923 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.091161  5776 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:13.100404  5922 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:13.024369  5888 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:13.114185  3305 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:13.108582  3927 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.100539  5688 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:13.128163  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.128964  3193 raft_consensus.cc:2376] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4. Re-sending same reply.
W20260709 12:14:13.129307  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.129829  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.135787  3189 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
W20260709 12:14:13.143574  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.091293  5834 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.095378  5848 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:14:13.152925  3193 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:13.154985  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.115270  5870 raft_consensus.cc:2764] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:13.057713  5807 consensus_queue.cc:237] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.160627  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:13.173276  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.146391  5688 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.176671  3193 raft_consensus.cc:2410] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:13.175299  3192 raft_consensus.cc:2410] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:14:13.093245  5874 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:13.179987  3261 raft_consensus.cc:1275] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:14:13.180435  3261 pending_rounds.cc:85] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 2
I20260709 12:14:13.180678  3261 pending_rounds.cc:107] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:14:13.151932  5697 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:13.188028  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 166168us
I20260709 12:14:13.179718  3262 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:13.198773  3261 raft_consensus.cc:2889] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:13.205356  5922 raft_consensus.cc:697] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:14:13.208458  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.209895  3184 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:13.210551  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.211198  3193 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:13.213354  3189 raft_consensus.cc:1240] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:13.214742  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:13.223246  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:13.119261  5923 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:13.234622  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:13.232548  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:13.248875  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:13.217489  5697 raft_consensus.cc:697] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:13.255250  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:13.255535  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.256211  3191 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:13.256897  3189 raft_consensus.cc:1240] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:13.248167  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:13.322691  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:13.341076  5934 log.cc:927] Time spent T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.155s	user 0.000s	sys 0.002s
I20260709 12:14:13.337848  5922 consensus_queue.cc:237] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.353127  5851 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.353974  5888 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:13.357486  3189 raft_consensus.cc:1240] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:14:13.256213  3264 raft_consensus.cc:2393] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:13.337680  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:13.396373  3263 raft_consensus.cc:2410] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:13.313407  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:13.403039  3339 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.382256  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:13.404538  3930 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:14:13.383464  3193 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
W20260709 12:14:13.249593  5837 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:14:13.310914  5931 log.cc:927] Time spent T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:13.262466  3342 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
W20260709 12:14:13.463469  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 154920us
I20260709 12:14:13.466073  3193 raft_consensus.cc:1240] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:14:13.306375  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.468246  3191 raft_consensus.cc:2393] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:13.322858  5902 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:14:13.433645  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.355890  5874 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:13.308537  5770 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:13.477710  3190 raft_consensus.cc:1240] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 12:14:13.477679  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:13.396780  5930 log.cc:927] Time spent T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:14:13.484840  3189 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:13.306370  5890 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:13.494330  3305 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
W20260709 12:14:13.476081  5881 consensus_meta.cc:287] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.754s	user 0.006s	sys 0.005s
I20260709 12:14:13.492403  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.516469  3191 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:13.233623  5869 consensus_queue.cc:260] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:13.513388  5847 consensus_queue.cc:260] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.524740  5847 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.256218  5697 consensus_queue.cc:237] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.531821  5950 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:13.532429  5950 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:13.532866  5950 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:13.533506  5810 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:13.539695  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 45687.8us
I20260709 12:14:13.540318  5942 consensus_queue.cc:1059] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:14:13.541642  5942 raft_consensus.cc:3055] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:13.542092  5942 raft_consensus.cc:740] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:13.542140  3305 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:13.545549  5956 consensus_queue.cc:1059] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:13.546654  5956 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:13.519531  5933 log.cc:927] Time spent T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 12:14:13.521642  5920 log.cc:927] Time spent T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.598s	user 0.006s	sys 0.000s
I20260709 12:14:13.570544  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.577879  3186 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:14:13.580889  3189 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
W20260709 12:14:13.546729  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.586305  3305 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:13.602819  3306 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:13.469336  5851 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:13.515455  5776 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.547067  5956 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:13.640920  3187 raft_consensus.cc:1240] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:14:13.640038  3930 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:13.646235  3928 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:14:13.653752  3928 pending_rounds.cc:85] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: Aborting all ops after (but not including) 6
I20260709 12:14:13.654100  3928 pending_rounds.cc:107] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:14:13.654377  3928 raft_consensus.cc:2889] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:13.640487  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:13.661454  3341 raft_consensus.cc:1240] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:13.686185  3185 consensus_meta.cc:287] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.000s
W20260709 12:14:13.687868  5932 log.cc:927] Time spent T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
I20260709 12:14:13.691598  5776 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.694597  5776 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:13.695274  5945 raft_consensus.cc:3055] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:13.695789  5945 raft_consensus.cc:740] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:13.696269  5810 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:13.697628  3188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1660) took 1062 ms. Trace:
I20260709 12:14:13.698057  3188 rpcz_store.cc:276] 0709 12:14:12.584359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.630859 (+ 46500us) service_pool.cc:224] Handling call
0709 12:14:12.656601 (+ 25742us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:12.673293 (+ 16692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:12.673344 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:12.684198 (+ 10854us) log.cc:844] Serialized 26 byte log entry
0709 12:14:12.837977 (+153779us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:12.838029 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.838111 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:13.519410 (+681299us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:13.616401 (+ 96991us) raft_consensus.cc:1685] finished
0709 12:14:13.616447 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.646694 (+ 30247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7284,"raft.queue_time_us":14232,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":9799,"spinlock_wait_cycles":40500992,"thread_start_us":107317,"threads_started":1,"wal-append.queue_time_us":222992}
I20260709 12:14:13.615947  5834 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:13.735338  3190 raft_consensus.cc:1240] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:14:13.736425  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.668150  5956 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:13.738869  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.742726  3193 raft_consensus.cc:2368] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7.
I20260709 12:14:13.743853  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.740612  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.740510  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.569896  5890 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:13.749253  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.747599  3193 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:13.616254  5780 consensus_queue.cc:1059] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:14:13.724812  5702 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.751610  3190 raft_consensus.cc:2393] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:13.752372  3191 raft_consensus.cc:2368] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7.
I20260709 12:14:13.696805  5945 consensus_queue.cc:260] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.754833  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:13.743016  5936 log.cc:927] Time spent T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 12:14:13.759843  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.737697  5776 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.632562  5296 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:13.616680  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 227360us
I20260709 12:14:13.775025  5296 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.789525  5296 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:13.543236  5942 consensus_queue.cc:260] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.505725  3339 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:13.687012  3185 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:13.749981  5951 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.809170  3190 raft_consensus.cc:1240] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:13.755966  5702 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.786674  5780 consensus_queue.cc:1243] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer 6f0cdd57c5934921829c205d32b2b8a5 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:13.828773  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:13.827509  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:13.828073  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 225354us
I20260709 12:14:13.812002  5945 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:13.855975  3895 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:13.888521  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 102860us
I20260709 12:14:13.889385  3232 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:13.819406  5888 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.789635  5776 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.892375  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.891322  3193 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:13.894143  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.814427  5697 raft_consensus.cc:2804] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:13.896126  3193 raft_consensus.cc:2368] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7.
I20260709 12:14:13.896862  3191 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:13.897564  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:13.817801  5702 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.898516  3193 raft_consensus.cc:2368] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7.
W20260709 12:14:13.900517  3266 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.004s	sys 0.006s
I20260709 12:14:13.901017  5890 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:13.890945  5952 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.902124  5952 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.904574  5952 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:13.905177  5851 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:13.905929  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:13.913251  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:13.913988  3333 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:13.914995  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:13.916466  5443 consensus_meta.cc:287] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.802s	user 0.009s	sys 0.001s
I20260709 12:14:13.938702  5952 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.938885  5443 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:13.939472  5952 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.941684  5952 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:13.942315  5602 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:13.942552  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:13.922977  3927 consensus_meta.cc:287] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.764s	user 0.005s	sys 0.004s
I20260709 12:14:13.896394  5780 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:13.943373  5826 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:13.817317  5951 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:13.924309  5888 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.940892  5950 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.943184  3191 raft_consensus.cc:2376] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7. Re-sending same reply.
W20260709 12:14:13.944219  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:13.973847  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.943869  5780 raft_consensus.cc:697] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:13.899966  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.978945  3193 raft_consensus.cc:2393] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:13.922477  5956 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:13.923226  5697 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:13.988173  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:13.991571  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 135656us
W20260709 12:14:13.991866  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.946934  5923 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:13.946075  3927 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:13.995573  3334 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:14.009488  3339 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:14.010228  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:13.946923  5851 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:13.994339  5697 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:13.994144  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 94393us
W20260709 12:14:13.998677  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.000627  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.019260  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.019964  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.020546  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.020963  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.066710  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.008083  5845 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:14.020978  5914 log.cc:927] Time spent T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 1.103s	user 0.007s	sys 0.009s
I20260709 12:14:14.069765  3895 leader_election.cc:400] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7.
I20260709 12:14:14.076208  3895 leader_election.cc:403] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:14:14.066176  5688 consensus_meta.cc:287] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.848s	user 0.008s	sys 0.004s
I20260709 12:14:14.023541  5953 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.092706  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:14.094213  5949 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.096331  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:14.097539  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 87808.7us
I20260709 12:14:14.098260  5946 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:14.098688  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55426 (request call id 531) took 1472 ms. Trace:
W20260709 12:14:14.099864  5960 log.cc:927] Time spent T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:14:14.108909  3190 raft_consensus.cc:1240] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:14.111696  3188 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:14.114060  3187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40510 (request call id 1857) took 1446 ms. Trace:
W20260709 12:14:14.119024  5958 log.cc:927] Time spent T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.223s	user 0.000s	sys 0.003s
I20260709 12:14:14.120007  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40510 (request call id 1860) took 1399 ms. Trace:
I20260709 12:14:14.125614  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55426 (request call id 534) took 1487 ms. Trace:
I20260709 12:14:14.126648  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:14.115118  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:14.128142  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:14.152822  3187 rpcz_store.cc:276] 0709 12:14:12.667528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.700160 (+ 32632us) service_pool.cc:224] Handling call
0709 12:14:13.616710 (+916550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.651970 (+ 35260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.113772 (+461802us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54000be850. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:14.113952 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2085222784}
I20260709 12:14:14.152901  3157 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:14.132001  5780 consensus_queue.cc:237] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.133350  5938 raft_consensus.cc:3055] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:14.162281  3895 leader_election.cc:400] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7.
I20260709 12:14:14.162748  3895 leader_election.cc:403] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:14:14.133666  5968 log.cc:927] Time spent T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:14:14.135648  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 64616.9us
W20260709 12:14:14.138288  5847 consensus_meta.cc:287] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.000s
I20260709 12:14:14.156657  3192 rpcz_store.cc:276] 0709 12:14:12.720774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.758593 (+ 37819us) service_pool.cc:224] Handling call
0709 12:14:14.119687 (+1361094us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54003c78d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:14.119886 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852908928}
I20260709 12:14:14.157171  3932 rpcz_store.cc:276] 0709 12:14:12.638578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.639454 (+   876us) service_pool.cc:224] Handling call
0709 12:14:12.640004 (+   550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:12.640576 (+   572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:12.640622 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:12.641398 (+   776us) log.cc:844] Serialized 26 byte log entry
0709 12:14:12.856943 (+215545us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:12.857038 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.857301 (+   263us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:13.947085 (+1089784us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:14.125322 (+178237us) raft_consensus.cc:1685] finished
0709 12:14:14.125344 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.125553 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":51335808,"thread_start_us":214821,"threads_started":1,"wal-append.queue_time_us":276414}
I20260709 12:14:14.191797  5956 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:14.192207  3184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40510 (request call id 1889) took 1207 ms. Trace:
I20260709 12:14:14.192579  3184 rpcz_store.cc:276] 0709 12:14:12.985192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.082944 (+ 97752us) service_pool.cc:224] Handling call
0709 12:14:14.192052 (+1109108us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54001513d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:14.192155 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290369920}
I20260709 12:14:14.149508  5953 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.196951  5953 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:14.197225  3186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40510 (request call id 1853) took 1562 ms (client timeout 2005 ms). Trace:
I20260709 12:14:14.161700  5890 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:14.080468  5845 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:14.198963  3232 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:14.197696  3186 rpcz_store.cc:269] 0709 12:14:12.634536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.661632 (+ 27096us) service_pool.cc:224] Handling call
0709 12:14:14.197069 (+1535437us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54000e47d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:14.197168 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077467520}
I20260709 12:14:14.189267  5881 consensus_queue.cc:1059] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:14:14.205041  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:14.201815  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:14.206394  3189 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:14.209350  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:14.210094  3184 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:14.176011  5593 consensus_queue.cc:1059] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:14:14.161507  5938 raft_consensus.cc:740] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:14.146490  5688 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.237699  5688 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:14.238654  5890 raft_consensus.cc:697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:14.239758  5890 consensus_queue.cc:237] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.240808  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:14.241629  3190 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
W20260709 12:14:14.242321  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.242686  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:14.240749  3186 raft_consensus.cc:1275] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:14.243639  3188 raft_consensus.cc:1275] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:14:14.244786  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:14.245373  3186 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:14.245980  3185 raft_consensus.cc:3055] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:14.246364  3185 raft_consensus.cc:740] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:14.246987  3186 raft_consensus.cc:1275] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:14.184172  3927 raft_consensus.cc:2393] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:14:14.214737  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.191061  5776 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:14.249456  3190 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:14.188772  5837 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7.
I20260709 12:14:14.250922  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:14.247133  3185 consensus_queue.cc:260] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.245419  3188 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:14.263571  3338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 2078) took 1047 ms. Trace:
I20260709 12:14:14.156961  5949 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.252516  3187 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:14:14.230708  5951 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:14.268484  3185 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:14.279443  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 128658us
I20260709 12:14:14.264173  3338 rpcz_store.cc:276] 0709 12:14:13.215785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.215945 (+   160us) service_pool.cc:224] Handling call
0709 12:14:13.216243 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.473923 (+257680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.473958 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:13.519887 (+ 45929us) log.cc:844] Serialized 26 byte log entry
0709 12:14:13.707419 (+187532us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:13.740579 (+ 33160us) log.cc:844] Serialized 14 byte log entry
0709 12:14:13.741168 (+   589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.111239 (+370071us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:14.263074 (+151835us) spinlock_profiling.cc:243] Waited 92.7 ms on lock 0x7b5400078854. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:14.263145 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:14.263219 (+    74us) raft_consensus.cc:1685] finished
0709 12:14:14.263243 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.263487 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14778,"prepare.queue_time_us":34974,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":261811,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":12701,"spinlock_wait_cycles":227212928,"thread_start_us":336329,"threads_started":2,"wal-append.queue_time_us":292298}
I20260709 12:14:14.262286  5776 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.267959  5881 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.304203  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:14.292233  5951 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:14.313656  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 133694us
I20260709 12:14:14.320603  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:14.323058  3157 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:14.286955  5697 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.324232  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:14.331830  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 132968us
I20260709 12:14:14.308897  5881 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:14.151691  3926 rpcz_store.cc:276] 0709 12:14:12.626577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.630293 (+  3716us) service_pool.cc:224] Handling call
0709 12:14:12.870250 (+239957us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:14:12.870472 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.024993 (+154521us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:13.090761 (+ 65768us) log.cc:844] Serialized 14 byte log entry
0709 12:14:13.300099 (+209338us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.306801 (+  6702us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:13.311000 (+  4199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.097586 (+786586us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b1800325fc0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4ae2a6 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419
0709 12:14:14.098333 (+   747us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400373cd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:14.098368 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.098494 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16688,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":110497,"raft.run_wall_time_us":5228,"spinlock_wait_cycles":369254528,"thread_start_us":135765,"threads_started":2,"wal-append.queue_time_us":222235}
I20260709 12:14:14.336383  3895 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:14.337157  5697 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:14.337950  5953 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:14.340184  5443 consensus_queue.cc:1059] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:14.341370  5443 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:14.342504  3340 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:14:14.333918  3338 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:14.344316  5949 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:14.334589  3232 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:14.310549  5776 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:14.345180  5851 raft_consensus.cc:3055] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:14.345641  5851 raft_consensus.cc:740] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:14.351596  3185 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:14:14.352087  3185 pending_rounds.cc:85] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: Aborting all ops after (but not including) 7
I20260709 12:14:14.352353  3185 pending_rounds.cc:107] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:14:14.302711  5938 consensus_queue.cc:260] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.318013  5951 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:14.358309  5981 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:14.358520  5951 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:14.352649  3185 raft_consensus.cc:2889] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:14.358944  5981 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.361112  5869 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:14.361125  5981 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:14.370294  5942 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:14.370702  5981 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:14.372200  5978 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:14.372681  5978 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.373011  5978 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:14.373415  5981 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:14.370702  5702 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:14.385500  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:14.390583  3189 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:14.383163  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:14.391793  3184 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:14.383821  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:14.380965  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:14.392791  3188 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:14.392887  3334 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
W20260709 12:14:14.404654  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.333241  5837 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:14.414043  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.414508  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.414881  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 75870.8us
I20260709 12:14:14.416090  3341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 1998) took 1165 ms. Trace:
I20260709 12:14:14.416687  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:14.417479  3338 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.419981  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:14.420986  3184 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:14.424995  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:14.416520  3341 rpcz_store.cc:276] 0709 12:14:13.221722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.335789 (+114067us) service_pool.cc:224] Handling call
0709 12:14:13.346240 (+ 10451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.701133 (+354893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.386467 (+685334us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b5400079754. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:14.386651 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715351424}
W20260709 12:14:14.429068  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 96517.9us
I20260709 12:14:14.431938  3339 raft_consensus.cc:1240] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:14.377722  5847 raft_consensus.cc:3055] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:14.436766  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:14.426873  5974 log.cc:927] Time spent T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:14:14.408070  5845 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:14.438359  5296 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:14.426283  5938 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:14.439368  3232 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:14.431237  5688 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:14:14.448190  5296 raft_consensus.cc:697] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:14.426990  5776 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:14.450241  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:14.452479  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:14.455689  3184 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:14:14.456772  5973 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:14.457244  5973 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.457592  5973 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.459635  5750 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:14.459664  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:14.460501  3185 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.461311  5702 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:14.460963  5296 consensus_queue.cc:237] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.463169  5881 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:14.463495  5870 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:14.464025  5977 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:14.463753  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 750) took 1467 ms. Trace:
I20260709 12:14:14.467084  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:14.467721  3334 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:14.469130  3185 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:14.469340  3338 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:14.470818  3305 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:14.438028  5847 raft_consensus.cc:740] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:14.432991  5975 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:14.480198  3896 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:14.474802  3336 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:14.346644  5851 consensus_queue.cc:260] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.433316  5951 consensus_queue.cc:1048] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:14:14.433197  5697 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:14:14.486699  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:14.455830  5979 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:14.492589  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:14.495595  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 140448us
I20260709 12:14:14.472859  5870 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:14.504065  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:14.508028  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:14.509058  3185 raft_consensus.cc:2410] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:14:14.509142  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.510764  3334 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:14.516245  3305 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:14.480055  5602 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:14:14.481621  5750 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:14:14.497607  5979 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.481966  5977 consensus_queue.cc:1059] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:14:14.521298  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:14.523705  3334 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:14:14.507505  5688 raft_consensus.cc:2804] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:14.524117  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 75049.3us
I20260709 12:14:14.524480  3339 raft_consensus.cc:1240] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:14.525094  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:14.488054  5975 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:14.527069  5941 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:14.543031  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:14.549008  5937 log.cc:927] Time spent T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 1.084s	user 0.000s	sys 0.013s
I20260709 12:14:14.542906  5750 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:14.505781  5702 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:14.517777  5952 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:14.521981  5956 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:14.557436  3335 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:14:14.617504  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.619397  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.624429  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.533155  5979 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:14.617462  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 83034.9us
I20260709 12:14:14.620692  3339 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:14.542204  5688 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.607277  5941 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:14.637756  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 188393us
I20260709 12:14:14.465142  3923 rpcz_store.cc:276] 0709 12:14:12.996683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.999322 (+  2639us) service_pool.cc:224] Handling call
0709 12:14:13.256098 (+256776us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8eee 000000000036eb39 00007f1af351c1e0 00007f1af35e50c4 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:14:13.256274 (+   176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:14.094322 (+838048us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b18002d05e0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aee1754bc 00007f1aeb4c348b 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dd455 00007f1aee5c5060 00007f1aee5c5bfb 00007f1aee5d064b
0709 12:14:14.094460 (+   138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.094488 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:14.095046 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:14:14.292124 (+197078us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:14.293687 (+  1563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.304011 (+ 10324us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:14.463504 (+159493us) raft_consensus.cc:1685] finished
0709 12:14:14.463524 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.463686 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":196237,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":16541,"spinlock_wait_cycles":27316480,"thread_start_us":389571,"threads_started":2,"wal-append.queue_time_us":220368}
I20260709 12:14:14.632567  3333 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:14.633196  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:14.555828  5922 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:14.558699  5851 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:14.637328  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:14.711171  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 81188.8us
I20260709 12:14:14.711354  5296 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:14.556103  5987 raft_consensus.cc:2804] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:14.518554  5870 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:14.616865  5780 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:14.646941  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.638641  3232 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:14.093704  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:14.740236  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 101702us
I20260709 12:14:14.610792  5981 raft_consensus.cc:3055] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:14.518132  5847 consensus_queue.cc:260] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:14.623095  5956 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.686558  3231 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:14.637431  5688 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:14.647493  5941 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:14.663846  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.624831  5869 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:14:14.624444  5750 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.748507  5956 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:14.625711  5702 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.749121  5998 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:14.783195  5998 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.730309  5975 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:14.627935  5952 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:14.644457  5697 consensus_queue.cc:1048] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:14:14.736976  5296 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:14.628029  5985 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:14.812309  5985 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.814457  5296 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:14.708320  5922 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.733923  5987 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.746088  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:14.745012  5981 raft_consensus.cc:740] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:14.785235  5834 consensus_queue.cc:1059] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:14.785601  5870 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:14.761720  5750 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:14.728808  5953 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:14.789502  5888 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:14.747898  5780 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.766620  3188 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
W20260709 12:14:14.767220  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 80738.2us
I20260709 12:14:14.843814  3231 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:14.754289  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:14.757784  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.762007  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:14.793498  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.754213  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:14.756973  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:14.756541  5890 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:14.759740  5946 consensus_meta.cc:287] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.604s	user 0.007s	sys 0.006s
I20260709 12:14:14.782298  5702 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:14.809276  5952 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:14.794222  5998 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:14.769284  5776 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:14.811584  3895 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9
W20260709 12:14:14.750981  5991 log.cc:927] Time spent T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:14:14.787549  5972 raft_consensus.cc:3055] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:14.831781  5922 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:14.831550  5975 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.832901  5987 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:14.923244  3266 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:14:14.928723  3261 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:14.940989  3928 raft_consensus.cc:1217] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Deduplicated request from leader. Original: 2.5->[3.6-3.6]   Dedup: 3.6->[]
I20260709 12:14:14.955245  3928 raft_consensus.cc:1240] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:14:14.942438  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 216253us
I20260709 12:14:14.938287  5946 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7.
W20260709 12:14:14.958967  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.950402  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.961660  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 221899us
I20260709 12:14:14.843899  5953 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.967957  3188 raft_consensus.cc:1275] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:14:14.971315  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 491143us
I20260709 12:14:14.946437  5972 raft_consensus.cc:740] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:14:14.978243  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.979137  3896 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:14.979482  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 167981us
I20260709 12:14:14.980751  3896 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:14.982180  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:14.985167  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:14.985716  3185 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.937117  5890 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:14.981168  3305 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:14.989431  3930 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:14.996140  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:14.997499  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:14.998064  3339 raft_consensus.cc:2376] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8. Re-sending same reply.
I20260709 12:14:14.969585  5949 raft_consensus.cc:2804] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:14:14.977578  5978 consensus_meta.cc:287] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.000s
I20260709 12:14:14.995795  3896 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:15.002099  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:15.003278  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.007128  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 163390us
I20260709 12:14:14.983953  5697 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.988659  5750 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:14.957674  5975 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.023634  5985 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:15.023792  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:15.024928  5946 raft_consensus.cc:2804] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:15.025379  5946 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:15.025758  5946 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:15.027472  5988 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:15.028012  5988 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.028730  5890 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:15.030102  5988 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:15.030761  5994 consensus_queue.cc:1059] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:14:15.031471  5966 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:15.032575  6002 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.033068  6002 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.035799  6005 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.001792  5990 consensus_queue.cc:1059] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.229s
I20260709 12:14:15.036293  6005 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.036780  5990 raft_consensus.cc:3055] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:15.037146  5990 raft_consensus.cc:740] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:15.037990  5990 consensus_queue.cc:260] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.030117  3185 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:15.038444  6005 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:15.039211  5990 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:14.953374  5981 consensus_queue.cc:260] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.043063  3231 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:15.041116  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:15.009730  5826 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:15.019775  5973 consensus_meta.cc:287] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.003s
I20260709 12:14:15.035265  5956 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.012413  5942 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:14.988785  5834 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:14:15.050055  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:15.073472  3339 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:15.039032  5972 consensus_queue.cc:260] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:15.046777  5881 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.015s	sys 0.031s
I20260709 12:14:15.035158  6002 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:14.998690  6001 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.068s
W20260709 12:14:15.086963  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 71928.6us
W20260709 12:14:15.093207  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.093760  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.093266  3305 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:15.048032  5949 raft_consensus.cc:697] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:15.096467  5956 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:15.100286  6007 consensus_queue.cc:1048] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:15.089293  5981 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:15.105311  5950 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:15.105654  5870 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:15.107357  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47276 (request call id 363) took 1392 ms. Trace:
I20260709 12:14:15.089624  5942 raft_consensus.cc:697] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:15.040953  5697 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.011534  5978 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.064605  5750 raft_consensus.cc:697] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:15.116485  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:15.107813  3191 rpcz_store.cc:276] 0709 12:14:13.715201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.087537 (+372336us) service_pool.cc:224] Handling call
0709 12:14:14.092727 (+  5190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:14.093190 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.093236 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:14.750253 (+657017us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b2c000c7a48. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aecec6a11 00007f1aeced6372 00007f1aee608a01 00007f1aee5cd43a 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2
0709 12:14:14.750723 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:14:14.967845 (+217122us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:14.967893 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.967962 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:15.107060 (+139098us) raft_consensus.cc:1685] finished
0709 12:14:15.107080 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.107294 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9106,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"spinlock_wait_cycles":12476672,"thread_start_us":216727,"threads_started":1,"wal-append.queue_time_us":309545}
I20260709 12:14:15.076079  5826 raft_consensus.cc:697] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:15.121327  5949 consensus_queue.cc:237] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:15.116241  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.126204  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.110442  3231 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:15.134428  3339 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:15.079713  5994 raft_consensus.cc:3055] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:15.151242  3333 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:15.106948  5979 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.124991  5780 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:15.157495  3928 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEARNER]: Advancing to term 6
I20260709 12:14:15.137137  5972 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:15.133678  5603 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:15.163111  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 69934.2us
I20260709 12:14:15.076124  5966 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:15.164790  3932 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:15.133409  5993 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:15.065186  5973 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:15.147514  5938 consensus_meta.cc:287] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.696s	user 0.006s	sys 0.007s
I20260709 12:14:15.143877  5994 raft_consensus.cc:740] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:15.188803  3339 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:15.124279  5952 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:14:15.262301  3264 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:14:15.278301  3336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58568 (request call id 2074) took 2065 ms (client timeout 1660 ms). Trace:
I20260709 12:14:15.231799  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:15.267714  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:15.282199  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55426 (request call id 537) took 1163 ms. Trace:
I20260709 12:14:15.313910  3335 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:15.262624  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:15.173122  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:15.233909  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 86970.1us
I20260709 12:14:15.313721  3930 rpcz_store.cc:276] 0709 12:14:14.119327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.126373 (+  7046us) service_pool.cc:224] Handling call
0709 12:14:15.282058 (+1155685us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b5400575dd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:15.282148 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888340864}
W20260709 12:14:15.238852  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.305593  3928 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:14:15.312744  3336 rpcz_store.cc:269] 0709 12:14:13.213169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.222895 (+  9726us) service_pool.cc:224] Handling call
0709 12:14:15.278043 (+2055148us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000c30d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:15.278187 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2839227648}
I20260709 12:14:15.164458  5970 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:15.165105  5888 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.232362  3929 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:15.370291  3338 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:15.314728  3337 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:15.351689  3339 raft_consensus.cc:1240] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:15.152949  5941 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:15.198506  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 262269us
I20260709 12:14:15.371166  3231 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:15.168417  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:15.351547  6007 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.388732  5888 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.388366  5994 consensus_queue.cc:260] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.389293  3924 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:15.369185  5953 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:15.369484  5688 consensus_meta.cc:287] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.618s	user 0.003s	sys 0.006s
I20260709 12:14:15.351680  5826 consensus_queue.cc:237] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.373234  3925 raft_consensus.cc:2468] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 1.
I20260709 12:14:15.400664  3341 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:15.280761  5978 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:15.308185  5984 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.188189  5956 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:15.404093  3923 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:14:15.406337  5296 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:15.174171  5780 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:15.358192  5998 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:15.484963  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.160127  5942 consensus_queue.cc:237] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.270776  5979 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:15.477974  5776 consensus_meta.cc:287] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.003s
I20260709 12:14:15.571651  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:15.548193  3231 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:15.505235  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:15.551715  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.172957  5603 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.434952  6007 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:15.579955  6007 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:15.580403  5603 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:15.568496  3896 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:15.553439  3232 leader_election.cc:336] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.660s (SENT)
W20260709 12:14:15.576879  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.205503  5993 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.266060  5987 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.377913  5750 consensus_queue.cc:237] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.548524  5975 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:15.530452  6021 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.548337  5941 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:15.550544  5956 raft_consensus.cc:697] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:15.564688  5847 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:15.591701  3157 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:15.620478  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.593312  5776 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:15.549249  5888 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:15.565013  5994 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:15.595504  3232 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:15.596776  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 48662.4us
I20260709 12:14:15.587638  5834 raft_consensus.cc:2804] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:15.592448  5443 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:15.644546  5443 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:15.644459  5956 consensus_queue.cc:237] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.612274  5979 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:15.552289  5984 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.583173  6017 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:14:15.650417  5984 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:15.573498  5978 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:14:15.582909  5881 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:14:15.654213  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:15.654825  3336 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:15.656075  5993 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:15.659696  5973 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:15.505723  5688 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:15.625615  6031 log.cc:927] Time spent T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260709 12:14:15.626485  6027 log.cc:927] Time spent T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:14:15.638568  5834 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:15.631536  3926 raft_consensus.cc:1240] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:15.665215  5834 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:15.633394  5851 consensus_meta.cc:287] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.921s	user 0.010s	sys 0.000s
I20260709 12:14:15.645084  5443 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:15.668591  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.668969  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.624576  5603 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.671628  5603 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:15.672075  5603 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.672670  5987 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:15.677366  3293 heartbeater.cc:646] Failed to heartbeat to 127.1.248.126:35191 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.1.248.126:35191 timed out after 15.000s (SENT)
W20260709 12:14:15.678870  5922 consensus_meta.cc:287] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.722s	user 0.006s	sys 0.002s
I20260709 12:14:15.679561  5688 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:15.684537  5998 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:15.686332  3090 catalog_manager.cc:5697] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 4 to 5, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 5 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.688432  3090 catalog_manager.cc:5697] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.689932  3090 catalog_manager.cc:5697] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 5 to 6, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 6 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:15.679345  5922 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.692869  5922 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:15.693377  5922 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.693818  5922 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:15.696599  5946 consensus_meta.cc:287] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.670s	user 0.011s	sys 0.000s
I20260709 12:14:15.697008  5946 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.701978  3090 catalog_manager.cc:5697] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 4 to 5, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 5 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:15.708434  3157 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:15.732251  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 751362us
I20260709 12:14:15.733130  3895 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:15.711771  5987 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.734035  5987 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.687077  5834 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:15.730384  5990 consensus_meta.cc:287] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.000s
I20260709 12:14:15.730671  3231 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:15.710362  5946 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:15.748610  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 195193us
W20260709 12:14:15.749491  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.756283  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.757644  3336 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:15.726621  5776 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:15.636569  6021 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.747398  5847 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:15.769109  3232 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:15.757521  5998 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.761978  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:15.762841  6005 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.775683  3336 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
W20260709 12:14:15.787801  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 143959us
I20260709 12:14:15.791622  3232 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:15.777947  5848 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:15.775077  5993 raft_consensus.cc:2804] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:15.813234  5296 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:15.814363  5296 raft_consensus.cc:697] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:15.815026  3338 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:15.815224  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:15.815949  3232 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:15.816237  3336 raft_consensus.cc:2393] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:15.817947  3932 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:14:15.780216  5922 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:15.821472  3231 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:15.828624  3231 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:15.834522  5922 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:15.835129  5922 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.837203  5922 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:15.819824  6025 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:15.831539  5296 consensus_queue.cc:237] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.782549  5998 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.846323  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:15.828222  5780 consensus_queue.cc:1059] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:14:15.840917  6025 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:15.826817  5776 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:15.819661  5985 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:14:15.864205  3336 raft_consensus.cc:2368] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5.
I20260709 12:14:15.784842  6005 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.878585  3896 leader_election.cc:400] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5.
I20260709 12:14:15.879665  3896 leader_election.cc:403] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:15.884264  5834 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:15.889096  5998 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:15.889025  5443 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.889863  5998 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:15.890740  5998 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:15.891883  6021 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:15.892427  5949 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:15.874287  5987 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:15.884341  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:15.896939  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 170544us
I20260709 12:14:15.898064  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:15.898869  3930 raft_consensus.cc:2410] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:14:15.900524  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.901923  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:15.902500  3928 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:15.904803  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:15.906002  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:15.876874  6025 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:15.929684  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:15.930495  3338 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:15.923101  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 106012us
I20260709 12:14:15.932464  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:15.933110  3924 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.882958  5979 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:15.936493  3232 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:15.941048  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:15.941808  3336 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:15.942250  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.908004  5443 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:15.913054  6021 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.948073  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:15.948788  3931 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:15.948503  6021 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.949791  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:15.945003  5603 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:15.950361  3335 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:15.950800  6021 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:15.951740  5603 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:15.955138  5985 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:15.935236  5697 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:15.955690  5985 raft_consensus.cc:697] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:15.941625  3232 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:15.968875  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:15.973925  5697 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.977320  5697 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.980436  5697 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:15.980989  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55426 (request call id 542) took 1036 ms. Trace:
I20260709 12:14:15.982245  3333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58568 (request call id 2085) took 1003 ms. Trace:
I20260709 12:14:15.983705  3333 rpcz_store.cc:276] 0709 12:14:14.978668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.978789 (+   121us) service_pool.cc:224] Handling call
0709 12:14:15.982066 (+1003277us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540005f354. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:15.982183 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314985216}
I20260709 12:14:15.983621  3927 rpcz_store.cc:276] 0709 12:14:14.944209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.949730 (+  5521us) service_pool.cc:224] Handling call
0709 12:14:15.980255 (+1030525us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:14:15.980486 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.980671 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:15.980697 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:15.980736 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:15.980775 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.980835 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.980934 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7479552}
I20260709 12:14:15.985080  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:15.985618  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:15.956681  5985 consensus_queue.cc:237] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:15.988924  3334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2005) took 1379 ms. Trace:
I20260709 12:14:15.936636  5956 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.989324  3334 rpcz_store.cc:276] 0709 12:14:14.609684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.609887 (+   203us) service_pool.cc:224] Handling call
0709 12:14:14.610207 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.811628 (+201421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.811657 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:14.811697 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:14.811733 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.988696 (+1176963us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540038bdd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:15.988745 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.988866 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462737280}
I20260709 12:14:15.989954  5956 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:15.991015  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:15.992151  5956 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:15.985980  3333 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
W20260709 12:14:15.994086  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.994462  3157 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:15.995540  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:15.996116  3333 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:15.992602  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:15.997570  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:15.998196  3334 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:15.998500  3340 raft_consensus.cc:2393] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:14:15.999780  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 185605us
I20260709 12:14:16.003516  3338 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:16.009265  3336 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:16.011440  3333 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:16.001546  3895 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:16.019115  3895 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:16.023135  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:16.024415  3184 raft_consensus.cc:2393] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:16.023135  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:16.025189  3334 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:16.026834  3189 raft_consensus.cc:2393] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 2: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:16.027791  3896 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:16.029062  3896 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:16.029587  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:16.030090  3896 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:16.030951  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:16.033460  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:16.034727  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:16.037232  3232 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:16.037443  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:16.038364  3232 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:16.039078  3341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58564 (request call id 2000) took 1521 ms. Trace:
I20260709 12:14:16.039247  3927 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:16.042433  3341 rpcz_store.cc:276] 0709 12:14:14.517296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.517445 (+   149us) service_pool.cc:224] Handling call
0709 12:14:16.038881 (+1521436us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400033ed4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:16.039016 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1955614464}
I20260709 12:14:16.040017  3342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2009) took 1392 ms. Trace:
I20260709 12:14:16.043747  3342 rpcz_store.cc:276] 0709 12:14:14.648130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.709976 (+ 61846us) service_pool.cc:224] Handling call
0709 12:14:14.733295 (+ 23319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.791529 (+ 58234us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:15.198994 (+407465us) log.cc:844] Serialized 14 byte log entry
0709 12:14:15.385650 (+186656us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:15.385710 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:15.385761 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.039709 (+653948us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b5400164ed4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:16.039764 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.039951 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7895,"prepare.queue_time_us":211716,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3375,"raft.queue_time_us":8289,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":10188,"spinlock_wait_cycles":133164288,"thread_start_us":545841,"threads_started":2,"wal-append.queue_time_us":413000}
I20260709 12:14:15.998487  5979 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:15.996140  6021 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:16.052275  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:16.063970  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:16.055393  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:16.049443  3232 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:16.054849  3264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 540) took 1294 ms. Trace:
W20260709 12:14:16.059254  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.016067  5997 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:16.065021  3187 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:16.051607  3924 raft_consensus.cc:2468] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:14:16.063069  3306 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:16.066247  3264 rpcz_store.cc:276] 0709 12:14:14.742851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.742975 (+   124us) service_pool.cc:224] Handling call
0709 12:14:14.750668 (+  7693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.312380 (+561712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.027450 (+715070us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54000ef6d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:16.037009 (+  9559us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053254528}
I20260709 12:14:16.048830  5848 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:16.026804  5869 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:16.073342  6047 consensus_queue.cc:1059] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:14:16.065542  5942 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.074265  5977 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:16.073958  5869 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.074739  5977 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:16.063606  6021 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.075150  5977 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.063987  5994 raft_consensus.cc:2804] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:16.075456  6021 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:16.076563  5869 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:16.062376  5979 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:16.118994  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 56001.2us
I20260709 12:14:16.037089  5851 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:16.082455  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 253916us
I20260709 12:14:16.125110  3231 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:16.082633  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.085366  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.127873  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.060943  5602 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:16.087824  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 56754.5us
W20260709 12:14:16.089148  3156 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.565s (SENT)
I20260709 12:14:16.130959  3156 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:16.063511  6005 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:16.094224  3931 raft_consensus.cc:1240] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:16.117630  5986 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.048622  5750 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:16.067749  5993 raft_consensus.cc:697] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:16.074608  5942 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.122923  3335 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:16.133592  5296 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:16.151108  5296 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:16.119834  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 70477.6us
I20260709 12:14:16.151510  5296 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:16.150334  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.091055  6025 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:16.137228  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.146682  3090 catalog_manager.cc:5697] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 7 to 9, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 9 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.123881  5979 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:16.190608  3090 catalog_manager.cc:5697] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 4, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 4 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
W20260709 12:14:16.196260  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 44181.2us
I20260709 12:14:16.140125  5847 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:16.129624  6007 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:16.129401  5834 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.218490  5834 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:16.221113  5834 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:16.136224  6047 raft_consensus.cc:3055] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:16.238725  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:16.239593  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:16.213395  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:16.214251  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 128697us
W20260709 12:14:16.215509  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 82431.5us
I20260709 12:14:16.130720  5851 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:16.221109  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.243166  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:16.153208  5780 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:16.142958  5776 raft_consensus.cc:697] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:16.145169  5949 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5.
I20260709 12:14:16.148998  5750 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.221320  5985 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:16.244158  3342 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:16.154433  5972 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:16.243897  3232 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:16.245908  5848 raft_consensus.cc:697] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:16.150171  5602 raft_consensus.cc:697] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:16.318046  5602 consensus_queue.cc:237] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.320945  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:16.321794  3266 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:16.241729  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:16.322350  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:16.259114  5296 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.260591  3231 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:16.205281  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:16.148164  5986 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.321112  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:16.340164  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:16.322988  3262 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:16.340611  3259 raft_consensus.cc:1240] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:16.252544  3337 raft_consensus.cc:1240] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:14:16.342468  3925 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:16.237432  5603 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:16.332446  5296 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:16.344054  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:16.344703  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 84205.7us
I20260709 12:14:16.347028  3231 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:16.247139  5780 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.246804  5851 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.246717  6047 raft_consensus.cc:740] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:16.353236  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:16.315945  5750 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.321728  5847 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.357363  6053 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:16.358073  3263 raft_consensus.cc:1275] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:16.236855  6046 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
W20260709 12:14:16.365166  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 234295us
I20260709 12:14:16.324306  6051 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:16.369405  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.370292  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.372956  3188 raft_consensus.cc:1240] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:16.372852  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:16.373955  3184 raft_consensus.cc:2393] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:16.353073  5780 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.391757  6053 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:16.358309  5776 consensus_queue.cc:237] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:16.392644  5986 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:16.394564  3192 raft_consensus.cc:1275] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.395205  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:16.461308  3187 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.366657  5847 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.396168  6047 consensus_queue.cc:260] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.402175  5979 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:16.479869  5979 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:16.409421  3266 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
W20260709 12:14:16.411986  6043 log.cc:927] Time spent T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 12:14:16.420478  5942 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:16.362206  5956 consensus_queue.cc:1059] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:14:16.361593  5993 consensus_queue.cc:237] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:16.431252  6025 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:16.431950  5848 consensus_queue.cc:237] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.367116  6051 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:16.353523  5603 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.345916  5972 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.322443  5985 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:16.499610  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.501009  3090 catalog_manager.cc:5697] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 5, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 5 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.529613  5972 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:16.529498  5847 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:16.534256  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.531564  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 326515us
I20260709 12:14:16.368703  5994 raft_consensus.cc:697] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:16.539256  3895 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:14:16.507701  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 49156us
I20260709 12:14:16.546520  5953 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:16.492798  6051 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.547053  3896 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:16.579044  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.575416  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:16.544317  6046 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:14:16.545733  6047 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:16.595222  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:16.673455  3192 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:16.639763  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:16.674415  3186 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.547060  5953 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:16.656064  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 104683us
I20260709 12:14:16.671370  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:16.601114  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:16.677922  3337 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:16.547699  6007 raft_consensus.cc:697] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:16.676761  3190 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
W20260709 12:14:16.694828  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.710451  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:16.616307  6060 log.cc:927] Time spent T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 12:14:16.646278  5977 consensus_meta.cc:287] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.002s
I20260709 12:14:16.720770  3337 raft_consensus.cc:1240] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:16.723307  3334 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:14:16.731341  3232 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:16.646006  5985 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:16.743003  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:16.744357  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:16.746948  3335 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:16.670457  6072 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:16.616740  6067 raft_consensus.cc:2804] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:16.748037  3340 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:16.748287  3334 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:16.759161  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:16.678812  5953 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.760020  3927 raft_consensus.cc:2393] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:16.751420  5602 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:16.755308  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:16.755862  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.755389  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 78668.8us
W20260709 12:14:16.768093  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.761878  3186 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:16.720088  6068 raft_consensus.cc:3055] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:14:16.768646  3338 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.006s	sys 0.011s
I20260709 12:14:16.769696  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:16.730648  6025 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:16.770524  3338 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.006s	sys 0.011s
I20260709 12:14:16.804383  6067 raft_consensus.cc:697] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:16.640209  5994 consensus_queue.cc:237] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.772610  3193 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.808753  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:16.742997  5977 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.814441  3186 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.798593  3187 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:16.759030  5985 consensus_queue.cc:1059] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:14:16.772984  6068 raft_consensus.cc:740] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:16.804558  5847 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.821496  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:16.771520  6065 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:16.796496  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:16.763868  6072 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:16.825315  3190 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:16.829206  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:16.832324  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 762) took 1127 ms. Trace:
I20260709 12:14:16.832870  3926 rpcz_store.cc:276] 0709 12:14:15.704876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.705028 (+   152us) service_pool.cc:224] Handling call
0709 12:14:15.720593 (+ 15565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:15.775701 (+ 55108us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:16.046266 (+270565us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.311839 (+265573us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:16.324145 (+ 12306us) log.cc:844] Serialized 26 byte log entry
0709 12:14:16.324299 (+   154us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:16.324333 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.324530 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:16.832102 (+507572us) raft_consensus.cc:1685] finished
0709 12:14:16.832126 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.832263 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12575,"prepare.queue_time_us":53129,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":99035,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":8574,"thread_start_us":378809,"threads_started":2,"wal-append.queue_time_us":484025}
I20260709 12:14:16.829751  3338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2016) took 1147 ms. Trace:
I20260709 12:14:16.834578  3187 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:16.805299  6025 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.824877  5603 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:16.822161  5443 consensus_queue.cc:1048] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:14:16.840896  3339 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:16.822193  6049 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:14:16.829948  5985 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.843212  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:16.824067  6053 consensus_queue.cc:1059] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 12:14:16.844875  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 497933us
I20260709 12:14:16.846400  5603 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:16.834734  3338 rpcz_store.cc:276] 0709 12:14:15.682431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.004396 (+321965us) service_pool.cc:224] Handling call
0709 12:14:16.004820 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:16.005284 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.005325 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:16.040056 (+ 34731us) log.cc:844] Serialized 52 byte log entry
0709 12:14:16.189654 (+149598us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:16.222240 (+ 32586us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.829424 (+607184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.829497 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:16.829538 (+    41us) raft_consensus.cc:1685] finished
0709 12:14:16.829552 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.829696 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74533,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":136038,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":21862,"thread_start_us":648425,"threads_started":2,"wal-append.queue_time_us":372715}
I20260709 12:14:16.848430  3336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2017) took 1165 ms. Trace:
I20260709 12:14:16.849586  3186 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:16.860803  3336 rpcz_store.cc:276] 0709 12:14:15.682673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.009992 (+327319us) service_pool.cc:224] Handling call
0709 12:14:16.010475 (+   483us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:16.010957 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.010983 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:16.131599 (+120616us) log.cc:844] Serialized 582 byte log entry
0709 12:14:16.552844 (+421245us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:16.552886 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.552956 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:16.848228 (+295272us) raft_consensus.cc:1685] finished
0709 12:14:16.848246 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.848375 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4389,"raft.queue_time_us":5873,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":27820,"thread_start_us":338089,"threads_started":1,"wal-append.queue_time_us":537791}
I20260709 12:14:16.851814  5972 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.855341  3190 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:16.826582  5847 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.873750  3193 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:16.882072  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:16.828649  6065 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.823621  6007 consensus_queue.cc:237] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.878507  5602 raft_consensus.cc:697] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:16.894378  5602 consensus_queue.cc:237] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:16.896059  5851 consensus_meta.cc:287] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.001s
I20260709 12:14:16.896523  5851 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.897710  3932 raft_consensus.cc:1240] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:16.876140  6067 consensus_queue.cc:237] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:16.905596  3186 raft_consensus.cc:1275] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:16.907801  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:16.910211  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:16.911190  3187 raft_consensus.cc:2410] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:14:16.915764  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.916383  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.930461  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:16.861070  5985 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:16.962790  3923 raft_consensus.cc:1240] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
W20260709 12:14:16.963629  6078 log.cc:927] Time spent T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:14:16.877127  5972 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:16.965613  6084 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:16.966095  6084 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.966423  6084 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.957721  5688 consensus_queue.cc:1059] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:14:16.968668  5847 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:16.970957  6025 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:16.971441  5977 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:16.866858  5603 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:16.980669  3192 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
W20260709 12:14:16.986260  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 105220us
I20260709 12:14:16.987053  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:16.996680  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:16.997819  3305 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:16.982887  5870 consensus_queue.cc:1048] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:14:16.984104  5972 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:17.007143  6077 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:17.007958  6077 raft_consensus.cc:697] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:17.007519  5780 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:17.009090  6077 consensus_queue.cc:237] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:17.010371  5780 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:17.011794  6079 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:17.012357  6079 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.012749  6079 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:17.017097  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 249105us
I20260709 12:14:17.020536  6072 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:17.022250  3895 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:17.023095  6097 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:17.024684  6088 log.cc:927] Time spent T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:14:17.024307  3895 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:17.026113  6097 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:17.026479  6097 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.026775  6097 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.033646  6051 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:17.035348  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.037496  6097 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:17.038286  6021 consensus_meta.cc:287] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.919s	user 0.005s	sys 0.005s
I20260709 12:14:17.038723  6021 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:17.039529  5998 raft_consensus.cc:3055] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:17.039912  5998 raft_consensus.cc:740] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:17.040732  5998 consensus_queue.cc:260] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:17.041837  5998 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:17.042064  6084 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:16.972155  5750 consensus_meta.cc:287] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.002s
I20260709 12:14:17.050424  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:17.050841  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 53137.8us
W20260709 12:14:17.052871  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.052964  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:17.053707  3186 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.055282  3231 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:17.064406  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:17.066757  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:16.999155  6092 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:14:17.074527  3185 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:14:17.075068  3185 pending_rounds.cc:85] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3: Aborting all ops after (but not including) 8
I20260709 12:14:17.075517  3185 pending_rounds.cc:107] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:14:17.075837  3185 raft_consensus.cc:2889] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:17.076110  3190 raft_consensus.cc:2393] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 9: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:17.077782  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:17.084668  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:17.085305  3926 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:17.074896  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:17.097174  3187 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:17.098577  3340 raft_consensus.cc:2393] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:17.114893  6051 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:17.132479  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.074725  5870 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:17.269191  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:17.282050  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:17.284013  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.298532  6007 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:17.325423  6007 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:17.064603  5973 consensus_queue.cc:1059] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.218s
I20260709 12:14:17.281949  5780 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:17.282708  5870 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:17.118806  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:17.063993  5750 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:17.280664  6071 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.342886  5870 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.380200  3929 raft_consensus.cc:1240] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:17.520633  3186 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
W20260709 12:14:17.521864  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 534813us
W20260709 12:14:17.447649  3188 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.013s	sys 0.030s
W20260709 12:14:17.523195  3188 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.013s	sys 0.031s
W20260709 12:14:17.533337  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:17.534126  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:17.528717  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.528256  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:17.540994  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.542578  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:17.546589  3231 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:17.495550  6091 log.cc:927] Time spent T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
W20260709 12:14:17.549947  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.552559  3193 raft_consensus.cc:1275] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:14:17.504287  5953 consensus_meta.cc:287] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.000s
I20260709 12:14:17.556214  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:17.544063  6105 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.562711  3305 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:17.555621  5987 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:17.558545  6072 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.488576  6065 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:17.557866  6082 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:17.490615  5750 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:17.547257  6005 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:17.517182  6007 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:17.567523  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.545612  6097 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:17.579721  6051 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.570407  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:17.572974  6059 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:17.570928  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:17.573356  5296 raft_consensus.cc:3055] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:17.592792  5296 raft_consensus.cc:740] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:17.511233  6046 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:17.569787  5780 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:17.557392  5993 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.010s	sys 0.012s
I20260709 12:14:17.578652  6084 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:17.565165  5953 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:17.582998  5750 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:17.602363  6046 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:17.603250  5780 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:17.595955  6007 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:17.603753  5296 consensus_queue.cc:260] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:17.612522  5296 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.571115  5987 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:17.601559  5993 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.011s	sys 0.012s
I20260709 12:14:17.574448  6072 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:17.580554  6005 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:17.624785  5851 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:17.626389  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55426 (request call id 547) took 1416 ms. Trace:
W20260709 12:14:17.631398  5998 consensus_meta.cc:287] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.004s
I20260709 12:14:17.659323  3929 rpcz_store.cc:276] 0709 12:14:16.209822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.209980 (+   158us) service_pool.cc:224] Handling call
0709 12:14:16.253998 (+ 44018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.537922 (+1283924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.626131 (+ 88209us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54005b3454. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:17.626323 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2589380480}
I20260709 12:14:17.664988  3231 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:17.614478  6007 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.675786  3339 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:17.681836  5998 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:17.568029  6105 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:17.684301  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:17.685757  6005 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:17.678442  6079 consensus_meta.cc:287] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.006s
I20260709 12:14:17.667534  6007 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.686981  6072 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:17.689474  3926 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:17.690737  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:17.692242  3924 raft_consensus.cc:1240] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
W20260709 12:14:17.692291  3333 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.036s	sys 0.073s
I20260709 12:14:17.608544  5750 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:17.352438  6071 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:17.696213  3333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.037s	sys 0.073s
W20260709 12:14:17.693955  3156 leader_election.cc:336] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.602s (SENT)
I20260709 12:14:17.598156  6059 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:17.699788  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:17.700420  3339 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:17.700042  3156 leader_election.cc:336] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.602s (SENT)
I20260709 12:14:17.701287  3156 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:17.703060  3156 leader_election.cc:336] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.708s (SENT)
I20260709 12:14:17.703761  3156 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:17.735809  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:17.693250  5998 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:17.740670  3340 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
W20260709 12:14:17.745152  3156 leader_election.cc:336] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.777s (SENT)
W20260709 12:14:17.746191  3156 leader_election.cc:336] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.806s (SENT)
W20260709 12:14:17.748405  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 83533.9us
I20260709 12:14:17.738240  5973 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 12:14:17.760506  3156 leader_election.cc:336] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.816s (SENT)
I20260709 12:14:17.761155  3156 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:17.761870  6110 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:14:17.762111  5972 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:17.763985  3156 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.839s (SENT) [suppressed 47 similar messages]
W20260709 12:14:17.765964  3156 leader_election.cc:336] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.932s (SENT)
W20260709 12:14:17.767952  6109 log.cc:927] Time spent T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:14:17.768427  6102 log.cc:927] Time spent T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:14:17.767138  3156 leader_election.cc:336] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.972s (SENT)
I20260709 12:14:17.772639  5750 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:14:17.773393  5972 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.774247  6071 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:17.774155  5972 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:17.777235  5972 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:17.784878  6059 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:17.785964  6046 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:17.787233  5987 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:17.788498  5780 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:17.792092  5953 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:17.730737  6072 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:17.743953  5998 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.744565  6065 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:17.804471  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.818956  3339 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:17.829650  6051 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:17.830269  3156 leader_election.cc:336] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.129s (SENT)
I20260709 12:14:17.830817  3156 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:17.697767  6079 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:17.846978  3231 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:17.853294  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:17.855787  3336 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:17.853943  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:17.874413  6072 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:17.879812  3333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 668) took 1222 ms. Trace:
I20260709 12:14:17.880247  3333 rpcz_store.cc:276] 0709 12:14:16.657412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.657579 (+   167us) service_pool.cc:224] Handling call
0709 12:14:16.658003 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.720497 (+ 62494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.720546 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:17.022958 (+302412us) spinlock_profiling.cc:243] Waited 9.21 ms on lock 0x7b2c000e61b8. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aecec6a11 00007f1aeced6372 00007f1aee608a01 00007f1aee5cd43a 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2
0709 12:14:17.044769 (+ 21811us) log.cc:844] Serialized 26 byte log entry
0709 12:14:17.696729 (+651960us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:17.696775 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.696846 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.879496 (+182650us) raft_consensus.cc:1685] finished
0709 12:14:17.879516 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.879748 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110834,"raft.queue_time_us":57702,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":24405,"spinlock_wait_cycles":21193984,"thread_start_us":576435,"threads_started":1,"wal-append.queue_time_us":798491}
I20260709 12:14:17.808174  6067 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.852958  6065 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.923501  3231 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:17.899025  5780 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:17.929251  5296 raft_consensus.cc:2764] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:17.931066  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:17.918402  5603 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:17.939663  3336 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
W20260709 12:14:17.962893  3156 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.174s (SENT)
I20260709 12:14:18.016736  3156 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:17.904970  6072 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:17.982491  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 59117.7us
I20260709 12:14:17.991163  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:17.993183  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:17.928227  5780 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:17.917186  6067 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.024148  3231 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:18.025447  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 62629.3us
I20260709 12:14:18.002259  5998 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.032903  5603 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.017946  5993 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.016039  6047 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.933339  5972 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:18.010813  5296 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:18.010912  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.041618  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.012662  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 81667.9us
I20260709 12:14:18.042311  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:18.042959  3186 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:18.013797  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:18.015411  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.022783  6105 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:18.011333  6051 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:18.010264  6082 raft_consensus.cc:697] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:18.024940  5780 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.018282  6120 raft_consensus.cc:2804] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:18.044898  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:18.057760  3184 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:18.045446  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:17.996661  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 433995us
I20260709 12:14:18.043974  3090 catalog_manager.cc:5697] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 1 to 5, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 5 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:18.059283  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:18.060510  3090 catalog_manager.cc:5697] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 3, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:18.059839  3305 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:18.052073  5296 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.053718  3266 raft_consensus.cc:1240] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:18.056056  3231 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:18.064990  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:18.065219  3264 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:18.066555  3305 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:18.066792  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.066954  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.067761  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:18.068881  3925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37962 (request call id 530) took 2099 ms (client timeout 1920 ms). Trace:
W20260709 12:14:18.070268  3156 leader_election.cc:336] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.217s (SENT)
I20260709 12:14:18.070729  3156 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:18.069403  3925 rpcz_store.cc:269] 0709 12:14:15.969128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.969801 (+   673us) service_pool.cc:224] Handling call
0709 12:14:18.068687 (+2098886us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54001ca054. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:18.068794 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788150656}
I20260709 12:14:18.072715  3191 raft_consensus.cc:2393] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:18.073741  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:18.062016  6052 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.085765  3895 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:18.070964  6079 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:18.065971  6115 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:18.041643  5993 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.072372  6105 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:18.098464  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.073122  6120 raft_consensus.cc:697] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:18.072062  5953 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:18.096133  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.045236  6047 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.096197  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.065743  6077 consensus_queue.cc:1059] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:14:18.052877  5972 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.095810  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.080243  6118 consensus_queue.cc:1048] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:14:18.072576  6114 raft_consensus.cc:2804] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:18.081113  6119 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:18.095854  5443 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 12:14:18.093825  3305 connection.cc:256] RPC call timeout handler was delayed by -1.0091330990001097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
I20260709 12:14:18.162696  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 536) took 2178 ms. Trace:
I20260709 12:14:18.181645  3267 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:18.181849  3932 rpcz_store.cc:276] 0709 12:14:15.984303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.046427 (+ 62124us) service_pool.cc:224] Handling call
0709 12:14:16.046790 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.898087 (+851297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.162447 (+1264360us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54006d01d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:18.162637 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956377472}
I20260709 12:14:18.184038  3336 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:18.098485  3895 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:18.184651  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:18.184832  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 86417.4us
I20260709 12:14:18.185523  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.088783  6084 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:18.164863  3259 raft_consensus.cc:2410] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:18.090226  6116 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:18.156185  6005 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:18.099502  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 56616.1us
I20260709 12:14:18.186805  6116 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.186061  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:18.096992  6067 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:18.156575  6105 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.188050  3265 raft_consensus.cc:1240] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:18.188100  6105 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.188499  6072 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:18.189097  6116 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:18.189400  6122 log.cc:927] Time spent T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:14:18.189561  3265 raft_consensus.cc:1275] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:18.175019  6082 consensus_queue.cc:237] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:18.190784  3265 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:14:18.191090  3265 pending_rounds.cc:85] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 5
I20260709 12:14:18.086995  6051 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:18.193045  6051 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:18.193570  5998 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:18.176271  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.195215  3262 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:18.178707  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.178823  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.172463  3264 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:18.181053  3268 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.186553  6084 raft_consensus.cc:697] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:18.191311  3265 pending_rounds.cc:107] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:14:18.201212  3265 raft_consensus.cc:2889] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:18.095642  5949 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:14:18.157325  5750 consensus_queue.cc:1048] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:14:18.200625  3931 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
W20260709 12:14:18.201730  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 131486us
I20260709 12:14:18.097306  6115 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.185565  5603 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:18.203405  3157 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:18.223057  3333 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:18.208794  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:18.224720  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.225385  3336 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:18.096938  6052 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:18.227661  3157 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:18.208205  3232 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:18.226531  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.197508  6114 raft_consensus.cc:697] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:18.234651  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.209471  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.169731  5953 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.233414  3262 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:18.227813  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.201848  5998 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.240739  3265 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:18.237365  6046 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:18.223703  5994 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:18.253230  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:18.251941  3305 leader_election.cc:336] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.595s (SENT)
W20260709 12:14:18.253582  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 67605.6us
W20260709 12:14:18.254518  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 46432.8us
I20260709 12:14:18.289183  3232 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:18.289554  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.288787  5994 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:18.298730  5994 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.299224  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.301003  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.254757  6131 raft_consensus.cc:1064] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:14:18.304821  3264 raft_consensus.cc:2393] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:18.303359  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.237597  5603 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:18.233516  6115 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.307770  3262 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.310837  3265 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:18.238306  6120 consensus_queue.cc:237] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.315168  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.316028  3265 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:14:18.321597  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.333261  3260 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:18.324900  3264 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
W20260709 12:14:18.334319  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 106725us
I20260709 12:14:18.342057  3262 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:18.309379  6130 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:18.344790  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.250234  5998 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.308462  5993 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:18.351955  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.313512  6128 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:18.310166  5603 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:18.322638  6131 raft_consensus.cc:1068] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: Unable to promote non-voter 6f0cdd57c5934921829c205d32b2b8a5: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:14:18.359916  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.360653  3265 raft_consensus.cc:2393] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:18.350556  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.290817  6067 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:14:18.316040  6052 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:18.356573  6130 raft_consensus.cc:697] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:18.323585  6005 raft_consensus.cc:697] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:18.319991  6051 consensus_queue.cc:1059] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:14:18.321552  6118 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:18.379789  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:18.382539  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 93585.5us
I20260709 12:14:18.358279  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.362725  3262 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
W20260709 12:14:18.358872  6124 log.cc:927] Time spent T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.201s	user 0.001s	sys 0.001s
I20260709 12:14:18.312458  6084 consensus_queue.cc:237] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:18.358675  5603 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.377686  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.385968  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.391453  3265 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:18.391718  3262 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:18.392843  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.392895  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.393724  3265 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:18.394440  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.395143  3262 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:18.391456  3896 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:18.403337  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.405349  3265 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:18.406052  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 91732.5us
I20260709 12:14:18.406286  3268 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:18.407500  3262 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:18.411852  3896 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:18.413187  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.414341  3262 raft_consensus.cc:2376] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7. Re-sending same reply.
I20260709 12:14:18.376744  6047 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:18.407974  3232 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:18.417130  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.417773  3260 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:18.419608  3305 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.817s (SENT)
I20260709 12:14:18.419668  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.401420  5972 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:18.422052  3896 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:18.420624  3262 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.408850  6052 raft_consensus.cc:3055] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:18.435485  3896 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:18.418869  6134 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:18.407460  5750 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:14:18.420926  6051 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:18.442983  5987 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:18.443169  6059 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:18.446071  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.424320  6072 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.455987  6132 raft_consensus.cc:2955] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:14:18.460805  6133 log.cc:927] Time spent T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:14:18.440714  6134 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:18.435344  5780 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.420907  6135 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:18.372429  6114 consensus_queue.cc:237] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:18.399648  6118 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.434996  6052 raft_consensus.cc:740] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:18.448172  3262 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:18.470456  3260 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
W20260709 12:14:18.455088  6127 log.cc:927] Time spent T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:14:18.503820  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.453652  6059 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:18.508586  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.509864  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.443203  6005 consensus_queue.cc:237] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.461246  5987 raft_consensus.cc:697] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:18.492547  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.492838  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.493528  6052 consensus_queue.cc:260] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:18.504052  6107 log.cc:927] Time spent T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.893s	user 0.003s	sys 0.001s
I20260709 12:14:18.474529  5443 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.510938  3265 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:18.471602  6134 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:18.453859  6047 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:14:18.461571  6072 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:18.477454  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.525722  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.596589  5296 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:18.598800  3260 raft_consensus.cc:2410] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 6 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:18.599203  3336 raft_consensus.cc:2393] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:18.599745  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.597285  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:18.576747  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.600517  3341 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
W20260709 12:14:18.603135  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 255189us
I20260709 12:14:18.484755  6128 consensus_queue.cc:1059] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 12:14:18.609225  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.614706  3265 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:18.615842  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.616812  3265 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:18.617848  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.609826  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:18.637585  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:18.525884  3262 raft_consensus.cc:2368] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8.
W20260709 12:14:18.576902  5870 consensus_meta.cc:287] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 1.025s	user 0.006s	sys 0.007s
I20260709 12:14:18.523707  6059 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:18.621086  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.600494  6052 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:18.453462  6130 consensus_queue.cc:237] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:18.642132  3260 raft_consensus.cc:2410] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:18.644652  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.645418  3265 raft_consensus.cc:2393] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:18.649086  3260 raft_consensus.cc:1275] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:14:18.649564  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.608563  5443 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.652180  5443 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:18.653016  6143 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:18.643577  6007 consensus_meta.cc:287] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.912s	user 0.011s	sys 0.000s
I20260709 12:14:18.558228  6115 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:18.659505  3260 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:18.643108  5870 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.674619  3264 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:18.643059  6129 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:18.647184  6146 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.678469  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.682610  3264 raft_consensus.cc:2393] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:18.661927  6007 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:18.686990  3334 raft_consensus.cc:1240] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:18.691707  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.694269  3339 raft_consensus.cc:1240] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:18.696995  3335 raft_consensus.cc:2368] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8.
I20260709 12:14:18.686468  6135 raft_consensus.cc:697] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:18.698417  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:18.706444  3264 raft_consensus.cc:1240] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:14:18.709797  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.710860  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:18.720956  3156 leader_election.cc:336] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.478s (SENT)
I20260709 12:14:18.721671  3156 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:18.683176  6105 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:18.726382  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.731906  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.732354  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.732398  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.733381  3264 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.733394  3341 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:18.749351  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.700359  6135 consensus_queue.cc:237] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.735466  6153 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:18.710498  5985 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:18.705828  5780 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:18.756300  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.759071  3265 raft_consensus.cc:2393] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:18.716154  6157 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:18.760643  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:18.762975  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:18.693593  5987 consensus_queue.cc:237] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:18.760749  3341 raft_consensus.cc:2955] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:18.766103  3263 raft_consensus.cc:1240] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:18.767385  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.772190  3265 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:18.776003  3264 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:18.777964  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:18.779525  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.773414  6130 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:18.783505  3338 raft_consensus.cc:2393] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:18.765194  5994 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:18.791917  6152 log.cc:927] Time spent T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 12:14:18.793010  6155 log.cc:927] Time spent T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:14:18.794690  5994 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:14:18.776885  6072 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:18.803923  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:19.090080  3264 raft_consensus.cc:2393] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:14:19.008906  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.950305  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 544) took 1262 ms. Trace:
W20260709 12:14:18.808357  6158 log.cc:927] Time spent T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:14:19.093065  3923 rpcz_store.cc:276] 0709 12:14:17.687950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.689865 (+  1915us) service_pool.cc:224] Handling call
0709 12:14:17.690194 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.779672 (+ 89478us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:18.017473 (+237801us) log.cc:844] Serialized 14 byte log entry
0709 12:14:18.201051 (+183578us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:18.205128 (+  4077us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:18.212003 (+  6875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.949987 (+737984us) spinlock_profiling.cc:243] Waited 65.4 ms on lock 0x7b5400373f54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:18.950049 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:18.950230 (+   181us) inbound_call.cc:177] Queueing success response
0709 12:14:19.062487 (+112257us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b1800403960. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
Metrics: {"prepare.queue_time_us":227331,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":18192,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3047,"spinlock_wait_cycles":159272960,"thread_start_us":380521,"threads_started":2,"wal-append.queue_time_us":199478}
I20260709 12:14:19.026008  6134 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:19.103899  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.105253  3267 raft_consensus.cc:2393] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:19.095891  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 547) took 1291 ms. Trace:
I20260709 12:14:19.106567  3926 rpcz_store.cc:276] 0709 12:14:17.804533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.804720 (+   187us) service_pool.cc:224] Handling call
0709 12:14:17.813389 (+  8669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:18.037675 (+224286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:18.037707 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:18.038136 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:14:18.940173 (+902037us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b18003e24e0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4c2e07 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1aee16720b 00007f1aee16cd23 00007f1aee16d0d1 00007f1aee588a0f
0709 12:14:19.093734 (+153561us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:19.093803 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.095486 (+  1683us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54005d6bd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:19.095555 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:19.095622 (+    67us) raft_consensus.cc:1685] finished
0709 12:14:19.095640 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:19.095818 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13838,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8310,"spinlock_wait_cycles":518827648,"thread_start_us":153357,"threads_started":1,"wal-append.queue_time_us":1053513}
W20260709 12:14:19.097780  3156 leader_election.cc:336] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.012s (SENT)
I20260709 12:14:18.913687  6068 consensus_queue.cc:260] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:19.026096  5922 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.901525  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.101375  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:18.946906  5296 raft_consensus.cc:3055] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:18.863783  5870 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:19.136701  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:19.142097  3260 raft_consensus.cc:2393] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:18.786103  6130 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:19.138329  3156 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:19.143960  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 46251.7us
W20260709 12:14:19.027868  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.139573  3263 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:18.913486  6105 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:19.139979  5296 raft_consensus.cc:740] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:14:18.921994  5603 consensus_meta.cc:287] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.002s
I20260709 12:14:18.992084  6157 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:19.140167  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 47595.1us
I20260709 12:14:18.893946  6007 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:18.885285  6115 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:18.858095  6108 log.cc:927] Time spent T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 1.193s	user 0.003s	sys 0.000s
I20260709 12:14:19.102325  6021 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:19.146313  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:19.276608  3338 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:19.276902  3266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 555) took 1265 ms. Trace:
I20260709 12:14:19.150862  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.277385  3266 rpcz_store.cc:276] 0709 12:14:18.011744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.011925 (+   181us) service_pool.cc:224] Handling call
0709 12:14:18.024214 (+ 12289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:18.062799 (+ 38585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.276610 (+1213811us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b54001748d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:19.276833 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67299712}
I20260709 12:14:19.278879  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:19.279459  6046 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:19.280184  6046 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.281774  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.282846  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:19.267827  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.278904  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:19.164137  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.286268  3264 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:14:19.288131  3266 raft_consensus.cc:2393] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:19.288682  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:19.270177  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.289268  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:19.289945  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:19.148849  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.164673  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:19.293386  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.294585  3263 raft_consensus.cc:2376] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6. Re-sending same reply.
I20260709 12:14:19.300258  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.301126  3264 raft_consensus.cc:2393] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:19.301427  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:19.212833  6166 log.cc:927] Time spent T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:14:19.301505  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:19.158382  6130 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.303437  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.302670  5296 consensus_queue.cc:260] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:19.304695  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.305200  5296 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:19.305354  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.305256  3264 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:19.211953  6068 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:19.225818  5870 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:19.287765  5998 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:19.306905  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:19.306059  3266 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:19.308137  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:19.313035  3932 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:14:19.287580  5949 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.165886  6072 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:19.137131  6059 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:19.292084  6132 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:19.313472  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.301749  6007 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.333657  3335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58568 (request call id 2111) took 1132 ms. Trace:
I20260709 12:14:19.334472  3339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 2112) took 1126 ms. Trace:
I20260709 12:14:19.313832  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:19.314072  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:19.142602  5922 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:19.348137  3264 raft_consensus.cc:2393] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:19.353590  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.354274  3264 raft_consensus.cc:2393] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:19.297533  6157 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:19.306974  6073 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:19.346416  3335 rpcz_store.cc:276] 0709 12:14:18.200948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.201396 (+   448us) service_pool.cc:224] Handling call
0709 12:14:19.333445 (+1132049us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b540005f354. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:19.333589 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1086375168}
I20260709 12:14:19.347030  3339 rpcz_store.cc:276] 0709 12:14:18.208196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.208309 (+   113us) service_pool.cc:224] Handling call
0709 12:14:18.234573 (+ 26264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:18.694871 (+460298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.334249 (+639378us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54000c2bd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:19.334416 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1056663296}
I20260709 12:14:19.351536  3260 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:19.348693  3263 raft_consensus.cc:2376] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6. Re-sending same reply.
I20260709 12:14:19.350481  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.360883  3266 raft_consensus.cc:2393] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:19.360826  3896 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:19.352268  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:19.295794  5603 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:19.352548  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:19.366464  3190 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:19.331915  6142 log.cc:927] Time spent T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.710s	user 0.001s	sys 0.004s
I20260709 12:14:19.329946  5870 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:19.366403  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.363199  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:19.367537  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.367744  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:19.371140  3260 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:19.371274  3335 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:19.370170  3264 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:19.348083  3923 raft_consensus.cc:1240] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:19.376668  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:19.377485  3192 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:19.370335  3191 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:19.384783  3193 raft_consensus.cc:1240] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:19.381417  3187 raft_consensus.cc:1275] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:19.372282  3932 raft_consensus.cc:2955] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:19.392589  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.388006  3335 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:19.395674  3896 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:19.369094  6059 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:19.358845  6007 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:19.398011  6157 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:19.327280  6130 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:19.352574  6132 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:19.369252  5870 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:19.349123  5949 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:19.365795  6073 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:19.400646  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:19.606521  3193 raft_consensus.cc:2393] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:19.467031  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:19.406777  3335 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:19.506731  3190 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
W20260709 12:14:19.509274  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:19.612399  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.380816  5997 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:19.511489  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.435488  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:19.643936  3341 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.645987  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:19.646586  3186 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:19.459897  3930 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37962 (request call id 532) took 3476 ms (client timeout 2044 ms). Trace:
W20260709 12:14:19.649019  3930 rpcz_store.cc:269] 0709 12:14:15.983272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.036433 (+ 53161us) service_pool.cc:224] Handling call
0709 12:14:19.459643 (+3423210us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400550354. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:19.459817 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4528625920}
I20260709 12:14:19.474431  3090 catalog_manager.cc:5697] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:19.450139  3187 raft_consensus.cc:1275] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:19.468626  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.650697  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:19.467984  3340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 2108) took 1284 ms. Trace:
I20260709 12:14:19.653676  3190 raft_consensus.cc:2376] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5. Re-sending same reply.
I20260709 12:14:19.651276  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:19.655784  3264 raft_consensus.cc:2368] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10.
I20260709 12:14:19.656735  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:19.657634  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 50023.3us
I20260709 12:14:19.661749  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:19.662371  3189 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:19.664086  3264 raft_consensus.cc:2393] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:19.666548  3341 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
W20260709 12:14:19.671116  3261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40120 (request call id 565) took 1604 ms (client timeout 1713 ms). Trace:
I20260709 12:14:19.653736  3340 rpcz_store.cc:276] 0709 12:14:18.183598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.185094 (+  1496us) service_pool.cc:224] Handling call
0709 12:14:18.194727 (+  9633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:18.195056 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:18.195082 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:18.195523 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 12:14:18.417690 (+222167us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:18.417734 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.417808 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:18.931941 (+514133us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b4800201558. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af34f6aa1 00007f1af34edb37 00007f1af34ed9ca 00007f1af35e526f 00007f1af35e4f37 00007f1af35f955c 00007f1af35f9508 00007f1af35f9488 00007f1af35f9443 00007f1af35f86ec 00007f1af2522a96
0709 12:14:19.331306 (+399365us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:19.467779 (+136473us) raft_consensus.cc:1685] finished
0709 12:14:19.467799 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:19.467923 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3633,"raft.run_cpu_time_us":1667,"raft.run_wall_time_us":730906,"spinlock_wait_cycles":8743680,"thread_start_us":217951,"threads_started":1,"wal-append.queue_time_us":276815}
I20260709 12:14:19.673329  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.674424  3186 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
W20260709 12:14:19.671708  3261 rpcz_store.cc:269] 0709 12:14:18.066417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.032697 (+966280us) service_pool.cc:224] Handling call
0709 12:14:19.468466 (+435769us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b58001c3898. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:19.671030 (+202564us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30146432}
I20260709 12:14:19.679827  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.669631  3896 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:19.682344  3189 raft_consensus.cc:1240] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:19.458739  5953 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:19.683175  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:19.694392  3193 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:19.683565  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.685067  3189 raft_consensus.cc:1275] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:19.451496  5987 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:19.459518  6134 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:19.413717  6157 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:19.658731  6007 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:19.650208  5997 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.699461  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:19.705899  3264 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:14:19.708506  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.399631  6046 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:19.712566  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.707665  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.719195  3264 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:19.720455  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.722904  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.724574  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:19.723685  3193 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:19.725764  3261 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:19.700937  5888 consensus_queue.cc:1059] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 12:14:20.038848  3191 consensus_meta.cc:287] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.004s
I20260709 12:14:19.726058  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:19.757195  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.417013  3264 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
W20260709 12:14:20.417312  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.417665  3264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2024) took 1134 ms. Trace:
W20260709 12:14:20.417943  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.418022  3264 rpcz_store.cc:276] 0709 12:14:19.283049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.725852 (+442803us) service_pool.cc:224] Handling call
0709 12:14:20.417603 (+691751us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:20.418533  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:20.419174  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.419047  3191 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
I20260709 12:14:20.419912  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40494 (request call id 1723) took 1101 ms. Trace:
I20260709 12:14:19.780985  3926 raft_consensus.cc:2393] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:19.832295  6130 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:19.838706  3925 raft_consensus.cc:1240] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:19.708606  5997 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.721249  6116 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.702s
W20260709 12:14:20.373200  3340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.000s	sys 0.045s
W20260709 12:14:20.425458  3340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.002s	sys 0.045s
I20260709 12:14:19.722719  5987 raft_consensus.cc:697] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
W20260709 12:14:20.190701  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:20.426949  3896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.011s	sys 0.039s
W20260709 12:14:20.427357  3896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.011s	sys 0.039s
I20260709 12:14:20.427201  5987 consensus_queue.cc:237] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.428186  6198 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:19.934517  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 228071us
I20260709 12:14:20.428771  6198 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.021377  5953 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.431607  5953 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.434473  5953 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:19.707587  6157 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:20.438864  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.441048  6157 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:20.443300  3185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.015s	sys 0.021s
W20260709 12:14:20.443786  3185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.015s	sys 0.021s
I20260709 12:14:19.801023  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:20.446666  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:20.447734  3263 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:20.436685  6199 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.837440  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:20.420468  3191 rpcz_store.cc:276] 0709 12:14:19.318161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.335588 (+ 17427us) service_pool.cc:224] Handling call
0709 12:14:20.419843 (+1084255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.449198  3930 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:20.438148  6198 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:19.723475  6134 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:20.448596  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:20.445627  3261 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
W20260709 12:14:20.451508  3898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.008s	sys 0.005s
I20260709 12:14:20.453329  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:20.454602  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:20.094897  6185 log.cc:927] Time spent T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:14:20.156298  6068 consensus_meta.cc:287] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.844s	user 0.012s	sys 0.000s
W20260709 12:14:20.146339  6178 log.cc:927] Time spent T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260709 12:14:20.463485  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2031) took 1142 ms. Trace:
I20260709 12:14:19.824970  6046 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:19.826776  6132 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:20.456110  3263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 1991) took 1727 ms. Trace:
W20260709 12:14:20.465132  3898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.009s	sys 0.006s
W20260709 12:14:20.411675  6182 log.cc:927] Time spent T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 12:14:20.469223  5869 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.472505  3263 rpcz_store.cc:276] 0709 12:14:18.728923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.723626 (+994703us) service_pool.cc:224] Handling call
0709 12:14:20.456041 (+732415us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.473212  5869 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.473615  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:20.474330  3263 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
W20260709 12:14:20.078277  6184 log.cc:927] Time spent T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:14:20.467157  3334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 675) took 2799 ms. Trace:
I20260709 12:14:20.481355  3334 rpcz_store.cc:276] 0709 12:14:17.664335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.664470 (+   135us) service_pool.cc:224] Handling call
0709 12:14:17.664835 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:18.687492 (+1022657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.463055 (+1775563us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000235d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:20.463266 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2350269696}
I20260709 12:14:19.930516  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:19.799644  5603 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:20.464398  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:20.469123  3261 rpcz_store.cc:276] 0709 12:14:19.321384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.726833 (+405449us) service_pool.cc:224] Handling call
0709 12:14:20.463296 (+736463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.449198  6131 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:20.499414  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.467505  6134 raft_consensus.cc:697] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:20.470813  3232 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:20.132678  5949 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:19.804476  5922 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:20.484412  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.490453  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:20.466012  6130 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:20.462745  6198 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:20.469452  5888 raft_consensus.cc:3055] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:20.498358  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:20.499781  3259 raft_consensus.cc:1240] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:20.464546  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:20.500905  3268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40120 (request call id 557) took 2487 ms (client timeout 2222 ms). Trace:
W20260709 12:14:20.504870  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.505087  3263 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:20.509745  3263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2027) took 1189 ms. Trace:
I20260709 12:14:20.510130  3263 rpcz_store.cc:276] 0709 12:14:19.320052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.490154 (+1170102us) service_pool.cc:224] Handling call
0709 12:14:20.509690 (+ 19536us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:20.509411  3268 rpcz_store.cc:269] 0709 12:14:18.013319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.013481 (+   162us) service_pool.cc:224] Handling call
0709 12:14:20.499345 (+2485864us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54003aa7d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:20.500126 (+   781us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315492736}
I20260709 12:14:20.510938  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:20.506583  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:20.511221  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:20.457590  6199 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:20.512070  3268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2022) took 1229 ms. Trace:
I20260709 12:14:20.515219  3268 rpcz_store.cc:276] 0709 12:14:19.282501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.510994 (+1228493us) service_pool.cc:224] Handling call
0709 12:14:20.512015 (+  1021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.516777  3268 raft_consensus.cc:1275] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:20.517385  3268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1576) took 2149 ms. Trace:
I20260709 12:14:20.517720  3268 rpcz_store.cc:276] 0709 12:14:18.367666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.516144 (+2148478us) service_pool.cc:224] Handling call
0709 12:14:20.516426 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.517149 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.517332 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.519160  3268 raft_consensus.cc:1275] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:20.519886  3268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1577) took 2142 ms. Trace:
I20260709 12:14:20.520742  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2016) took 1239 ms. Trace:
I20260709 12:14:20.521128  3261 rpcz_store.cc:276] 0709 12:14:19.280881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.501207 (+1220326us) service_pool.cc:224] Handling call
0709 12:14:20.520645 (+ 19438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.520332  3268 rpcz_store.cc:276] 0709 12:14:18.377099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.518587 (+2141488us) service_pool.cc:224] Handling call
0709 12:14:20.518867 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.519559 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.519836 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.523578  3264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1573) took 2164 ms. Trace:
I20260709 12:14:20.523977  3264 rpcz_store.cc:276] 0709 12:14:18.353037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.516297 (+2163260us) service_pool.cc:224] Handling call
0709 12:14:20.516563 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.516735 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:20.516761 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:20.516804 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:20.516838 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.516887 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:20.516980 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.525601  3268 raft_consensus.cc:1240] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:20.526469  3264 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:20.524943  6118 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:20.508188  5888 raft_consensus.cc:740] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:20.510814  6073 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:20.500828  6131 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.529523  3261 raft_consensus.cc:1240] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 5. Ops: []
I20260709 12:14:20.509014  6130 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.534942  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:20.535751  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:20.511277  6198 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:20.549496  3262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 1972) took 2119 ms (client timeout 1816 ms). Trace:
I20260709 12:14:20.624802  3264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1975) took 2139 ms. Trace:
I20260709 12:14:20.625365  3264 rpcz_store.cc:276] 0709 12:14:18.485529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.525773 (+2040244us) service_pool.cc:224] Handling call
0709 12:14:20.526250 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:20.624436 (+ 98186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.624725 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.552037  3259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1543) took 2389 ms. Trace:
I20260709 12:14:20.535629  6134 consensus_queue.cc:237] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.622036  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1973) took 2170 ms. Trace:
I20260709 12:14:20.622849  3268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1974) took 2168 ms. Trace:
I20260709 12:14:20.623746  3265 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:20.627384  3264 raft_consensus.cc:1240] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:20.625279  3262 rpcz_store.cc:269] 0709 12:14:18.435663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.503507 (+ 67844us) service_pool.cc:224] Handling call
0709 12:14:20.549247 (+2045740us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b54000cfb54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:20.549401 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48533376}
I20260709 12:14:20.626681  3259 rpcz_store.cc:276] 0709 12:14:18.162141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.186812 (+ 24671us) service_pool.cc:224] Handling call
0709 12:14:20.499588 (+2312776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.508686 (+  9098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.551704 (+ 43018us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b54003aa7d0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:20.551927 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5318168320}
I20260709 12:14:20.635672  3268 rpcz_store.cc:276] 0709 12:14:18.454587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.525137 (+2070550us) service_pool.cc:224] Handling call
0709 12:14:20.525428 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.622500 (+ 97072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.622774 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:20.651664  3265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2001) took 1875 ms (client timeout 2325 ms). Trace:
I20260709 12:14:20.659938  3259 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:20.659907  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 189896us
I20260709 12:14:20.661541  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1983) took 1979 ms. Trace:
I20260709 12:14:20.668151  3259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1979) took 2025 ms. Trace:
I20260709 12:14:20.635131  3261 rpcz_store.cc:276] 0709 12:14:18.452007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.525370 (+2073363us) service_pool.cc:224] Handling call
0709 12:14:20.529354 (+  3984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.621735 (+ 92381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.621969 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.668692  3259 rpcz_store.cc:276] 0709 12:14:18.642858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.659217 (+2016359us) service_pool.cc:224] Handling call
0709 12:14:20.659587 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.667804 (+  8217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.668081 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.668238  3262 rpcz_store.cc:276] 0709 12:14:18.682578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.660697 (+1978119us) service_pool.cc:224] Handling call
0709 12:14:20.661032 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.661235 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:20.661264 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:20.661305 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:20.661338 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.661391 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:20.661489 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:20.662048  3265 rpcz_store.cc:269] 0709 12:14:18.776605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.011809 (+235204us) service_pool.cc:224] Handling call
0709 12:14:20.535585 (+1523776us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b58001c3898. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:20.651598 (+116013us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23472896}
I20260709 12:14:20.670502  3264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1978) took 2029 ms. Trace:
I20260709 12:14:20.671010  3264 rpcz_store.cc:276] 0709 12:14:18.641457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.626728 (+1985271us) service_pool.cc:224] Handling call
0709 12:14:20.627151 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.670279 (+ 43128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.670452 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:20.629467  6184 log.cc:927] Time spent T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:14:20.712289  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 282638us
I20260709 12:14:20.555896  5869 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:20.736774  3265 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:20.739390  3268 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:14:20.739537  3265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1996) took 2009 ms. Trace:
I20260709 12:14:20.738329  3261 raft_consensus.cc:1240] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:20.740346  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1984) took 2053 ms. Trace:
I20260709 12:14:20.740693  3261 rpcz_store.cc:276] 0709 12:14:18.687476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.669254 (+1981778us) service_pool.cc:224] Handling call
0709 12:14:20.738156 (+ 68902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.740119 (+  1963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.740296 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.742116  3261 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:20.742758  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2002) took 1953 ms. Trace:
I20260709 12:14:20.743026  3261 rpcz_store.cc:276] 0709 12:14:18.789645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.741473 (+1951828us) service_pool.cc:224] Handling call
0709 12:14:20.741770 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.742480 (+   710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.742706 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.739785  3268 pending_rounds.cc:85] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 3
I20260709 12:14:20.744160  3268 pending_rounds.cc:107] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:14:20.744517  3268 raft_consensus.cc:2889] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:20.745698  3265 rpcz_store.cc:276] 0709 12:14:18.730494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.673578 (+1943084us) service_pool.cc:224] Handling call
0709 12:14:20.735536 (+ 61958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.739226 (+  3690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.739482 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:20.738054  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.747380  3262 raft_consensus.cc:1240] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:20.748724  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1989) took 2020 ms. Trace:
I20260709 12:14:20.749209  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:20.749691  3262 rpcz_store.cc:276] 0709 12:14:18.728216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.694803 (+1966587us) service_pool.cc:224] Handling call
0709 12:14:20.747214 (+ 52411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.748510 (+  1296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.748675 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.750087  3930 raft_consensus.cc:2468] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 2.
W20260709 12:14:20.751334  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 95239.4us
I20260709 12:14:20.752640  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:20.660426  6202 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.756517  3268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1982) took 2088 ms. Trace:
I20260709 12:14:20.781737  3268 rpcz_store.cc:276] 0709 12:14:18.667973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.659312 (+1991339us) service_pool.cc:224] Handling call
0709 12:14:20.736074 (+ 76762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.745000 (+  8926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.756454 (+ 11454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.762229  6212 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.754841  3306 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:20.763485  6204 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.767220  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:20.767526  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:20.768635  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:20.786795  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:20.777925  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:20.783655  3089 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48778 (request call id 281) took 20293 ms (client timeout 15000 ms). Trace:
I20260709 12:14:20.766213  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:20.775353  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:20.788856  3262 raft_consensus.cc:2368] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4.
I20260709 12:14:20.788905  3927 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:20.786876  3261 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:20.790759  6211 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:20.791534  6211 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.795781  3927 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:20.794348  6211 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:20.800472  6211 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.801067  6211 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:20.807439  5603 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:20.808216  5603 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:20.810619  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.810853  5603 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:20.811205  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 139151us
I20260709 12:14:20.811884  6210 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.812664  3232 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:20.812583  6210 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.815646  6210 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:20.816970  6210 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.817627  6210 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:20.816296  5603 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.731312  6203 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.786898  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:20.842042  3339 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:20.819680  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:20.824519  3232 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:20.823519  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:20.753880  6065 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:20.827406  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 72645.4us
I20260709 12:14:20.741120  6209 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:20.829730  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:20.839828  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:20.674055  6188 consensus_queue.cc:1059] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.163s
I20260709 12:14:20.823540  5994 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.873281  3337 raft_consensus.cc:1240] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:20.853277  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:20.849612  6205 log.cc:927] Time spent T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:20.826308  6204 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.876959  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:20.877067  6201 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.877542  6209 raft_consensus.cc:697] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:20.878760  6199 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:20.879977  6213 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:20.883533  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.896811  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:20.898751  6204 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:20.899951  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:20.900964  6196 log.cc:927] Time spent T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
W20260709 12:14:20.901609  6189 log.cc:927] Time spent T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
W20260709 12:14:20.905380  3926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55438 (request call id 774) took 1620 ms (client timeout 1553 ms). Trace:
I20260709 12:14:20.939415  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:20.939667  3926 rpcz_store.cc:269] 0709 12:14:19.284703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.285366 (+   663us) service_pool.cc:224] Handling call
0709 12:14:20.905091 (+1619725us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400373f54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:20.905284 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096175616}
I20260709 12:14:20.940157  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37962 (request call id 553) took 1015 ms. Trace:
I20260709 12:14:20.906250  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:20.908020  6195 log.cc:927] Time spent T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:14:20.821069  6202 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.913362  6131 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:20.913655  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:20.851754  6203 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.941702  6199 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:20.948642  6199 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:20.949026  6199 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:20.949149  5997 consensus_meta.cc:287] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 12:14:20.949750  6203 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:20.949838  3338 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:20.915342  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:20.950955  3262 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:20.916674  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:20.917379  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:20.846371  5922 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:20.851541  6084 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:14:20.846678  6192 raft_consensus.cc:2804] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:20.926206  3339 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
W20260709 12:14:20.929898  3306 leader_election.cc:336] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Timed out: RequestConsensusVote RPC to 127.1.248.68:43599 timed out after 1.920s (SENT)
I20260709 12:14:20.933494  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:20.957808  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37962 (request call id 552) took 1058 ms. Trace:
I20260709 12:14:20.935901  3186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1731) took 1550 ms. Trace:
I20260709 12:14:20.959007  3186 rpcz_store.cc:276] 0709 12:14:19.385500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.675370 (+289870us) service_pool.cc:224] Handling call
0709 12:14:19.675726 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:19.685498 (+  9772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:19.685533 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:19.685584 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:19.685633 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.935609 (+1249976us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b54000be354. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:20.935667 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:20.935829 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22055808}
W20260709 12:14:20.938508  3156 connection.cc:256] RPC call timeout handler was delayed by -1.4117451760000677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2988s for a response
W20260709 12:14:20.960875  3156 leader_election.cc:336] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.839s (SENT)
I20260709 12:14:20.961395  3156 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:20.940529  3929 rpcz_store.cc:276] 0709 12:14:19.925307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.925613 (+   306us) service_pool.cc:224] Handling call
0709 12:14:20.939281 (+1013668us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:20.940101 (+   820us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1202488704}
I20260709 12:14:20.887599  6073 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:20.919802  6208 log.cc:927] Time spent T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:14:20.784895  5888 consensus_queue.cc:260] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.947679  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:20.826961  6191 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:21.019742  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.868891  5603 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:20.871480  6065 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.958243  3928 rpcz_store.cc:276] 0709 12:14:19.899714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.899867 (+   153us) service_pool.cc:224] Handling call
0709 12:14:20.933355 (+1033488us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:20.957736 (+ 24381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64145792}
W20260709 12:14:21.038727  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 77887.9us
W20260709 12:14:21.061070  3156 leader_election.cc:336] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.836s (SENT)
W20260709 12:14:21.062039  3156 connection.cc:256] RPC call timeout handler was delayed by -1.2343429860000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 12:14:21.062454  3156 connection.cc:256] RPC call timeout handler was delayed by -1.2001239999999598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 12:14:21.062831  3156 connection.cc:256] RPC call timeout handler was delayed by -1.0642889040000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23250000000000004s for a response
I20260709 12:14:21.049842  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:21.063216  3156 connection.cc:256] RPC call timeout handler was delayed by -1.0104228750001312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32320000000000004s for a response
I20260709 12:14:21.064244  3262 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:21.069001  3156 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:21.056032  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:20.822111  6212 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:20.919526  5994 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:21.060109  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 235645us
I20260709 12:14:21.074177  3156 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:21.037182  3337 raft_consensus.cc:2468] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 2.
I20260709 12:14:21.070199  3261 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:14:20.788069  3089 rpcz_store.cc:269] 0709 12:14:00.365829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.367504 (+  1675us) service_pool.cc:224] Handling call
0709 12:14:20.644281 (+20276777us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:11.795735 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:11.796672 (+   937us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:11.796719 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:14:11.796749 (+    30us) tablet.cc:662] Decoding operations
0709 12:14:11.797694 (+   945us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:11.797839 (+   145us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:11.797879 (+    40us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:14:11.798664 (+   785us) tablet.cc:701] Row locks acquired
0709 12:14:11.798717 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:14:11.798911 (+   194us) write_op.cc:270] Start()
0709 12:14:11.799079 (+   168us) write_op.cc:276] Timestamp: P: 1783599251798836 usec, L: 0
0709 12:14:11.799104 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:14:11.895855 (+ 96751us) log.cc:844] Serialized 2454 byte log entry
0709 12:14:12.755318 (+859463us) op_driver.cc:464] REPLICATION: finished
0709 12:14:12.897435 (+142117us) write_op.cc:301] APPLY: starting
0709 12:14:12.939492 (+ 42057us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:12.939761 (+   269us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:12.939940 (+   179us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:12.945827 (+  5887us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:12.946208 (+   381us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:14:12.946273 (+    65us) write_op.cc:312] APPLY: finished
0709 12:14:12.946669 (+   396us) log.cc:844] Serialized 53 byte log entry
0709 12:14:12.946910 (+   241us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:12.947053 (+   143us) write_op.cc:454] Released schema lock
0709 12:14:12.947126 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:13.002842 (+ 55716us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:13.012541 (+  9699us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17113,"reported_tablets":33,"spinlock_wait_cycles":21760,"child_traces":[["op",{"apply.queue_time_us":123735,"apply.run_cpu_time_us":6904,"apply.run_wall_time_us":84703,"num_ops":6,"prepare.queue_time_us":117463,"prepare.run_cpu_time_us":22897,"prepare.run_wall_time_us":167913,"raft.queue_time_us":312417,"raft.run_cpu_time_us":9826,"raft.run_wall_time_us":148588,"replication_time_us":921353,"spinlock_wait_cycles":1280,"thread_start_us":360121,"threads_started":4,"wal-append.queue_time_us":63386,"wal-append.run_cpu_time_us":108454,"wal-append.run_wall_time_us":2014588}]]}
I20260709 12:14:20.951279  6213 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.956344  5922 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:21.097080  3156 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:21.047717  3260 raft_consensus.cc:2376] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5. Re-sending same reply.
I20260709 12:14:21.047406  6131 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.078428  6130 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:21.079995  6202 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:21.081128  5603 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:21.070652  5869 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.087801  6198 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:21.089452  5994 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:21.076079  6206 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.092739  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:21.076385  6192 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.094185  6209 consensus_queue.cc:237] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:20.929200  6201 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.076943  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.145731  3157 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:21.151981  3261 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:21.152997  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.154273  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.155200  3261 raft_consensus.cc:2410] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:21.124511  6157 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.119860  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.120848  3156 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:21.119182  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.123317  3265 raft_consensus.cc:2376] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5. Re-sending same reply.
I20260709 12:14:21.055182  6073 raft_consensus.cc:697] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:21.125067  3185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1726) took 1806 ms. Trace:
I20260709 12:14:21.167728  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.168797  3261 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:21.169883  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:20.949767  5997 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.071964  6126 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:21.129055  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:21.140362  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 73316.9us
I20260709 12:14:21.181931  3268 raft_consensus.cc:2410] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:14:21.145001  6131 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.145763  3264 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:21.119839  6132 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.121254  5922 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:21.200793  6073 consensus_queue.cc:237] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.201659  6021 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.171185  5603 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:21.203939  5603 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:21.203508  6126 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.053738  6207 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:21.160151  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 314811us
I20260709 12:14:21.204687  6131 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.211732  3305 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:21.161477  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 407054us
I20260709 12:14:21.214749  3895 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:21.163348  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.165999  3185 rpcz_store.cc:276] 0709 12:14:19.319061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.648227 (+329166us) service_pool.cc:224] Handling call
0709 12:14:19.671341 (+ 23114us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:19.685169 (+ 13828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:19.685198 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:19.723854 (+ 38656us) log.cc:844] Serialized 26 byte log entry
0709 12:14:20.444297 (+720443us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:20.444355 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.444450 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.124856 (+680406us) raft_consensus.cc:1685] finished
0709 12:14:21.124878 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.125010 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25135,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4158,"thread_start_us":607009,"threads_started":1,"wal-append.queue_time_us":705942}
W20260709 12:14:21.172106  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.170527  3261 raft_consensus.cc:2376] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7. Re-sending same reply.
W20260709 12:14:21.182531  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 95020.7us
I20260709 12:14:21.148427  6220 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.195927  3264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1997) took 2465 ms. Trace:
I20260709 12:14:21.142256  5869 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.075721  6213 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.215375  3930 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:21.204435  5603 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.207983  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:21.209561  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:21.209879  3929 raft_consensus.cc:1240] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:21.210394  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:21.210515  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:21.211917  6130 consensus_queue.cc:1059] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:21.216087  3305 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:21.216128  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.216099  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.218153  3924 raft_consensus.cc:2368] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6.
W20260709 12:14:21.228484  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.148123  6192 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.222028  3264 rpcz_store.cc:276] 0709 12:14:18.730798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.730447 (+1999649us) service_pool.cc:224] Handling call
0709 12:14:21.145260 (+414813us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b58001c3898. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:14:21.145449 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.195573 (+ 50124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.195853 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23288064}
I20260709 12:14:21.229672  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.230269  3264 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:21.231135  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:21.210772  3157 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
W20260709 12:14:21.206012  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 85252.9us
I20260709 12:14:21.232715  3156 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:21.203534  6217 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:21.203646  6202 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.235472  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.236143  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.237102  3266 raft_consensus.cc:2393] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:21.213634  6131 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:21.218489  6084 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:21.221364  6175 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:21.227103  5949 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.244410  3895 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:21.250277  6201 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:21.250641  5603 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:21.227341  6220 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.253976  6220 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:21.254492  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:21.255141  6227 log.cc:927] Time spent T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:14:21.256934  6215 log.cc:927] Time spent T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:14:21.257413  6116 raft_consensus.cc:3055] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:21.257833  6116 raft_consensus.cc:740] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:21.258299  3263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 570) took 3050 ms. Trace:
I20260709 12:14:21.258657  3263 rpcz_store.cc:276] 0709 12:14:18.207747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.516121 (+2308374us) service_pool.cc:224] Handling call
0709 12:14:20.532141 (+ 16020us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:20.746066 (+213925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:20.746094 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:20.764120 (+ 18026us) log.cc:844] Serialized 26 byte log entry
0709 12:14:20.856673 (+ 92553us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:20.856710 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.856774 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.258072 (+401298us) raft_consensus.cc:1685] finished
0709 12:14:21.258096 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.258241 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":230655,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":170,"thread_start_us":305570,"threads_started":2,"wal-append.queue_time_us":170108}
I20260709 12:14:21.260469  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.261044  3263 raft_consensus.cc:2376] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7. Re-sending same reply.
I20260709 12:14:21.261935  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.262941  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.263509  6187 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:21.258615  6116 consensus_queue.cc:260] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.221912  6191 consensus_queue.cc:1048] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:14:21.265060  6116 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.265889  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:21.266528  6065 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:21.230733  6210 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:21.269920  3263 raft_consensus.cc:2410] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:21.272715  5997 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:21.272995  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.273583  6175 raft_consensus.cc:697] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:21.274077  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.275206  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:21.276364  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.277114  3266 raft_consensus.cc:2376] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8. Re-sending same reply.
I20260709 12:14:21.278745  3263 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:21.280206  3265 raft_consensus.cc:1275] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:21.280822  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.281993  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:21.283874  3268 raft_consensus.cc:2393] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:21.284310  3265 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:21.233444  6224 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:14:21.288363  5869 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:21.242391  6202 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.288966  3263 raft_consensus.cc:1275] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:21.290666  3264 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:21.292826  3266 raft_consensus.cc:1275] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:21.223271  6207 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.295622  5997 consensus_queue.cc:1059] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:21.296319  6213 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:21.296867  6207 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:21.299549  3895 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:21.300741  3928 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:21.301155  3932 raft_consensus.cc:1240] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:21.283586  6197 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:21.246766  6131 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:14:21.241739  6217 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:21.308642  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.309463  6197 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:21.300239  6212 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:21.246338  6084 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.270090  6199 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.304739  6233 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:21.298309  6210 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:21.278482  6221 raft_consensus.cc:2804] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:21.364331  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.393067  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 93652.7us
I20260709 12:14:21.393602  3895 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:21.367313  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.274518  6175 consensus_queue.cc:237] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.389551  5869 consensus_queue.cc:1059] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:14:21.396942  5870 raft_consensus.cc:3055] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:21.397311  5870 raft_consensus.cc:740] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:21.397794  6187 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:21.398221  6187 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:21.389910  6197 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.398154  5870 consensus_queue.cc:260] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.398201  6084 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:21.398821  6187 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.400545  6199 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:21.410218  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:21.411463  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:21.415726  3895 connection.cc:256] RPC call timeout handler was delayed by -1.2449808870001107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260709 12:14:21.416075  3895 connection.cc:256] RPC call timeout handler was delayed by -1.1027808870001081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 12:14:21.416303  3895 connection.cc:256] RPC call timeout handler was delayed by -1.0487808870000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 12:14:21.392037  6210 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:21.408147  6226 log.cc:927] Time spent T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.113s	user 0.001s	sys 0.008s
I20260709 12:14:21.394680  6221 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:21.404554  6233 raft_consensus.cc:697] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:14:21.424767  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 208776us
I20260709 12:14:21.406738  5870 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.423553  6021 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:21.428556  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.429723  3266 raft_consensus.cc:1240] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:21.392477  6213 consensus_queue.cc:1059] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:14:21.410430  6126 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:21.426644  3305 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:21.424546  6210 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:21.406474  6199 consensus_queue.cc:1059] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:14:21.446036  5997 consensus_queue.cc:1059] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:21.407218  6212 consensus_queue.cc:1059] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:14:21.449687  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.427611  6221 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:21.449584  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:21.456061  3267 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:21.460094  3923 raft_consensus.cc:1240] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:21.461753  3267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 1995) took 2731 ms (client timeout 2478 ms). Trace:
W20260709 12:14:21.462244  3267 rpcz_store.cc:269] 0709 12:14:18.730148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.105808 (+375660us) service_pool.cc:224] Handling call
0709 12:14:20.745447 (+1639639us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b58001c3898. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:21.449447 (+704000us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b58001c3898. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8e9c 00007f1aeb4a8a5b 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:21.461662 (+ 12215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24343680}
I20260709 12:14:21.462466  3305 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:21.447412  5997 raft_consensus.cc:3055] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:21.467617  3266 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:21.443295  6118 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:21.473953  5922 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.474803  6233 consensus_queue.cc:237] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.475463  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:21.463109  6206 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:21.475687  6213 raft_consensus.cc:3055] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:21.461825  6202 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:21.487078  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:21.496070  6118 raft_consensus.cc:697] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:21.497118  6118 consensus_queue.cc:237] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.498701  5949 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:21.499590  3932 raft_consensus.cc:1240] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:21.468258  6191 consensus_queue.cc:1048] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:14:21.469002  6212 consensus_queue.cc:1243] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer 6f0cdd57c5934921829c205d32b2b8a5 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:14:21.476107  6068 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:21.501976  6068 raft_consensus.cc:697] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:14:21.502835  6230 log.cc:927] Time spent T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
I20260709 12:14:21.505035  6192 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.492497  6213 raft_consensus.cc:740] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:21.507213  6213 consensus_queue.cc:260] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.508387  6213 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.511526  6186 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:21.512279  6186 raft_consensus.cc:697] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:21.512377  6157 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:21.469388  5997 raft_consensus.cc:740] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:21.523882  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:21.524748  3185 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:21.526541  3186 raft_consensus.cc:1275] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:21.529510  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:21.532574  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:21.533633  3185 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:21.519338  6197 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:21.538844  6235 log.cc:927] Time spent T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:14:21.540117  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:21.520918  6207 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:21.540611  3259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 1987) took 2830 ms. Trace:
I20260709 12:14:21.541468  3191 raft_consensus.cc:1275] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:21.541059  3259 rpcz_store.cc:276] 0709 12:14:18.710417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.715554 (+2005137us) service_pool.cc:224] Handling call
0709 12:14:20.785960 (+ 70406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:21.057358 (+271398us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:21.057390 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:21.124541 (+ 67151us) log.cc:844] Serialized 26 byte log entry
0709 12:14:21.222835 (+ 98294us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:21.222869 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.222930 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.540419 (+317489us) raft_consensus.cc:1685] finished
0709 12:14:21.540437 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.540558 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88758,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":131,"thread_start_us":327657,"threads_started":2,"wal-append.queue_time_us":248173}
I20260709 12:14:21.545315  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:21.546252  3184 raft_consensus.cc:2393] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:21.563376  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 352990us
I20260709 12:14:21.565148  3157 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:21.566385  6247 raft_consensus.cc:2804] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:21.567003  6247 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:21.567026  6242 consensus_queue.cc:1059] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:21.567704  6247 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:21.569026  3305 connection.cc:256] RPC call timeout handler was delayed by -2.03014979999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.5026s for a response
W20260709 12:14:21.570099  3305 connection.cc:256] RPC call timeout handler was delayed by -1.7806071370000609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 12:14:21.570541  3305 connection.cc:256] RPC call timeout handler was delayed by -1.7077738330001466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 12:14:21.570902  3305 connection.cc:256] RPC call timeout handler was delayed by -1.6163594089998696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 12:14:21.571273  3305 connection.cc:256] RPC call timeout handler was delayed by -1.5704594090000228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
W20260709 12:14:21.571652  3305 connection.cc:256] RPC call timeout handler was delayed by -1.566859409000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 12:14:21.572788  3190 raft_consensus.cc:1240] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:21.572957  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:21.572772  3305 connection.cc:256] RPC call timeout handler was delayed by -1.4705594089998613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
I20260709 12:14:21.540786  6197 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:21.574267  3305 connection.cc:256] RPC call timeout handler was delayed by -1.42195940900001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
I20260709 12:14:21.576175  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:21.581851  3305 connection.cc:256] RPC call timeout handler was delayed by -1.3274594089998573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 12:14:21.582398  3305 connection.cc:256] RPC call timeout handler was delayed by -1.3265594089998558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 12:14:21.582763  3305 connection.cc:256] RPC call timeout handler was delayed by -1.2793071369999325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
W20260709 12:14:21.583110  3305 connection.cc:256] RPC call timeout handler was delayed by -1.2650726960000611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 12:14:21.583487  3305 connection.cc:256] RPC call timeout handler was delayed by -1.2563594089999697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260709 12:14:21.583863  3305 connection.cc:256] RPC call timeout handler was delayed by -1.239259408999942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 12:14:21.584268  3305 connection.cc:256] RPC call timeout handler was delayed by -1.2325071370000842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
W20260709 12:14:21.584717  3305 connection.cc:256] RPC call timeout handler was delayed by -1.1649898400000893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.48390000000000005s for a response
W20260709 12:14:21.585076  3305 connection.cc:256] RPC call timeout handler was delayed by -1.1636594089998198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
I20260709 12:14:21.585186  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:21.585451  3305 connection.cc:256] RPC call timeout handler was delayed by -1.1536852529998214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 12:14:21.585743  3305 connection.cc:256] RPC call timeout handler was delayed by -1.1267594089999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
W20260709 12:14:21.586020  3305 connection.cc:256] RPC call timeout handler was delayed by -1.0345558379999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.5001000000000001s for a response
W20260709 12:14:21.586282  3305 connection.cc:256] RPC call timeout handler was delayed by -1.0228071369999725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2388s for a response
W20260709 12:14:21.586598  3305 connection.cc:256] RPC call timeout handler was delayed by -1.0204852529998334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
I20260709 12:14:21.556463  5949 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:21.547588  6207 raft_consensus.cc:697] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:21.593276  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:21.590672  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:21.594386  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:21.594758  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:21.592110  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:21.595672  3334 raft_consensus.cc:1240] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:21.595981  3338 raft_consensus.cc:2410] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:21.574462  6114 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.598479  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:21.502861  6068 consensus_queue.cc:237] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.604619  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:21.606215  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:21.608837  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.602092  6114 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.644625  6073 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:21.645498  6114 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:21.597424  6084 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:14:21.650324  6207 consensus_queue.cc:237] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.592303  6191 consensus_queue.cc:1059] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:14:21.601874  3190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "eb49d92feeb14382b3baa49d696b6141"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:14:21.666980  3190 raft_consensus.cc:606] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Received request to transfer leadership to TS eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:21.671778  3190 raft_consensus.cc:614] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:21.683017  6239 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.592618  6186 consensus_queue.cc:237] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.683713  6239 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.686141  6239 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:21.690585  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 97223.9us
W20260709 12:14:21.692747  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.599730  5949 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:21.715837  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 109730us
W20260709 12:14:21.718807  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.665759  6073 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.596735  5997 consensus_queue.cc:260] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.679965  6191 consensus_queue.cc:1243] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:21.728833  3338 raft_consensus.cc:1240] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:21.728145  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 118672us
I20260709 12:14:21.731194  6259 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 12:14:21.779948  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.785110  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.714118  6210 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.727414  6157 consensus_queue.cc:1059] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:14:21.725314  6239 consensus_queue.cc:1048] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:14:21.772207  5997 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:21.808305  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 85256.4us
W20260709 12:14:21.788884  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.809752  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.786068  6252 log.cc:927] Time spent T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:14:21.797901  5888 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:21.802317  6046 raft_consensus.cc:3055] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:21.802894  3338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:46076
I20260709 12:14:21.836489  3338 raft_consensus.cc:606] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
W20260709 12:14:21.788867  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 54211.6us
W20260709 12:14:21.823089  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.769078  6242 consensus_queue.cc:1059] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:14:21.838121  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.825289  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.842074  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.844901  6007 raft_consensus.cc:3055] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:21.845307  6007 raft_consensus.cc:740] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:21.846539  6244 raft_consensus.cc:3055] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:21.846918  6244 raft_consensus.cc:740] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:21.848898  6247 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.849972  3193 raft_consensus.cc:1240] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:21.850757  6192 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:21.850867  6247 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:21.840340  6246 log.cc:927] Time spent T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:14:21.836010  6046 raft_consensus.cc:740] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:21.852790  6046 consensus_queue.cc:260] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.795076  6068 consensus_queue.cc:1059] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 12:14:21.899053  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.789372  5922 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:21.901563  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:21.847728  6244 consensus_queue.cc:260] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.823540  6187 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.944667  6244 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.945647  6187 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:21.911674  6192 consensus_queue.cc:1048] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 12:14:21.937629  5870 consensus_meta.cc:287] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.002s
I20260709 12:14:21.937578  5949 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:21.905103  6191 consensus_queue.cc:1059] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:14:21.949168  6191 raft_consensus.cc:3055] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:21.949487  6191 raft_consensus.cc:740] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:21.940635  3923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:14:21.906574  6239 consensus_queue.cc:1048] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:14:21.950994  3923 raft_consensus.cc:606] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
W20260709 12:14:21.904273  6215 log.cc:927] Time spent T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:14:21.950268  6191 consensus_queue.cc:260] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.910997  6007 consensus_queue.cc:260] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:21.953236  6191 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.942260  6221 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:21.953685  6007 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.955135  6221 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:21.957186  3156 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.014s	sys 0.035s
W20260709 12:14:21.957507  3156 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.014s	sys 0.035s
W20260709 12:14:21.958009  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 725284us
I20260709 12:14:21.958693  3156 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:21.960069  6247 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:21.845335  6210 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:21.960443  6247 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:21.943748  6116 consensus_meta.cc:287] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.000s
I20260709 12:14:21.976401  3929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:14:21.978345  3929 raft_consensus.cc:606] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:21.978930  3929 raft_consensus.cc:614] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:14:21.977965  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 152754us
I20260709 12:14:21.980756  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:21.970043  6247 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.982914  3305 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:21.999101  3305 leader_election.cc:400] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4.
I20260709 12:14:21.999413  3305 leader_election.cc:403] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:14:22.000151  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.001530  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:21.984603  6068 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:22.004541  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:22.006881  3305 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:22.002722  5688 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:22.004091  3928 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:22.013901  6207 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:22.013597  3305 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:22.003005  5869 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4.
I20260709 12:14:22.007056  6269 raft_consensus.cc:2804] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:22.006721  5870 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:22.004693  6068 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:22.022358  6269 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:22.029532  6269 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:22.038473  6267 log.cc:927] Time spent T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:14:22.041050  6214 raft_consensus.cc:3055] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:22.041484  6214 raft_consensus.cc:740] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:22.042119  6247 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:22.042332  6214 consensus_queue.cc:260] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.043541  6214 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.046370  6217 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:22.049485  6247 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:22.049575  6241 log.cc:927] Time spent T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.509s	user 0.001s	sys 0.000s
I20260709 12:14:22.042755  6269 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:22.052217  6265 log.cc:927] Time spent T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 12:14:22.056331  6245 log.cc:927] Time spent T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.379s	user 0.003s	sys 0.000s
I20260709 12:14:22.056895  6269 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:22.058101  6249 log.cc:927] Time spent T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.494s	user 0.000s	sys 0.002s
W20260709 12:14:22.058224  6264 log.cc:927] Time spent T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.122s	user 0.000s	sys 0.002s
W20260709 12:14:22.060070  6272 log.cc:927] Time spent T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.122s	user 0.002s	sys 0.000s
W20260709 12:14:22.060124  6270 log.cc:927] Time spent T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
W20260709 12:14:22.092113  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:22.093420  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 121295us
W20260709 12:14:22.096704  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.102221  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:22.107949  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 94287.2us
I20260709 12:14:22.117244  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:22.118562  3262 raft_consensus.cc:2376] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6. Re-sending same reply.
I20260709 12:14:22.109110  3338 raft_consensus.cc:1240] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:22.122373  3265 raft_consensus.cc:3055] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:22.026775  6068 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:22.134053  6237 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.135175  6237 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:22.137641  6191 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:22.138500  6191 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:22.139016  6191 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.128608  3265 raft_consensus.cc:740] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:14:22.147244  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.147464  6242 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:14:22.149464  6242 consensus_queue.cc:1243] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:22.152108  6247 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:22.153748  3189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:14:22.154934  3189 raft_consensus.cc:606] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:22.155565  3189 raft_consensus.cc:614] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:22.156039  6211 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:22.157049  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.158043  6233 consensus_queue.cc:1059] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:22.159112  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.159219  6233 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:22.159792  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:22.160228  6233 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.161724  6130 raft_consensus.cc:3055] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:22.162325  6130 raft_consensus.cc:740] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:22.164330  6130 consensus_queue.cc:260] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.166555  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.167757  3337 raft_consensus.cc:2393] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:22.170364  6233 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:22.175499  6244 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:22.176608  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.179658  3265 consensus_queue.cc:260] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.181281  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:22.183826  3157 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:22.185012  3265 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:22.211557  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 74760.6us
I20260709 12:14:22.190389  3337 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:22.194446  6233 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:22.215337  3156 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:22.195271  6244 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:22.216480  6244 raft_consensus.cc:697] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:22.217252  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:22.217412  3156 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:22.218050  6244 consensus_queue.cc:237] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.180100  6068 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.221470  3932 raft_consensus.cc:1240] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:22.221590  6068 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:22.222378  6242 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:22.222805  5922 raft_consensus.cc:3055] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:22.223276  5922 raft_consensus.cc:740] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:14:22.223752  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 105422us
I20260709 12:14:22.224176  6242 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:22.224695  5922 consensus_queue.cc:260] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:22.225425  6242 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:22.226111  3305 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:22.226696  3334 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:22.227797  6269 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:22.228246  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:22.230227  3260 raft_consensus.cc:3055] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:22.230603  3260 raft_consensus.cc:740] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:22.231895  3260 consensus_queue.cc:260] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.233170  3260 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.237535  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:22.238576  3267 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:22.240800  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:22.241781  3268 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:22.142894  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56754 (request call id 1588) took 1359 ms. Trace:
I20260709 12:14:22.249061  3262 rpcz_store.cc:276] 0709 12:14:20.768765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.065609 (+296844us) service_pool.cc:224] Handling call
0709 12:14:22.116661 (+1051052us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b58001c3898. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:22.128216 (+ 11555us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19014016}
I20260709 12:14:22.160826  3333 raft_consensus.cc:1275] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:22.140650  6237 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:22.251978  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 529162us
I20260709 12:14:22.252431  3305 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:22.253527  6114 raft_consensus.cc:2749] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:22.254621  6136 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:22.256870  3156 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:22.207325  3924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37962 (request call id 550) took 2319 ms (client timeout 1920 ms). Trace:
I20260709 12:14:22.259399  3156 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:22.259774  3924 rpcz_store.cc:269] 0709 12:14:19.887739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.887905 (+   166us) service_pool.cc:224] Handling call
0709 12:14:21.092602 (+1204697us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:22.206663 (+1114061us) spinlock_profiling.cc:243] Waited 74.1 ms on lock 0x7b54001ca054. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:22.206984 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185105536}
I20260709 12:14:22.262578  3305 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:22.211045  3263 pending_rounds.cc:85] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 6
I20260709 12:14:22.263953  3263 pending_rounds.cc:107] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:14:22.264457  3263 raft_consensus.cc:2889] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:22.249615  6065 raft_consensus.cc:3055] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:22.266215  6065 raft_consensus.cc:740] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:22.267663  6065 consensus_queue.cc:260] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.271196  6237 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:22.273118  6046 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.167295  6130 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.276429  6065 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:22.277310  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.281302  5922 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:22.282770  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.248238  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:22.294924  3932 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.296099  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:22.304795  3924 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:22.306723  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:22.307538  3924 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.307994  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:22.308799  3261 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:22.316179  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.329627  3260 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:22.346881  3924 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:22.295306  6206 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:22.365435  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:22.365362  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 102983us
I20260709 12:14:22.366262  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:22.368074  6114 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:22.371165  6114 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:22.373415  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.374361  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:22.377189  6114 consensus_queue.cc:1048] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:22.379350  6114 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:22.379989  6114 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:22.380479  6114 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:22.382995  5888 consensus_meta.cc:287] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.547s	user 0.004s	sys 0.014s
I20260709 12:14:22.384218  5870 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.384754  5870 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.387146  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:22.389132  5870 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:22.390415  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:22.391934  3335 raft_consensus.cc:2410] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:22.392496  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:22.394469  3335 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:14:22.397053  3259 raft_consensus.cc:1240] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:22.396867  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.399480  5997 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:22.401362  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.401794  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.403065  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.404997  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.405841  3342 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:22.406548  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.407078  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.407721  6192 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:22.408514  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.409782  3336 raft_consensus.cc:1240] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:22.410305  3335 raft_consensus.cc:2393] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:22.409754  3340 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:22.408514  6192 raft_consensus.cc:697] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:22.411975  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.411794  6192 consensus_queue.cc:237] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:22.413983  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:22.415570  6243 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.014s	sys 0.025s
I20260709 12:14:22.416172  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.418390  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.420408  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:22.422857  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:22.424957  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.425451  6114 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:22.427165  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.427812  6114 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:22.430066  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 80544.7us
I20260709 12:14:22.441763  3932 raft_consensus.cc:2468] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:14:22.443532  3261 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
W20260709 12:14:22.416193  6243 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.014s	sys 0.026s
W20260709 12:14:22.445096  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.324476  6191 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.451122  3341 raft_consensus.cc:2410] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:22.456650  3265 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:14:22.457199  3265 pending_rounds.cc:85] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 7
I20260709 12:14:22.463511  3265 pending_rounds.cc:107] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:14:22.463835  3265 raft_consensus.cc:2889] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:22.464233  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 205073us
I20260709 12:14:22.466837  3339 raft_consensus.cc:2393] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:22.469842  3268 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:22.473697  3262 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:22.480078  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:22.486094  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:22.486405  6199 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:14:22.486816  3265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 577) took 1068 ms. Trace:
I20260709 12:14:22.487255  3265 rpcz_store.cc:276] 0709 12:14:21.418657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.418789 (+   132us) service_pool.cc:224] Handling call
0709 12:14:21.419106 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:22.122010 (+702904us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b54001340a0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee544dc0 00007f1aee5cf1c0 00007f1aee5d0231 00007f1aee5ccd8f 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c
0709 12:14:22.475381 (+353371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.486729 (+ 11348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217192704}
I20260709 12:14:22.493314  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:22.494760  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:22.496132  6065 raft_consensus.cc:1064] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:14:22.496279  3340 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:22.482707  3336 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:22.503170  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:22.506789  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:22.507028  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:22.507668  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.507726  3342 raft_consensus.cc:2393] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:22.508194  3928 raft_consensus.cc:1240] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:22.508950  6199 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.506807  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:22.509727  6199 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:22.510584  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:22.511117  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:22.511312  3262 raft_consensus.cc:2376] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6. Re-sending same reply.
I20260709 12:14:22.511821  3931 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:22.512251  6192 consensus_queue.cc:1059] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:22.513228  3339 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:14:22.513676  3339 pending_rounds.cc:85] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 6
I20260709 12:14:22.514052  3339 pending_rounds.cc:107] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:14:22.514427  3339 raft_consensus.cc:2889] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:22.513525  6084 raft_consensus.cc:3055] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:22.515093  6084 raft_consensus.cc:740] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:22.515898  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:22.513921  3306 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:22.522779  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:22.517848  3156 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:22.523931  3261 raft_consensus.cc:1240] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:22.532035  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:22.533922  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:22.535852  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:22.537699  6191 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:22.537942  3259 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:22.506943  6206 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.537693  6084 consensus_queue.cc:260] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.541620  6206 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:22.542258  6084 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.549430  6134 raft_consensus.cc:993] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: : Instructing follower 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:14:22.549793  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:22.550570  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:22.513254  6192 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:14:22.549470  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:22.550005  6134 raft_consensus.cc:1081] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Signalling peer 1ef05c9d901046dca7fe0e638cc693b9 to start an election
I20260709 12:14:22.552983  3930 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:22.551244  3186 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:22.556092  3260 raft_consensus.cc:2376] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7. Re-sending same reply.
I20260709 12:14:22.560498  3931 raft_consensus.cc:2393] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:22.549887  6191 raft_consensus.cc:2804] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:22.557868  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:22.531731  6244 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:22.572408  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:22.560145  6237 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:22.575165  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:22.582568  3268 raft_consensus.cc:3055] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:22.582940  3268 raft_consensus.cc:740] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:22.583271  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:22.583698  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 98850.6us
I20260709 12:14:22.584637  3260 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:22.576313  6192 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:22.575336  6191 raft_consensus.cc:697] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:22.589553  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:22.594389  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:22.595247  6206 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:22.603597  3265 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:14:22.605396  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.612159  3930 raft_consensus.cc:1240] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:22.613587  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:22.593885  6192 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:22.614565  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.614661  3192 raft_consensus.cc:2410] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:22.616518  6192 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:22.619642  6116 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:22.622035  3156 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:22.625723  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:22.626734  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:22.627528  3260 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:22.603050  6199 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:22.639811  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:22.599467  6237 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:14:22.644882  6244 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:22.652238  3333 raft_consensus.cc:1240] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:22.652856  6244 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:22.657392  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.622936  3268 consensus_queue.cc:260] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:22.665539  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:22.664448  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:22.666535  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:22.669386  3931 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:22.673399  3932 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:22.659523  6244 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:22.676820  6286 log.cc:927] Time spent T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:22.677415  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:22.677927  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.680177  3337 raft_consensus.cc:1240] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:22.685274  3924 raft_consensus.cc:2393] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:22.681327  6199 consensus_queue.cc:1059] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 12:14:22.690547  6281 log.cc:927] Time spent T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.132s	user 0.001s	sys 0.002s
I20260709 12:14:22.692351  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:22.694705  3896 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:22.695523  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:22.696058  6287 log.cc:927] Time spent T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:14:22.696179  3192 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:22.696425  5949 raft_consensus.cc:2764] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:14:22.699390  5949 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:22.701330  5949 consensus_queue.cc:1059] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:22.702597  6116 raft_consensus.cc:3055] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:22.702991  6116 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:22.703104  6206 consensus_queue.cc:1059] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:22.704169  6206 raft_consensus.cc:3055] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:22.704066  6116 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.705665  3924 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:22.707247  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 112148us
I20260709 12:14:22.708117  3156 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:22.709064  6233 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:22.709836  3156 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:22.709997  6233 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.710592  6233 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.712342  6116 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:22.704592  6206 raft_consensus.cc:740] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:22.720182  6206 consensus_queue.cc:260] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:22.720988  6186 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:22.721474  6206 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.712910  6134 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:22.722587  6186 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:22.724347  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.728327  3337 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:22.730321  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:22.733341  3191 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:22.734876  3188 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:22.714910  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:22.737498  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.738519  3188 raft_consensus.cc:1240] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:22.742376  3157 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:22.713013  6233 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:22.745558  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.745909  6136 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.748857  3268 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:22.761742  3931 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
W20260709 12:14:22.762854  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.750310  3186 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
W20260709 12:14:22.751474  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 66839.8us
I20260709 12:14:22.776460  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:22.660686  6191 consensus_queue.cc:237] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.781679  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:22.785486  6130 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:22.785971  6130 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.786319  6130 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:22.786365  3231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 2.116s (SENT) [suppressed 44 similar messages]
W20260709 12:14:22.791905  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:22.796396  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.800683  3268 raft_consensus.cc:1275] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:14:22.801442  3268 pending_rounds.cc:85] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 3
I20260709 12:14:22.801774  3268 pending_rounds.cc:107] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:14:22.802493  3268 raft_consensus.cc:2889] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:22.803618  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 93868.5us
I20260709 12:14:22.803966  3924 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:22.805765  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:22.820686  3339 raft_consensus.cc:1240] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:22.820894  3305 leader_election.cc:336] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.920s (SENT)
W20260709 12:14:22.823956  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 47615.9us
I20260709 12:14:22.810938  6247 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.832351  6247 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:22.813238  6211 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:14:22.834635  6247 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:22.837412  6244 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:22.813609  6237 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:22.848578  3156 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:22.849511  3192 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:22.840443  6065 consensus_queue.cc:237] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:22.856732  5953 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:14:22.859704  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:22.866941  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:22.867780  6233 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.871853  6247 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:22.852993  6244 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:22.879336  6237 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:22.925648  3337 raft_consensus.cc:1240] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:22.929606  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 113086us
W20260709 12:14:22.938097  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.936146  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:22.949167  3232 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:22.951589  3305 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:22.959815  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 111381us
I20260709 12:14:22.976027  3156 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:22.976104  3232 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:22.976503  6084 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:22.993923  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.989073  3090 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34704 (request call id 181) took 10211 ms. Trace:
I20260709 12:14:22.997874  6206 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:23.004525  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.004392  6130 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:23.005834  6294 log.cc:927] Time spent T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:14:23.006711  6130 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:22.977239  5953 consensus_queue.cc:1059] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:14:22.981246  6084 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:23.014868  3157 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:22.969374  6116 consensus_queue.cc:1059] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:14:23.007350  6130 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:23.030507  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.033740  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 57810.8us
I20260709 12:14:23.012286  6084 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:23.041052  6233 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:23.046928  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 142079us
I20260709 12:14:23.047480  6244 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:23.048092  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:23.048843  6191 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:23.050256  3305 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:23.050439  6191 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:23.050896  6191 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:23.051290  6191 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:23.052481  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.053227  3190 raft_consensus.cc:2368] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6.
I20260709 12:14:23.053107  5869 consensus_queue.cc:1048] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:23.053895  6307 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:23.054739  5869 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.054894  3193 raft_consensus.cc:1240] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:23.055689  6302 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:23.055819  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.056139  6302 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.056560  6302 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:23.057150  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.057861  3186 raft_consensus.cc:2368] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:23.058907  3188 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:23.060086  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.060837  3189 raft_consensus.cc:2368] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 9. Current term is 10.
I20260709 12:14:23.017992  6300 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.021588  6130 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.043618  3185 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:22.996698  3090 rpcz_store.cc:276] 0709 12:14:12.736287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.736659 (+   372us) service_pool.cc:224] Handling call
0709 12:14:12.910008 (+173349us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b5400189f54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee537090 00007f1aee5d5f3a 00007f1af438be9c 00007f1af448a04e 00007f1af294b2a4 00007f1af294b232 00007f1af294b161 00007f1af294b0dc 00007f1af294a392 00007f1aec90848c 00007f1aec9078c6
0709 12:14:22.946205 (+10036197us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:21.200439 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:21.201029 (+   590us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:21.201073 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:14:21.201090 (+    17us) tablet.cc:662] Decoding operations
0709 12:14:21.202119 (+  1029us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:21.202173 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:21.202208 (+    35us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:14:21.203012 (+   804us) tablet.cc:701] Row locks acquired
0709 12:14:21.203026 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:14:21.203161 (+   135us) write_op.cc:270] Start()
0709 12:14:21.203282 (+   121us) write_op.cc:276] Timestamp: P: 1783599261203115 usec, L: 0
0709 12:14:21.203875 (+   593us) op_driver.cc:348] REPLICATION: starting
0709 12:14:21.204497 (+   622us) log.cc:844] Serialized 4016 byte log entry
0709 12:14:21.538740 (+334243us) op_driver.cc:464] REPLICATION: finished
0709 12:14:22.055555 (+516815us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aeb4c30ac 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1af2003ef0
0709 12:14:22.472172 (+416617us) write_op.cc:301] APPLY: starting
0709 12:14:22.479972 (+  7800us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:22.480278 (+   306us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:22.480316 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:22.551201 (+ 70885us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b1800191e00. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e0522 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
0709 12:14:22.582160 (+ 30959us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:22.613369 (+ 31209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:14:22.613440 (+    71us) write_op.cc:312] APPLY: finished
0709 12:14:22.613922 (+   482us) log.cc:844] Serialized 77 byte log entry
0709 12:14:22.771998 (+158076us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:22.784208 (+ 12210us) write_op.cc:454] Released schema lock
0709 12:14:22.784278 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:22.784756 (+   478us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:22.784784 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5466865,"reported_tablets":18,"spinlock_wait_cycles":137601792,"child_traces":[["op",{"apply.queue_time_us":907526,"apply.run_cpu_time_us":48408,"apply.run_wall_time_us":336063,"num_ops":10,"prepare.queue_time_us":352102,"prepare.run_cpu_time_us":14975,"prepare.run_wall_time_us":206657,"raft.queue_time_us":114682,"raft.run_cpu_time_us":41152,"raft.run_wall_time_us":934316,"replication_time_us":334689,"spinlock_wait_cycles":115286144,"thread_start_us":1623581,"threads_started":5,"wal-append.queue_time_us":212940,"wal-append.run_cpu_time_us":12809,"wal-append.run_wall_time_us":1066471}]]}
W20260709 12:14:23.090325  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 114337us
I20260709 12:14:23.099859  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.105904  6136 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:23.110797  6175 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.099736  6199 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:23.111418  6175 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:23.112017  6199 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:23.113754  6175 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:23.114131  6199 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:23.115916  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.116884  3188 raft_consensus.cc:2368] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 9. Current term is 10.
I20260709 12:14:23.117993  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.119975  3192 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:23.121448  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.122366  3193 raft_consensus.cc:2368] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6.
W20260709 12:14:23.123819  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.133869  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.135000  3190 raft_consensus.cc:2410] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:14:23.138218  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.139617  3189 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:23.145968  3191 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:23.147364  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.079800  6306 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:23.152328  6046 raft_consensus.cc:3055] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:23.152782  6046 raft_consensus.cc:740] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:23.153740  6046 consensus_queue.cc:260] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.156221  6211 raft_consensus.cc:3055] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:23.156646  6211 raft_consensus.cc:740] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:23.155076  3232 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:23.157735  6211 consensus_queue.cc:260] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.158352  6303 raft_consensus.cc:2749] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:23.159075  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.159807  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.160012  3925 raft_consensus.cc:1240] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:23.159878  3187 raft_consensus.cc:2393] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:23.161158  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.087302  6300 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.162261  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.155072  6046 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:23.162853  6192 consensus_queue.cc:1059] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:23.163460  6300 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:23.164162  3192 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:23.164281  6192 raft_consensus.cc:3055] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:23.164808  6192 raft_consensus.cc:740] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:23.165334  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.165756  6192 consensus_queue.cc:260] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.167073  6192 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:23.165992  3192 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:23.171020  3088 catalog_manager.cc:5697] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:23.171528  6191 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:23.173627  6191 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:23.162861  3187 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:23.169414  6130 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:23.189193  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 174378us
I20260709 12:14:23.164058  6304 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.203941  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.196013  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.194649  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:23.205158  3187 raft_consensus.cc:2410] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:23.209589  6130 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:23.219703  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.223222  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.223906  3185 raft_consensus.cc:2410] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:23.224382  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.226024  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.228449  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.230207  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.232738  3157 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:23.240777  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.241645  3185 raft_consensus.cc:2410] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:23.246078  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.246837  3188 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
W20260709 12:14:23.250526  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 236695us
I20260709 12:14:23.260174  3305 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:23.260707  3192 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:23.273855  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:23.293591  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.294451  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 67137.1us
I20260709 12:14:23.300242  3190 raft_consensus.cc:1240] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:23.308552  3191 raft_consensus.cc:1240] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:23.309144  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 62702us
I20260709 12:14:23.261696  6130 raft_consensus.cc:2764] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:23.305074  3185 raft_consensus.cc:1240] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:23.311993  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:23.313865  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.314292  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.309902  3088 catalog_manager.cc:5697] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 5 to 6, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 6 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
W20260709 12:14:23.311332  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.315652  3188 raft_consensus.cc:1240] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:23.317346  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 170178us
I20260709 12:14:23.321895  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:23.325680  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:23.326313  3261 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:23.328197  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.328732  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.329255  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.332618  3157 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:23.341037  3265 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:23.323989  6206 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:23.338711  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.345382  3191 raft_consensus.cc:2410] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:23.344010  3259 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:14:23.346153  3259 pending_rounds.cc:85] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 6
I20260709 12:14:23.346402  3259 pending_rounds.cc:107] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:14:23.346632  3259 raft_consensus.cc:2889] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:23.344131  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.312666  6302 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.360641  3190 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:23.353255  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.315176  6136 consensus_queue.cc:1059] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:14:23.366818  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:23.369665  3193 raft_consensus.cc:2368] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8.
I20260709 12:14:23.371069  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.372105  3190 raft_consensus.cc:2393] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:23.352761  3088 catalog_manager.cc:5697] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:23.375891  3191 raft_consensus.cc:1240] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:23.343592  6237 raft_consensus.cc:2804] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:23.352866  5953 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:23.391710  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 77837.4us
I20260709 12:14:23.380999  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:23.398577  3265 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:23.401043  6302 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:23.402034  3232 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:23.363677  5949 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.395740  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:23.404510  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:23.406260  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:23.409904  3231 leader_election.cc:336] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.537s (SENT)
W20260709 12:14:23.412199  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.411726  3261 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:23.414863  3262 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:23.404783  3088 catalog_manager.cc:5697] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:23.425316  3231 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:23.435609  3088 catalog_manager.cc:5697] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:23.436676  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 117038us
I20260709 12:14:23.392544  6191 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.413792  6134 raft_consensus.cc:3055] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:23.415594  5922 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:23.409586  6237 raft_consensus.cc:697] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:23.414604  6300 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:23.459226  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 54782.7us
I20260709 12:14:23.460824  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:23.461728  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:23.443321  6303 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:23.455890  3088 catalog_manager.cc:5697] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:23.465915  6318 log.cc:927] Time spent T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:14:23.466267  6305 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.467674  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.497249  3191 raft_consensus.cc:2393] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:14:23.470562  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 60744.5us
I20260709 12:14:23.471604  6307 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:23.472733  6311 log.cc:927] Time spent T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 12:14:23.473943  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 274851us
W20260709 12:14:23.488096  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.405344  6206 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:14:23.404989  5953 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.453751  6134 raft_consensus.cc:740] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:23.497083  3088 catalog_manager.cc:5697] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 4 to 8, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 8 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:23.515995  3184 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
W20260709 12:14:23.516633  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.538765  3192 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:23.457370  6247 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:23.517657  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.437206  5949 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:23.519394  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 117477us
W20260709 12:14:23.531301  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.534886  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.458250  6300 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:23.549158  6300 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:23.556398  3925 raft_consensus.cc:1275] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:14:23.556690  6313 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:14:23.537240  3088 catalog_manager.cc:5697] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 4, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 4 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
W20260709 12:14:23.555228  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.546605  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.560286  3184 raft_consensus.cc:2376] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8. Re-sending same reply.
I20260709 12:14:23.566337  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:23.567001  3924 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:23.463989  6191 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.569620  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:23.605232  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 56726.2us
I20260709 12:14:23.608367  5953 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:23.609038  6134 consensus_queue.cc:260] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:23.615566  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.619589  3932 raft_consensus.cc:2468] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:14:23.623168  3924 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:23.543188  6314 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.625725  3931 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEARNER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:14:23.632576  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.634908  6332 log.cc:927] Time spent T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:14:23.640197  6321 log.cc:927] Time spent T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:14:23.642204  6333 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.647969  5949 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:23.648291  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:23.648576  6237 consensus_queue.cc:237] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.649396  6191 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:23.652626  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.543733  6305 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:23.655169  6313 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:14:23.655624  6316 log.cc:927] Time spent T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:14:23.660305  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:23.660983  3932 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:23.661461  3931 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:23.661352  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.657991  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:23.662734  3184 raft_consensus.cc:2368] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8.
I20260709 12:14:23.662863  3306 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:23.664364  6334 raft_consensus.cc:2804] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:23.664760  6084 consensus_meta.cc:287] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.006s
I20260709 12:14:23.664987  6334 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.665233  6084 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.665555  6334 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:23.668489  3189 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:23.669548  3339 raft_consensus.cc:1240] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:23.667300  3157 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:23.672655  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.673396  3185 raft_consensus.cc:2368] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 9. Current term is 10.
I20260709 12:14:23.674170  3262 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
W20260709 12:14:23.665161  5869 consensus_meta.cc:287] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.001s
I20260709 12:14:23.677637  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:23.678898  3932 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:23.681597  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:23.682278  3931 raft_consensus.cc:1240] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:14:23.686919  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.688398  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.689117  3186 raft_consensus.cc:2368] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 9. Current term is 10.
I20260709 12:14:23.689270  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.673274  6307 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:23.693185  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.693892  3185 raft_consensus.cc:2410] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:14:23.690623  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.703800  3262 raft_consensus.cc:1240] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:14:23.708652  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.683393  6244 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:23.682312  5869 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:23.675482  6339 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:23.670403  6233 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:14:23.660343  6114 consensus_queue.cc:1048] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:14:23.747025  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.720918  6084 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:23.722126  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:23.729678  6303 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:23.755098  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.670545  6333 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.712926  3261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f"
dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:40120
I20260709 12:14:23.733896  6300 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.660104  6314 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:23.735110  6304 consensus_meta.cc:287] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.516s	user 0.000s	sys 0.010s
I20260709 12:14:23.735548  6244 raft_consensus.cc:697] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:23.735952  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.736996  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.765027  3186 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:23.748063  6339 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.740463  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.741165  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.769933  3193 raft_consensus.cc:2410] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:14:23.719640  6319 log.cc:927] Time spent T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 12:14:23.764173  3232 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:23.774439  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.775638  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:23.776185  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.748510  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 81298.5us
W20260709 12:14:23.751892  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 71609.7us
I20260709 12:14:23.757330  3337 raft_consensus.cc:1240] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:23.758394  3261 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:23.739781  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.777657  3261 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.779448  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.782104  3187 raft_consensus.cc:2368] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:23.787701  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.764899  6304 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:23.789868  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.784478  6307 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:23.792833  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.793642  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.794744  3184 raft_consensus.cc:2410] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:23.772938  6339 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:23.792491  6307 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.799151  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.800989  3187 raft_consensus.cc:2393] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:23.801244  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.799234  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.804917  6307 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:23.807798  6065 raft_consensus.cc:3055] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:23.808177  6065 raft_consensus.cc:740] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:23.812387  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.813052  3193 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
W20260709 12:14:23.814396  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.817294  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 464979us
W20260709 12:14:23.820019  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.845681  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.846760  3186 raft_consensus.cc:2410] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:23.848812  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.785458  6206 consensus_queue.cc:1059] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:14:23.856225  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:23.863265  6331 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:23.865727  3188 raft_consensus.cc:1240] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:23.867937  6341 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:23.869016  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.868773  6244 consensus_queue.cc:237] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.790553  6315 consensus_queue.cc:1059] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:14:23.870011  6315 raft_consensus.cc:3055] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:23.870343  6315 raft_consensus.cc:740] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:23.886291  3261 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.887225  3259 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:23.889909  3261 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:23.896353  6333 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:23.900277  3186 raft_consensus.cc:1240] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:23.901538  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.902015  3190 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:23.902643  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.902987  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:23.871202  6315 consensus_queue.cc:260] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.894747  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.905068  3265 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
W20260709 12:14:23.905139  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 54460.1us
I20260709 12:14:23.884922  6046 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.891090  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:23.912295  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:23.921568  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.936384  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.913763  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:23.906159  6192 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.954226  6331 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.956678  6331 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:23.956848  6333 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:24.160673  6333 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:23.963253  3186 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:24.160744  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40510 (request call id 1944) took 1003 ms. Trace:
W20260709 12:14:24.007571  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.116218  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.165385  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.109508  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.168185  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 259216us
I20260709 12:14:23.961954  3185 raft_consensus.cc:2376] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6. Re-sending same reply.
I20260709 12:14:23.998782  3924 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:24.025156  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.171491  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 265254us
W20260709 12:14:24.171859  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.110034  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.164288  3192 rpcz_store.cc:276] 0709 12:14:23.157454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.289407 (+131953us) service_pool.cc:224] Handling call
0709 12:14:23.538451 (+249044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:23.539100 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.160537 (+621437us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54003c6ed0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:24.160683 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532673920}
I20260709 12:14:24.173870  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:24.163851  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:24.188462  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:24.195039  3925 raft_consensus.cc:1240] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:24.196823  3189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40510 (request call id 1939) took 1023 ms. Trace:
I20260709 12:14:24.197399  3189 rpcz_store.cc:276] 0709 12:14:23.154566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.159574 (+  5008us) service_pool.cc:224] Handling call
0709 12:14:24.033199 (+873625us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54001b12d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:24.178342 (+145143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488435456}
I20260709 12:14:24.163268  6211 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:24.204444  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:24.205034  3930 raft_consensus.cc:3055] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:24.206329  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:24.209839  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:23.943698  6046 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.214036  3305 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:24.205303  3930 raft_consensus.cc:740] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:24.215797  3930 consensus_queue.cc:260] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.217115  3930 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:24.217500  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 44550.1us
W20260709 12:14:24.216827  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.217741  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.221693  3192 raft_consensus.cc:2393] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:24.223912  3189 raft_consensus.cc:1240] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:24.218868  3895 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:24.230486  3334 raft_consensus.cc:1240] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:24.046687  6314 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:24.232302  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.273546  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.967981  6192 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.276966  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:24.277581  3339 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:24.278347  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:24.201890  6339 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.290956  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:24.292186  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.292210  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.229990  5869 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:24.296600  3925 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:24.224701  5949 consensus_queue.cc:1059] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:14:24.284818  6084 raft_consensus.cc:2804] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:24.288106  6345 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:24.225366  6307 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.283727  6114 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:24.287138  6130 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:24.354362  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 128283us
I20260709 12:14:24.356205  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:24.361805  3232 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:24.362502  6046 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:24.362383  6314 consensus_queue.cc:1059] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:24.364534  6192 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:24.310700  6324 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:24.368240  3231 leader_election.cc:336] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.566s (SENT)
I20260709 12:14:24.370097  6306 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:24.388664  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.353822  6334 consensus_meta.cc:287] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.674s	user 0.003s	sys 0.009s
I20260709 12:14:24.304497  6323 consensus_queue.cc:1059] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:14:24.411567  6192 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.355782  6345 raft_consensus.cc:697] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:24.304090  5869 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:24.370481  6339 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:24.419610  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 221158us
I20260709 12:14:24.420172  3333 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:24.420234  3231 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:24.379026  6303 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:24.427532  3188 consensus_meta.cc:287] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.000s
W20260709 12:14:24.432761  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.432981  3188 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:24.433760  3192 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:24.429309  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:24.364933  6351 raft_consensus.cc:2804] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:24.435384  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:24.442271  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.369367  6352 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:24.505633  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:24.485488  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.508983  6353 log.cc:927] Time spent T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 12:14:24.514214  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 141888us
I20260709 12:14:24.425549  6084 raft_consensus.cc:697] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:24.519802  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.407997  6130 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:24.441987  6303 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.525190  3188 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:24.535768  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.451223  6237 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:24.536374  3188 raft_consensus.cc:2376] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6. Re-sending same reply.
I20260709 12:14:24.537449  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.465070  6339 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.419659  6306 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.420895  6334 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.515688  6206 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:24.546068  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:24.549134  6358 raft_consensus.cc:3055] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:24.549461  6323 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:24.534904  6303 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:24.550042  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.554198  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:24.556187  6357 log.cc:927] Time spent T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
W20260709 12:14:24.557449  6354 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:14:24.561005  3263 raft_consensus.cc:1275] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:14:24.563309  6355 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
W20260709 12:14:24.567179  6346 log.cc:927] Time spent T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:14:24.571408  3188 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.441339  6192 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:24.573386  6345 consensus_queue.cc:237] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:24.606204  6046 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:24.607475  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.608596  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.609145  3191 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:24.609956  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.610744  6192 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:24.610994  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.576442  6306 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:24.546777  6237 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.521601  6351 raft_consensus.cc:697] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:24.465787  6352 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:24.615134  6134 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.615751  6351 consensus_queue.cc:237] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.616793  6352 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:24.541783  6359 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:14:24.620467  6136 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.620997  6136 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:24.623126  6136 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:24.586784  3184 raft_consensus.cc:2368] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 3. Current term is 4.
I20260709 12:14:24.594111  6065 consensus_queue.cc:260] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.594866  6197 consensus_queue.cc:1059] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:24.586416  6323 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.599346  6302 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:24.600416  6300 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:24.604087  6307 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:24.605660  5869 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:24.623991  6130 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:24.624679  3187 raft_consensus.cc:1240] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:24.624814  6331 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:24.626951  3186 raft_consensus.cc:1240] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:24.693362  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.614770  6237 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:24.631349  3930 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:24.570569  3193 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:24.635051  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:24.694860  3185 raft_consensus.cc:2376] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7. Re-sending same reply.
I20260709 12:14:24.606151  3188 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:24.696427  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.581923  6358 raft_consensus.cc:740] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:24.642843  3341 raft_consensus.cc:1240] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:24.648641  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.583876  6333 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:24.703083  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 334839us
I20260709 12:14:24.702960  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:24.649554  3264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1629) took 1064 ms. Trace:
I20260709 12:14:24.705895  3192 raft_consensus.cc:2376] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5. Re-sending same reply.
I20260709 12:14:24.683141  3191 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:14:24.580003  6084 consensus_queue.cc:237] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.546319  6339 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:24.705292  3231 leader_election.cc:336] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.567s (SENT)
I20260709 12:14:24.636339  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:24.586659  6206 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:24.712635  3337 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
I20260709 12:14:24.712302  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:24.716399  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.717543  3186 raft_consensus.cc:2410] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:24.718561  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.698019  6191 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.721454  3896 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:24.725958  3186 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:24.703392  6065 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:24.706380  3264 rpcz_store.cc:276] 0709 12:14:23.342926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.365739 (+ 22813us) service_pool.cc:224] Handling call
0709 12:14:23.366148 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.366549 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.366585 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.367028 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.379756 (+1012728us) spinlock_profiling.cc:243] Waited 8.62 ms on lock 0x7b180035f7a0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aee1754bc 00007f1aeb4c348b 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1aee16720b 00007f1aee16cd23 00007f1aee16d0d1
0709 12:14:24.404011 (+ 24255us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:24.404047 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.404113 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.404154 (+    41us) raft_consensus.cc:1685] finished
0709 12:14:24.404164 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.407526 (+  3362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13346,"raft.queue_time_us":24577,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":28194,"spinlock_wait_cycles":19831680,"thread_start_us":63525,"threads_started":1,"wal-append.queue_time_us":91510,"wal-append.run_cpu_time_us":2832,"wal-append.run_wall_time_us":1205241}
W20260709 12:14:24.732838  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.735656  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.736518  3186 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:24.738051  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.739107  3186 raft_consensus.cc:2410] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:24.713434  6324 raft_consensus.cc:697] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
W20260709 12:14:24.741156  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 190565us
I20260709 12:14:24.747033  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:14:24.748660  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.750022  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 598) took 1012 ms. Trace:
I20260709 12:14:24.758090  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:24.750416  3262 rpcz_store.cc:276] 0709 12:14:23.737630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.748375 (+ 10745us) service_pool.cc:224] Handling call
0709 12:14:23.764215 (+ 15840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.786102 (+ 21887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.786131 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.796217 (+ 10086us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.208068 (+411851us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:24.208127 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.208221 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.749722 (+541501us) raft_consensus.cc:1685] finished
0709 12:14:24.749746 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.749920 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17216,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":7827,"thread_start_us":335855,"threads_started":1,"wal-append.queue_time_us":451792}
I20260709 12:14:24.756433  3232 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:24.766966  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.767871  3189 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
W20260709 12:14:24.770283  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 65054.4us
I20260709 12:14:24.773437  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:24.744560  6367 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:24.771036  3231 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.595s (SENT)
I20260709 12:14:24.747766  6114 raft_consensus.cc:697] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:24.753175  5997 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:24.750368  6333 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.778254  3231 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:24.734717  6191 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:24.785934  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:24.789541  3931 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:24.784221  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:24.785049  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:24.791532  3932 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:24.751159  5953 consensus_queue.cc:1059] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:14:24.811255  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.809070  5949 raft_consensus.cc:3055] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:24.814234  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.809653  6369 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:24.816433  3930 raft_consensus.cc:1240] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:24.821897  3189 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:24.822990  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:24.826664  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 95250us
I20260709 12:14:24.786755  5997 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.776934  6368 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:24.814090  5949 raft_consensus.cc:740] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
W20260709 12:14:24.832196  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 61196.9us
W20260709 12:14:24.834021  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.857316  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:24.892025  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:24.782018  6367 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:24.777407  6358 consensus_queue.cc:260] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:24.945785  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.909276  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:24.823290  6334 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:24.877851  3187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40510 (request call id 1975) took 1140 ms. Trace:
W20260709 12:14:24.879650  3895 leader_election.cc:336] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.957s (SENT)
I20260709 12:14:24.880396  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:24.881374  5949 consensus_queue.cc:260] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.954546  3187 rpcz_store.cc:276] 0709 12:14:23.737613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.813509 (+ 75896us) service_pool.cc:224] Handling call
0709 12:14:24.624489 (+810980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.703701 (+ 79212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.877527 (+173826us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54002ee350. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:24.877734 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864279808}
I20260709 12:14:24.812000  6130 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:14:24.813230  6324 consensus_queue.cc:237] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.774092  6244 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:14:24.793808  6375 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:24.829118  6136 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:24.807819  6333 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.834451  5997 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:24.858589  6114 consensus_queue.cc:237] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:24.891289  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.982659  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:24.893074  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:24.895820  3262 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:24.899001  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:24.899895  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.913221  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:24.894912  3231 leader_election.cc:336] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.686s (SENT)
I20260709 12:14:24.887415  3189 raft_consensus.cc:1275] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:24.984813  3188 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
W20260709 12:14:24.914705  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 135898us
I20260709 12:14:24.910305  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:24.888034  6156 raft_consensus.cc:3055] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:24.890209  6315 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.889195  6206 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:24.897228  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:24.897739  6199 raft_consensus.cc:3055] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:24.902580  6369 consensus_queue.cc:765] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Error trying to read ahead of the log while preparing peer request: Incomplete: Op with index 7 is ahead of the local log (next sequential op: 7). Destination peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.566s
I20260709 12:14:24.904614  6368 raft_consensus.cc:697] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:24.906288  6305 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:25.025158  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:25.007583  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.815634  6247 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:24.947945  3931 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:25.029206  3187 raft_consensus.cc:1240] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:24.954900  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.030072  3259 raft_consensus.cc:1240] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:24.976632  6375 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.001106  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:24.955437  3193 raft_consensus.cc:2376] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6. Re-sending same reply.
W20260709 12:14:24.954551  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 62643.1us
W20260709 12:14:24.957604  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.883373  6211 consensus_meta.cc:287] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.000s
I20260709 12:14:24.960165  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:24.962584  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:24.970227  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:24.885851  6323 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:25.034420  3306 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:24.908739  6360 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.977531  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:24.883973  6339 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:24.884917  6191 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:24.983314  3268 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
I20260709 12:14:24.993686  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:24.994189  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:25.046715  3341 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
W20260709 12:14:25.025818  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 130966us
W20260709 12:14:25.019462  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.996544  3264 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:25.026819  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:25.048101  3231 leader_election.cc:336] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.733s (SENT)
I20260709 12:14:25.048417  3260 raft_consensus.cc:2376] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8. Re-sending same reply.
W20260709 12:14:25.027138  3088 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48786 (request call id 304) took 12637 ms (client timeout 15000 ms). Trace:
I20260709 12:14:24.893855  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:25.032898  3925 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:24.996631  6156 raft_consensus.cc:740] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:25.025528  5949 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.041631  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:25.042853  3261 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:14:25.025679  6199 raft_consensus.cc:740] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:25.048775  3157 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:25.029790  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:25.034126  3192 raft_consensus.cc:1240] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:25.035742  6375 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.045822  6175 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:25.049234  3088 rpcz_store.cc:269] 0709 12:14:12.390159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.390456 (+   297us) service_pool.cc:224] Handling call
0709 12:14:25.027070 (+12636614us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:23.808520 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:23.809198 (+   678us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:23.809244 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:14:23.809272 (+    28us) tablet.cc:662] Decoding operations
0709 12:14:23.810213 (+   941us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:23.810319 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:23.810350 (+    31us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:14:23.811103 (+   753us) tablet.cc:701] Row locks acquired
0709 12:14:23.811150 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:14:23.811374 (+   224us) write_op.cc:270] Start()
0709 12:14:23.872889 (+ 61515us) write_op.cc:276] Timestamp: P: 1783599263811247 usec, L: 0
0709 12:14:23.876771 (+  3882us) op_driver.cc:348] REPLICATION: starting
0709 12:14:23.984771 (+108000us) log.cc:844] Serialized 3234 byte log entry
0709 12:14:24.572609 (+587838us) op_driver.cc:464] REPLICATION: finished
0709 12:14:24.839240 (+266631us) write_op.cc:301] APPLY: starting
0709 12:14:24.884930 (+ 45690us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:24.886819 (+  1889us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:24.887736 (+   917us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:24.895796 (+  8060us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:24.897328 (+  1532us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:14:24.897766 (+   438us) write_op.cc:312] APPLY: finished
0709 12:14:24.899666 (+  1900us) log.cc:844] Serialized 65 byte log entry
0709 12:14:24.900979 (+  1313us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:24.902348 (+  1369us) write_op.cc:454] Released schema lock
0709 12:14:24.902700 (+   352us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:24.905777 (+  3077us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:24.905805 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":670132,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":259192,"apply.run_cpu_time_us":14639,"apply.run_wall_time_us":71181,"num_ops":8,"prepare.queue_time_us":149057,"prepare.run_cpu_time_us":4829,"prepare.run_wall_time_us":185975,"replication_time_us":695639,"thread_start_us":266470,"threads_started":2}]]}
I20260709 12:14:25.042834  6366 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:25.059662  6323 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:24.979990  6303 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:24.985589  6136 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.088764  6373 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:25.097069  6156 consensus_queue.cc:260] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.097937  6373 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.098459  6373 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.098850  6156 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:25.099557  3926 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:14:25.100257  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.100504  6374 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:25.100992  6374 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:25.101346  6303 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:25.101449  6374 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.104574  3305 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:25.104714  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 56642.6us
W20260709 12:14:25.105931  3231 leader_election.cc:336] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.771s (SENT)
I20260709 12:14:25.106397  3231 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:24.996856  6345 consensus_queue.cc:1059] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 12:14:25.107707  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 228090us
I20260709 12:14:25.097146  3087 catalog_manager.cc:5697] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:25.050249  6360 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.119864  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:25.120724  3926 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.087239  6175 raft_consensus.cc:697] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:25.124205  6175 consensus_queue.cc:237] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.103351  6136 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:25.107789  6351 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:25.156831  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 50930us
W20260709 12:14:25.158529  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 49945.4us
I20260709 12:14:25.088076  6366 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:25.161388  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.146621  6303 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:14:25.163964  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:25.165561  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.103973  6199 consensus_queue.cc:260] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:25.170334  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 121647us
I20260709 12:14:25.151183  6333 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:25.196962  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 111575us
I20260709 12:14:25.158885  6211 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:25.163288  6302 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:25.167982  6116 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.170686  6134 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.196362  6367 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:25.144542  6368 consensus_queue.cc:237] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.207363  3926 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:25.257264  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:25.258620  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:25.351023  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 78643.9us
W20260709 12:14:25.229017  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:25.216684  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.269531  3334 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:25.355538  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:25.208413  6378 log.cc:927] Time spent T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:14:25.240236  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:25.260314  3190 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:25.272544  3232 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:14:25.363634  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:25.383394  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 143255us
I20260709 12:14:25.366398  6376 consensus_queue.cc:1059] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:14:25.366874  6388 log.cc:927] Time spent T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:14:25.362044  6382 log.cc:927] Time spent T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.145s	user 0.005s	sys 0.000s
I20260709 12:14:25.368404  5949 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:25.363700  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40120 (request call id 605) took 1479 ms. Trace:
I20260709 12:14:25.270555  6331 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:25.385386  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.247260  6366 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:25.402779  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.398113  3261 rpcz_store.cc:276] 0709 12:14:23.884551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.890906 (+  6355us) service_pool.cc:224] Handling call
0709 12:14:25.363491 (+1472585us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001941d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:25.363636 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2607271808}
I20260709 12:14:25.399673  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:25.384209  6136 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.384651  6065 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:25.218878  6302 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:25.386622  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 114180us
I20260709 12:14:25.208019  6199 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.248808  6192 raft_consensus.cc:3055] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:25.216735  6211 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:25.356706  6367 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:14:25.372180  6392 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 12:14:25.394481  6114 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:25.220902  6134 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.219684  6116 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:25.448362  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.227314  5997 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.394471  6303 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:25.386404  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 221875us
W20260709 12:14:25.475296  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 91226.2us
I20260709 12:14:25.433127  6206 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:25.479215  6211 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:25.453681  6192 raft_consensus.cc:740] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:25.479944  6373 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:25.482506  6302 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:25.451368  6136 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.399636  6374 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:25.493592  3231 leader_election.cc:336] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.847s (SENT)
W20260709 12:14:25.512642  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.522390  3305 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:25.487543  6364 log.cc:927] Time spent T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:14:25.454506  6305 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:25.527791  3231 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:25.489346  6333 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:25.474637  6065 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.433853  6331 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.534333  6351 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:25.546957  6302 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:25.535079  3185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1769) took 1178 ms. Trace:
I20260709 12:14:25.547711  3926 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:25.490294  6114 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:25.550195  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 56991.8us
I20260709 12:14:25.555697  3305 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:25.547940  3185 rpcz_store.cc:276] 0709 12:14:24.356578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.880608 (+524030us) service_pool.cc:224] Handling call
0709 12:14:24.880970 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.881397 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.881425 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.881907 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:14:25.067319 (+185412us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:25.067382 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.067507 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.361230 (+293723us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:25.530694 (+169464us) raft_consensus.cc:1685] finished
0709 12:14:25.530723 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.535000 (+  4277us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1576,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":2331392,"thread_start_us":184861,"threads_started":1,"wal-append.queue_time_us":270183}
I20260709 12:14:25.536564  6333 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.529656  6303 raft_consensus.cc:697] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:25.504185  6315 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:25.585899  6191 consensus_queue.cc:1048] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:25.586412  6303 consensus_queue.cc:237] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:25.587934  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:25.590463  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 96884.3us
I20260709 12:14:25.524737  6206 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.595866  3929 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:25.560534  6114 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:25.591418  3231 leader_election.cc:336] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.860s (SENT)
I20260709 12:14:25.597265  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:25.576550  6366 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:25.607590  3188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1775) took 1018 ms. Trace:
I20260709 12:14:25.609870  3305 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:25.534564  6192 consensus_queue.cc:260] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:25.604907  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.584749  6333 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:25.605720  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.608233  3188 rpcz_store.cc:276] 0709 12:14:24.589259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.996403 (+407144us) service_pool.cc:224] Handling call
0709 12:14:24.996691 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.996891 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:25.135422 (+138531us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.607035 (+471613us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.607113 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:25.607210 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.607292 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.607505 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64256,"prepare.queue_time_us":108399,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":6518,"raft.queue_time_us":33867,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":9005,"thread_start_us":511183,"threads_started":3,"wal-append.queue_time_us":442328}
W20260709 12:14:25.623814  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:25.628614  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.557168  6065 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.561190  6305 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:25.633893  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.607702  6366 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:25.617048  6084 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:25.644404  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:25.645215  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:25.647234  3926 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
W20260709 12:14:25.650573  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 251122us
W20260709 12:14:25.653663  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.659468  3929 raft_consensus.cc:2368] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7.
I20260709 12:14:25.600634  6315 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.622812  6323 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:25.635799  6175 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:25.691282  6175 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:25.691871  6175 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.694564  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:25.700915  6136 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:25.701186  6305 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:25.671833  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.701648  6175 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:25.702284  6394 log.cc:927] Time spent T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:14:25.673076  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.641435  6302 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.624738  6339 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:14:25.680039  3157 leader_election.cc:400] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7.
I20260709 12:14:25.703174  3157 leader_election.cc:403] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:14:25.684401  6383 log.cc:927] Time spent T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.465s	user 0.003s	sys 0.000s
I20260709 12:14:25.703794  6134 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:25.659435  6331 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:25.704804  6401 log.cc:927] Time spent T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:14:25.704799  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1770) took 1348 ms. Trace:
I20260709 12:14:25.638191  6192 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:25.705389  3191 rpcz_store.cc:276] 0709 12:14:24.356846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.881319 (+524473us) service_pool.cc:224] Handling call
0709 12:14:24.881605 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.881917 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.881939 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.882378 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:14:25.062843 (+180465us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:25.062885 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.062964 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.683591 (+620627us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:25.704497 (+ 20906us) raft_consensus.cc:1685] finished
0709 12:14:25.704530 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.704736 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1215,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":57,"spinlock_wait_cycles":4875648,"thread_start_us":180075,"threads_started":1,"wal-append.queue_time_us":276180}
I20260709 12:14:25.689102  5997 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:25.691207  6323 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.712051  6323 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:25.677299  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 311864us
I20260709 12:14:25.713075  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:25.713201  3895 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:25.681566  6358 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:25.716104  6402 log.cc:927] Time spent T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:14:25.716473  3895 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:25.718034  3895 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:25.720357  6175 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:25.722148  6197 raft_consensus.cc:3055] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:25.722533  6197 raft_consensus.cc:740] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:25.724396  6114 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:25.725080  6065 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:25.728781  3334 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:25.729173  3895 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:25.730151  6379 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:25.730365  3895 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:25.731673  6379 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:25.731717  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 55603.7us
I20260709 12:14:25.732157  6379 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.732555  6379 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:25.735960  6116 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:25.620908  6191 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:14:25.645833  6366 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:25.745611  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:25.754612  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 144848us
I20260709 12:14:25.761227  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:25.754909  3895 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:25.773126  3339 raft_consensus.cc:1240] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:25.773794  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 94088.9us
I20260709 12:14:25.761924  3338 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
W20260709 12:14:25.779990  3190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47276 (request call id 427) took 1855 ms (client timeout 1593 ms). Trace:
W20260709 12:14:25.780624  3190 rpcz_store.cc:269] 0709 12:14:23.902684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.192919 (+290235us) service_pool.cc:224] Handling call
0709 12:14:25.757504 (+1564585us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54002350d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:25.757648 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2185406848}
I20260709 12:14:25.788226  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1779) took 1067 ms. Trace:
I20260709 12:14:25.788812  3193 rpcz_store.cc:276] 0709 12:14:24.720959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.042431 (+321472us) service_pool.cc:224] Handling call
0709 12:14:25.059126 (+ 16695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.059322 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:25.394624 (+335302us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.787794 (+393170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.787877 (+    83us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:25.787952 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.788043 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.788170 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22969,"prepare.queue_time_us":87571,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"thread_start_us":689322,"threads_started":2}
W20260709 12:14:25.792366  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.794695  3336 raft_consensus.cc:1240] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:25.760450  6324 raft_consensus.cc:2764] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:14:25.802052  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:25.803440  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:25.748369  6302 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:25.807890  6116 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:25.809859  6302 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:25.794189  6334 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.811523  6334 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:25.813656  6334 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:25.814777  6404 log.cc:927] Time spent T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:14:25.791632  6136 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:25.815547  6136 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:25.817677  6136 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:25.787521  6244 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:14:25.823926  6405 log.cc:927] Time spent T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:14:25.826339  6114 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:25.793594  6374 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:25.827732  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:25.828378  3932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:14:25.829077  3932 raft_consensus.cc:606] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:25.829521  6379 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.828409  3929 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
W20260709 12:14:25.834635  6375 consensus_meta.cc:287] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.750s	user 0.008s	sys 0.000s
I20260709 12:14:25.749984  6197 consensus_queue.cc:260] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.814815  3334 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 11.
I20260709 12:14:25.843257  3333 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:25.802778  3925 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
W20260709 12:14:25.848176  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 93329.1us
W20260709 12:14:25.849435  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 60963.3us
I20260709 12:14:25.851935  3929 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:14:25.852572  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 95472.2us
I20260709 12:14:25.751353  6305 consensus_queue.cc:1059] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 12:14:25.860553  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 58604.4us
I20260709 12:14:25.857421  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:25.836004  6373 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:25.864075  3932 raft_consensus.cc:2393] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:25.878320  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:25.879194  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:25.854467  5997 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:25.835155  6375 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.884596  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:25.885367  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:25.886114  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:25.888163  3261 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:25.890245  6365 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.857777  6116 raft_consensus.cc:697] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:25.899883  6116 consensus_queue.cc:237] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.900558  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:25.901059  3267 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:25.901957  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:25.902585  3193 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:25.857728  6376 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:25.903746  6206 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:25.867722  6415 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.904692  6415 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.905829  6323 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:25.890959  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:25.907822  3266 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:25.907567  6365 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.880757  6379 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:25.894600  6305 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:14:25.914688  6192 consensus_queue.cc:1048] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:25.915665  3268 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:25.863103  6114 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:14:25.919184  6375 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:25.894083  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:25.920189  3191 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:25.871697  6359 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:14:25.921417  3231 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:25.898281  6315 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:25.922333  6315 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:25.893886  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:25.922796  3231 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:25.923228  6366 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:25.925367  6366 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:25.907188  6415 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:25.894870  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:25.928562  3187 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
W20260709 12:14:25.929575  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.923247  3188 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:25.931293  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:25.932009  3232 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 2.133s (SENT)
I20260709 12:14:25.932073  3896 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:25.932663  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:25.934156  3341 raft_consensus.cc:1240] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:25.934173  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:25.934919  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:25.936612  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:25.937361  3334 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.947414  3333 raft_consensus.cc:2393] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:25.864348  6136 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:25.951339  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:25.951660  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 55080.6us
I20260709 12:14:25.952134  3339 raft_consensus.cc:2393] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:25.952312  3895 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:25.873672  6247 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.873327  6410 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.961232  3339 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:25.962175  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:25.967190  3335 raft_consensus.cc:2410] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:25.958967  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:25.957021  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:25.930099  6244 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7.
I20260709 12:14:25.970046  3333 raft_consensus.cc:2410] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:14:25.973215  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 50493.9us
W20260709 12:14:25.975540  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.971060  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:25.986270  3231 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:25.987493  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:25.956174  6368 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:25.890971  6345 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:14:25.989533  3231 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:25.994807  3335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:46076
W20260709 12:14:25.994971  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 62980.4us
I20260709 12:14:25.995415  3335 raft_consensus.cc:606] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:25.995867  3335 raft_consensus.cc:614] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:26.002337  3334 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:26.005970  3188 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:26.003762  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:25.986176  6406 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:26.026449  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:26.028122  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:26.029614  3266 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 11.
I20260709 12:14:26.035246  3929 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:26.007582  6368 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:25.962211  6136 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:26.037484  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:26.014567  6365 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:25.971994  6134 consensus_queue.cc:1059] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 12:14:26.043457  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 53978.8us
I20260709 12:14:26.049995  3231 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:25.971652  6247 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:26.053133  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:26.030082  6315 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:25.985574  6410 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:26.044409  6368 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.055183  6408 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:26.045256  6406 raft_consensus.cc:697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:26.067891  6305 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:26.068828  3231 leader_election.cc:400] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
W20260709 12:14:26.069453  6399 log.cc:927] Time spent T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.596s	user 0.000s	sys 0.005s
I20260709 12:14:26.073433  6333 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:26.056232  6136 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:26.081518  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:26.083254  3190 raft_consensus.cc:2393] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:14:26.083889  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 131641us
I20260709 12:14:26.085160  3925 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:26.089776  3306 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:26.092303  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:26.079593  6368 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:26.068871  6175 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:14:26.096575  6345 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:26.097096  3231 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:26.098804  6303 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:26.099637  6360 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:26.097220  6345 raft_consensus.cc:697] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:26.104688  3231 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:26.109148  6368 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:26.108953  6406 consensus_queue.cc:237] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:26.119442  3192 raft_consensus.cc:1240] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:26.116681  3337 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:26.120709  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:26.121419  3191 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.124790  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:26.125893  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:26.129215  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:26.130069  3188 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:14:26.089610  6408 raft_consensus.cc:697] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:26.110594  6345 consensus_queue.cc:237] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:26.155191  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:26.131108  3187 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:26.135109  3188 raft_consensus.cc:1240] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:26.155411  3232 leader_election.cc:336] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.919s (SENT)
I20260709 12:14:26.157120  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:26.166234  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 61633.4us
W20260709 12:14:26.168071  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 61975.8us
W20260709 12:14:26.171591  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 65054us
I20260709 12:14:26.172019  3191 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:26.167490  3186 raft_consensus.cc:1240] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:26.175981  3231 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:26.178431  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:26.189481  3191 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 9: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:26.132085  6315 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:26.197137  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:26.207592  6197 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:26.218181  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 46318.4us
I20260709 12:14:26.219316  3895 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:26.220191  3895 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:26.220825  6156 raft_consensus.cc:2804] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:26.221231  6134 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:26.221798  6134 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.221288  6156 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:26.222325  3895 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:26.222571  6156 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.223639  6375 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:26.224241  6375 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:26.224713  6375 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.222133  6134 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.219892  6360 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:26.223726  6211 raft_consensus.cc:3055] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:26.254248  3895 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:26.274351  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 50829.1us
I20260709 12:14:26.277107  3191 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:26.269639  3305 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:26.201696  6199 consensus_meta.cc:287] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.746s	user 0.012s	sys 0.000s
I20260709 12:14:26.275796  3895 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:26.294924  3305 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:26.272650  6211 raft_consensus.cc:740] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:26.290643  5997 raft_consensus.cc:2804] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:26.310647  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:26.311647  3193 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:26.296485  6406 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:26.314453  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:26.308416  6084 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:26.321300  3193 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:26.310947  5997 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:26.374631  5997 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:26.292872  6333 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:26.300029  6315 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:26.296087  6199 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:26.361583  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 43674.8us
I20260709 12:14:26.372102  6339 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:26.372908  6410 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:26.373607  6134 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:26.379025  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.380657  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:26.280691  6408 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:26.456303  3193 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:14:26.457579  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 302124us
I20260709 12:14:26.463517  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:26.464335  3268 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:26.466405  3232 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:26.378975  6406 raft_consensus.cc:697] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:26.469158  3929 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:26.471350  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:26.472024  3266 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.450099  6339 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.473829  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:26.477643  3260 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
W20260709 12:14:26.481441  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 305551us
I20260709 12:14:26.482465  3231 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:26.483718  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:26.487509  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.493817  3232 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:26.505909  3268 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:26.486259  6339 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.510936  3231 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:26.511839  6440 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:26.515420  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:26.516673  3337 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:26.516772  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:26.515735  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:26.516021  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:26.512260  6368 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:26.515278  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:26.521759  3928 raft_consensus.cc:2393] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:26.520016  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:26.520022  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 225189us
I20260709 12:14:26.520473  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:26.522710  3932 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:26.524861  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:26.525807  3335 raft_consensus.cc:2393] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:26.523667  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:26.452872  6211 consensus_queue.cc:260] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:26.528509  3305 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:26.529111  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:26.530258  3339 raft_consensus.cc:2410] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:26.496829  6438 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:26.531699  3157 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:26.502666  6315 consensus_queue.cc:1059] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:14:26.571950  3337 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:26.538904  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:26.591215  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 59600us
I20260709 12:14:26.594532  3266 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:26.534833  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:26.595201  3928 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.561900  6374 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:14:26.580775  6409 log.cc:927] Time spent T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.677s	user 0.006s	sys 0.014s
I20260709 12:14:26.583864  6438 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:26.592427  6315 raft_consensus.cc:3055] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:26.579885  6134 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:26.596693  6333 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:26.596015  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:26.578573  6410 raft_consensus.cc:2804] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:26.578351  6192 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:26.588078  6440 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.582988  6419 consensus_queue.cc:1059] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:14:26.625118  6156 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:26.636216  6437 log.cc:927] Time spent T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:14:26.565327  6084 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:14:26.532123  6199 consensus_queue.cc:1059] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:14:26.598469  6315 raft_consensus.cc:740] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:14:26.656872  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 293608us
I20260709 12:14:26.598414  6368 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.611645  6333 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.665531  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:26.613550  6410 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.618319  6365 consensus_queue.cc:1059] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:14:26.668651  6375 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:26.543231  6406 consensus_queue.cc:237] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:26.671777  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:26.689512  3335 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:14:26.672991  6339 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:26.673851  6156 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:26.683936  3337 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.569649  6191 consensus_queue.cc:1048] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:14:26.686678  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:26.690758  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 197031us
I20260709 12:14:26.703660  3932 raft_consensus.cc:1240] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:26.686729  6333 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:26.689411  6410 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:26.689087  6199 consensus_queue.cc:1243] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Peer eb49d92feeb14382b3baa49d696b6141 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:26.708544  3232 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:26.717440  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:26.718029  3193 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.660497  6440 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:26.719164  3191 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:26.730324  3895 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:26.722038  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:26.733754  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:26.736804  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:26.801872  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 68197.3us
I20260709 12:14:26.709193  6408 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:26.802646  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 291807us
I20260709 12:14:26.804011  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:26.802121  3337 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:26.814087  3928 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:26.824626  3193 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:26.826038  6375 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:26.720042  6365 raft_consensus.cc:3055] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:26.801290  6303 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:26.803586  6438 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:26.696234  6315 consensus_queue.cc:260] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:26.887276  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 272940us
I20260709 12:14:26.850026  6247 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:26.871917  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:26.879312  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 75369.7us
I20260709 12:14:26.800913  6368 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:26.885594  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 296640us
I20260709 12:14:26.895208  3231 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:26.901823  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:26.912513  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 182092us
I20260709 12:14:26.885879  6302 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:26.885417  6365 raft_consensus.cc:740] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:26.912773  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:26.923556  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:26.924171  3265 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.803973  6324 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:26.891322  6408 raft_consensus.cc:697] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:26.907248  6419 consensus_queue.cc:1243] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer 7ac63b674f204bc4805ab989f8c965d3 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:26.934046  3895 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:26.929382  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:26.942358  3262 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.943323  3895 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:26.908896  6339 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:26.904764  6192 raft_consensus.cc:697] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:14:26.941246  5997 consensus_meta.cc:287] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.004s
I20260709 12:14:26.940109  6453 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.980433  6419 consensus_queue.cc:1059] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:14:26.992856  6408 consensus_queue.cc:237] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:26.980211  6440 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:26.995968  6365 consensus_queue.cc:260] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:26.997033  6365 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.972295  6446 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:26.956878  3265 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:26.952185  6358 raft_consensus.cc:3055] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:26.925688  6315 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:26.999899  5997 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:26.951539  6458 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:26.953223  6443 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:14:26.911866  6452 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:26.927064  6451 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:14:26.953812  6442 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:27.008786  3265 raft_consensus.cc:1240] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:27.013093  6446 raft_consensus.cc:697] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:27.014211  6462 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:27.022993  3924 raft_consensus.cc:1240] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:27.022710  5997 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:27.025631  3262 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:27.007645  6358 raft_consensus.cc:740] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:27.024264  6333 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:27.037256  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:27.040748  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 145665us
W20260709 12:14:27.023706  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 80459.3us
I20260709 12:14:27.042966  6446 consensus_queue.cc:237] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:27.025795  6458 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.026777  6406 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:27.038967  6460 raft_consensus.cc:3055] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:27.074554  6358 consensus_queue.cc:260] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:27.083098  3231 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:27.084623  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 192950us
I20260709 12:14:27.026683  6457 consensus_queue.cc:1059] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:14:27.110301  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:27.111159  3193 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:27.073064  6406 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.109683  6467 raft_consensus.cc:2764] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:14:27.116354  6465 raft_consensus.cc:2955] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:27.073369  6458 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:27.124774  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:27.036589  6452 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:27.127852  3157 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:27.129316  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 156665us
I20260709 12:14:27.080840  6460 raft_consensus.cc:740] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:27.137890  6460 consensus_queue.cc:260] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:27.139273  6460 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:27.086565  6375 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.151399  3193 raft_consensus.cc:2468] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:27.172928  3190 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:27.162701  3268 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:27.175904  3305 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:27.114166  6156 consensus_queue.cc:1059] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 12:14:27.180585  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:27.181411  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.174594  3895 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:27.183007  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 99989.9us
I20260709 12:14:27.120468  6406 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:27.184368  3231 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:27.190943  3193 raft_consensus.cc:1240] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:27.192920  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:27.193668  3193 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:27.046530  6462 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:27.209399  3193 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:27.210807  3231 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:27.221618  3193 raft_consensus.cc:1240] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:27.188678  6175 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:27.088433  6192 consensus_queue.cc:237] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:27.227039  3231 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:27.228670  3231 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:27.238150  3231 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:27.200862  5997 raft_consensus.cc:2804] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:27.201223  6470 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:27.243986  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 107310us
I20260709 12:14:27.244500  6478 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:27.209836  6467 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:27.183511  6442 consensus_queue.cc:1059] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:14:27.250231  3157 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:27.195653  6451 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:14:27.180644  6375 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:27.223791  6453 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:27.264772  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 76818.3us
I20260709 12:14:27.205962  6443 consensus_queue.cc:1059] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:14:27.273181  3333 raft_consensus.cc:1240] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:27.273506  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:27.274235  3337 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:27.205727  6324 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:14:27.224128  6456 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:27.210541  6114 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:14:27.247519  6303 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:27.246685  6466 raft_consensus.cc:3055] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:27.247390  6345 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:27.253623  6305 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:27.218130  6448 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:14:27.248030  6438 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:27.272385  3231 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:27.262058  6211 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:27.262579  6472 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:27.309108  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:27.301185  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 51397.6us
I20260709 12:14:27.262892  5997 raft_consensus.cc:697] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
W20260709 12:14:27.271975  6410 consensus_meta.cc:287] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.000s
I20260709 12:14:27.268191  6478 raft_consensus.cc:697] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:27.299819  6303 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:27.333307  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 80387.2us
I20260709 12:14:27.263708  6470 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:27.332073  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:27.278582  6175 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:27.331352  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.308346  6457 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.341032  3231 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:27.304560  6466 raft_consensus.cc:740] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:27.333392  6315 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:27.349974  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:27.352039  3337 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:14:27.321882  6438 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:27.322659  6442 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:27.362506  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.365144  3337 pending_rounds.cc:85] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 5
I20260709 12:14:27.371142  3337 pending_rounds.cc:107] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:14:27.371508  3337 raft_consensus.cc:2889] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:27.338265  6447 raft_consensus.cc:3055] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:27.372963  6447 raft_consensus.cc:740] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:27.373363  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:27.374114  6447 consensus_queue.cc:260] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:27.346414  6303 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:27.380497  6447 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:27.398339  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:27.305881  6456 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:27.401268  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.401306  3305 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:27.331292  6345 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:27.340356  6410 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:27.518786  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.657220  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:27.657608  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 316639us
I20260709 12:14:27.660465  3231 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:27.661976  3231 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:27.370795  6438 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:27.670812  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:27.359668  6175 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:27.576782  6473 log.cc:927] Time spent T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:14:27.577437  6498 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.421882  6482 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:27.367367  6333 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:27.341274  6472 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:27.713217  3342 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:27.465797  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:27.555281  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.366671  6315 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.682116  6406 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:27.369980  6451 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:27.670574  6305 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:27.723940  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:27.575621  6452 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:27.694020  6470 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:27.742750  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 341434us
I20260709 12:14:27.708248  6453 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:27.364225  6457 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:27.707719  6482 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.753603  3185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d"
dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:34698
I20260709 12:14:27.403293  6442 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:27.750998  3191 raft_consensus.cc:2393] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:27.754303  3185 raft_consensus.cc:606] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:27.578449  6485 consensus_queue.cc:1059] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
W20260709 12:14:27.763300  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.729817  6315 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:27.812590  3156 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 3.214s (SENT) [suppressed 50 similar messages]
I20260709 12:14:27.709856  6498 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:28.005311  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 192747us
W20260709 12:14:27.814263  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 111138us
I20260709 12:14:27.717628  6467 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:27.818943  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.012001  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.749783  6453 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.731860  6490 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:27.966239  6462 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:27.576927  5997 consensus_queue.cc:237] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:27.757421  6482 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:27.765717  6502 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:27.575870  6466 consensus_queue.cc:260] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:28.018604  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.021813  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.022480  3188 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:27.574259  6303 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.015120  6305 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:28.027660  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:28.027680  6474 log.cc:927] Time spent T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.490s	user 0.000s	sys 0.001s
I20260709 12:14:28.032016  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.078614  3264 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:28.017204  6374 raft_consensus.cc:3055] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:14:28.016834  6247 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.049s	sys 0.042s
I20260709 12:14:28.051146  3184 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:28.064860  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.068346  3188 raft_consensus.cc:1240] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:14:28.071275  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:28.117213  3263 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:27.724743  6478 consensus_queue.cc:237] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:28.072002  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.030316  6473 log.cc:927] Time spent T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:14:28.080685  3193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.005s	sys 0.001s
W20260709 12:14:28.138154  3193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.005s	sys 0.001s
I20260709 12:14:28.014933  6451 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:28.035086  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.139822  3265 raft_consensus.cc:2410] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:14:28.084288  6469 log.cc:927] Time spent T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.454s	user 0.001s	sys 0.000s
I20260709 12:14:28.066411  6459 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:28.089542  6410 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.090412  6485 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:28.138024  6247 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.049s	sys 0.042s
I20260709 12:14:28.091917  6506 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.088038  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:28.175271  3259 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:28.022956  6453 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:28.180498  3189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.004s	sys 0.007s
I20260709 12:14:28.088335  6305 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.105788  6374 raft_consensus.cc:740] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:28.145998  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:28.148597  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 417731us
W20260709 12:14:28.091471  6496 log.cc:927] Time spent T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.151s	user 0.000s	sys 0.008s
W20260709 12:14:28.141770  6211 consensus_meta.cc:287] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.801s	user 0.006s	sys 0.005s
W20260709 12:14:28.164664  3335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.003s	sys 0.006s
W20260709 12:14:28.202713  3335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.003s	sys 0.006s
W20260709 12:14:28.181216  3189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.004s	sys 0.008s
I20260709 12:14:28.194137  3265 raft_consensus.cc:2410] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:14:28.185913  6323 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.010s	sys 0.017s
W20260709 12:14:28.201812  3156 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.525s (SENT)
I20260709 12:14:28.204622  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 627) took 1294 ms. Trace:
I20260709 12:14:28.264124  3156 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:28.210842  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 120412us
I20260709 12:14:28.147519  6490 raft_consensus.cc:697] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:28.217960  3265 raft_consensus.cc:1275] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:28.264205  3261 rpcz_store.cc:276] 0709 12:14:26.910294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.913736 (+  3442us) service_pool.cc:224] Handling call
0709 12:14:26.914133 (+   397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:26.978558 (+ 64425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.978629 (+    71us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:27.011893 (+ 33264us) log.cc:844] Serialized 52 byte log entry
0709 12:14:27.173561 (+161668us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:27.194045 (+ 20484us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.195315 (+  1270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.203917 (+  8602us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:28.204400 (+1000483us) raft_consensus.cc:1685] finished
0709 12:14:28.204424 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.204562 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4665,"prepare.queue_time_us":19696,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":20893,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":17271,"thread_start_us":202104,"threads_started":2,"wal-append.queue_time_us":321984}
I20260709 12:14:28.223569  6374 consensus_queue.cc:260] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.240947  3267 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
W20260709 12:14:28.241240  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 47197.8us
I20260709 12:14:28.179762  6459 raft_consensus.cc:697] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:14:28.248770  6497 log.cc:927] Time spent T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
W20260709 12:14:28.280555  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 78782us
I20260709 12:14:28.151491  6451 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.217659  6489 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:28.251696  6500 log.cc:927] Time spent T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:14:28.252290  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47276 (request call id 463) took 1127 ms. Trace:
I20260709 12:14:28.081000  6502 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.262995  3259 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:28.278589  6477 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:28.240934  6452 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.280261  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:28.028456  6467 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.252388  6465 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.329087  3267 raft_consensus.cc:1240] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:14:28.286613  3192 rpcz_store.cc:276] 0709 12:14:27.124376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.126244 (+  1868us) service_pool.cc:224] Handling call
0709 12:14:27.178535 (+ 52291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:27.255746 (+ 77211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.255792 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:27.256382 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 12:14:27.397182 (+140800us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:27.397247 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.397375 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:28.252041 (+854666us) raft_consensus.cc:1685] finished
0709 12:14:28.252063 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.252228 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6135,"raft.queue_time_us":66752,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"thread_start_us":146813,"threads_started":2,"wal-append.queue_time_us":397554}
I20260709 12:14:28.179391  6485 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.307018  6451 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:28.316769  6305 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:28.340477  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.341149  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 60959.6us
I20260709 12:14:28.341889  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:28.321565  3259 raft_consensus.cc:1240] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:14:28.322403  3342 consensus_meta.cc:287] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.000s
I20260709 12:14:28.324354  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.344972  3342 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:28.345233  3265 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:28.274236  6472 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.323161  6512 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:28.264007  6323 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.011s	sys 0.017s
I20260709 12:14:28.292418  6175 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:28.336316  6460 consensus_meta.cc:287] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 1.196s	user 0.007s	sys 0.006s
I20260709 12:14:28.340126  3261 raft_consensus.cc:1240] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:28.360239  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:28.360857  3261 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:28.285880  6462 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:28.189929  6506 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.363771  6507 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.364305  6507 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.365592  6506 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:14:28.348009  6498 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.366695  6507 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.301764  6406 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:28.317677  6457 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.368723  6502 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:28.291320  6489 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.372129  3265 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:14:28.373167  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:28.373340  6489 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.373910  3265 raft_consensus.cc:2410] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:14:28.375743  6459 consensus_queue.cc:237] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.330835  6374 raft_consensus.cc:3060] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.389566  6522 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:28.390615  6365 consensus_meta.cc:287] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 1.393s	user 0.007s	sys 0.007s
I20260709 12:14:28.391861  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:28.358089  6458 consensus_meta.cc:287] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 1.181s	user 0.013s	sys 0.000s
I20260709 12:14:28.392601  3267 raft_consensus.cc:2393] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:28.398185  3259 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:28.372175  6513 log.cc:927] Time spent T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:14:28.405254  3186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1804) took 1207 ms. Trace:
I20260709 12:14:28.412154  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 601) took 1848 ms. Trace:
I20260709 12:14:28.412536  3932 rpcz_store.cc:276] 0709 12:14:26.563757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.563890 (+   133us) service_pool.cc:224] Handling call
0709 12:14:26.564222 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.704178 (+139956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.408979 (+1704801us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54004ef554. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:28.412060 (+  3081us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320250240}
I20260709 12:14:28.417261  3342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52822 (request call id 781) took 1100 ms. Trace:
I20260709 12:14:28.417680  3342 rpcz_store.cc:276] 0709 12:14:27.316506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.334140 (+ 17634us) service_pool.cc:224] Handling call
0709 12:14:28.417052 (+1082912us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b540038c2d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:28.417173 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":800921984}
I20260709 12:14:28.420584  6467 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:28.421296  6442 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:28.342178  6465 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.402740  6458 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.424732  6465 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:28.408473  6303 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.425670  6345 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.425760  6458 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:28.399052  6490 consensus_queue.cc:237] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.341070  6452 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.426820  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 626) took 1523 ms. Trace:
I20260709 12:14:28.427815  6452 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:28.427201  3260 rpcz_store.cc:276] 0709 12:14:26.903119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.903334 (+   215us) service_pool.cc:224] Handling call
0709 12:14:26.921353 (+ 18019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.189592 (+268239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.189638 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.189695 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:27.189745 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.426592 (+1236847us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54003aa7d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:28.426643 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.426763 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616244096}
I20260709 12:14:28.408625  3186 rpcz_store.cc:276] 0709 12:14:27.198296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.198412 (+   116us) service_pool.cc:224] Handling call
0709 12:14:27.198706 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:27.245854 (+ 47148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.245887 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:27.256285 (+ 10398us) log.cc:844] Serialized 26 byte log entry
0709 12:14:27.659929 (+403644us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:27.659968 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.660027 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:28.405042 (+745015us) raft_consensus.cc:1685] finished
0709 12:14:28.405062 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.405194 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48372,"raft.queue_time_us":44680,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5138,"thread_start_us":362117,"threads_started":2,"wal-append.queue_time_us":440804}
I20260709 12:14:28.396838  6462 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.442761  3261 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:28.446030  3267 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:28.450119  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.450838  3261 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:28.452201  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:28.452556  3156 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.703s (SENT)
I20260709 12:14:28.453292  3156 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:28.452800  3260 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:28.455454  6447 consensus_meta.cc:287] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 1.074s	user 0.004s	sys 0.007s
I20260709 12:14:28.455616  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.464313  3267 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:28.457003  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.478384  3261 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:14:28.480479  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.483973  3261 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
W20260709 12:14:28.479036  6438 consensus_meta.cc:287] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.779s	user 0.016s	sys 0.000s
I20260709 12:14:28.496519  6438 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.511572  3262 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:28.511853  6438 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:28.574757  6458 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.575268  6462 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.554126  3260 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:28.576489  3263 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:28.607908  6458 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.609157  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.609380  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:28.609885  3260 raft_consensus.cc:2376] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9. Re-sending same reply.
I20260709 12:14:28.610023  3263 raft_consensus.cc:2376] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5. Re-sending same reply.
I20260709 12:14:28.610723  6458 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.575490  6452 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:28.610922  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.611789  3263 raft_consensus.cc:2393] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
W20260709 12:14:28.536013  6493 log.cc:927] Time spent T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.005s
I20260709 12:14:28.576704  6485 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.611668  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:28.508941  6528 log.cc:927] Time spent T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.055s	user 0.004s	sys 0.000s
I20260709 12:14:28.611599  6452 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.577644  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1811) took 1358 ms. Trace:
I20260709 12:14:28.532004  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.625444  3267 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:28.626012  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.604245  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:28.616329  3335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 773) took 1310 ms. Trace:
I20260709 12:14:28.627018  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.620762  3261 raft_consensus.cc:2376] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9. Re-sending same reply.
I20260709 12:14:28.627780  3263 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:28.624342  3193 rpcz_store.cc:276] 0709 12:14:27.219628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.228392 (+  8764us) service_pool.cc:224] Handling call
0709 12:14:27.228761 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:28.155639 (+926878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.155669 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:28.192372 (+ 36703us) log.cc:844] Serialized 52 byte log entry
0709 12:14:28.445709 (+253337us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:28.445836 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.446036 (+   200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:28.577370 (+131334us) raft_consensus.cc:1685] finished
0709 12:14:28.577395 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.577570 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":321093,"raft.queue_time_us":113369,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":21472,"thread_start_us":1042429,"threads_started":2,"wal-append.queue_time_us":239162}
I20260709 12:14:28.630620  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.631094  3263 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:28.632902  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:28.633026  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:28.633628  3337 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:28.626806  3335 rpcz_store.cc:276] 0709 12:14:27.271703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.271945 (+   242us) service_pool.cc:224] Handling call
0709 12:14:27.307515 (+ 35570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:27.314596 (+  7081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.314642 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:27.320500 (+  5858us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.203143 (+882643us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:28.203191 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.203263 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:28.577129 (+373866us) raft_consensus.cc:1685] finished
0709 12:14:28.577173 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.582083 (+  4910us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6639,"raft.queue_time_us":63416,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":21008,"thread_start_us":844050,"threads_started":1,"wal-append.queue_time_us":1125747}
W20260709 12:14:28.633234  6503 log.cc:927] Time spent T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 12:14:28.634682  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.635380  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:28.635994  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.636143  3261 raft_consensus.cc:2376] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7. Re-sending same reply.
I20260709 12:14:28.637017  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:28.639166  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.640028  6502 consensus_queue.cc:1059] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:28.639596  6518 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.640831  6502 raft_consensus.cc:3055] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:28.640784  6518 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.641314  6502 raft_consensus.cc:740] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:28.643389  3267 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:28.639212  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.644578  3262 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:28.644862  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.643862  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:28.646083  3264 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.642167  6502 consensus_queue.cc:260] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.637511  3261 raft_consensus.cc:2376] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7. Re-sending same reply.
I20260709 12:14:28.649081  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.649988  3267 raft_consensus.cc:2393] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:28.650969  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.652482  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.618036  6482 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.653424  6502 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:28.653501  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.655258  3896 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:28.656226  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.689720  3261 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
W20260709 12:14:28.657019  6523 log.cc:927] Time spent T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:14:28.658209  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.662405  3337 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:28.644871  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.686800  3267 raft_consensus.cc:2410] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:14:28.687070  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.695302  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.696447  3261 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:28.699649  6418 raft_consensus.cc:3055] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:28.700148  6418 raft_consensus.cc:740] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:28.697664  6305 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:28.705163  6305 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.709983  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.711148  3263 raft_consensus.cc:2410] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:28.707315  6305 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.713670  6456 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.718619  3334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 775) took 1446 ms. Trace:
I20260709 12:14:28.719007  3334 rpcz_store.cc:276] 0709 12:14:27.272309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.275756 (+  3447us) service_pool.cc:224] Handling call
0709 12:14:27.276067 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.482195 (+206128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.482244 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.482293 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:27.482331 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.718393 (+1236062us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54000c3ad4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:28.718442 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.718563 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472960256}
W20260709 12:14:28.720676  3191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47276 (request call id 461) took 1597 ms (client timeout 1502 ms). Trace:
W20260709 12:14:28.721071  3191 rpcz_store.cc:269] 0709 12:14:27.123740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.124529 (+   789us) service_pool.cc:224] Handling call
0709 12:14:28.720469 (+1595940us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54002422d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:28.720608 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434430208}
I20260709 12:14:28.723308  3190 raft_consensus.cc:1240] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:28.724798  3190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1801) took 1535 ms. Trace:
I20260709 12:14:28.692334  6467 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.725139  3190 rpcz_store.cc:276] 0709 12:14:27.189491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.189653 (+   162us) service_pool.cc:224] Handling call
0709 12:14:28.723132 (+1533479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.723718 (+   586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.724620 (+   902us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002422d0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:28.724743 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3484728192}
I20260709 12:14:28.725589  6467 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:28.726881  3267 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:14:28.727200  3267 pending_rounds.cc:85] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 5
I20260709 12:14:28.727478  3267 pending_rounds.cc:107] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:14:28.727854  6467 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:28.728159  3267 raft_consensus.cc:2889] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:28.688522  6438 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:28.728634  6454 log.cc:927] Time spent T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 1.756s	user 0.005s	sys 0.001s
I20260709 12:14:28.728704  6438 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:28.729949  3259 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:28.730952  6438 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:28.749563  6512 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:28.762217  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 107037us
I20260709 12:14:28.764310  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:28.751313  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 298799us
I20260709 12:14:28.766330  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.725073  5949 raft_consensus.cc:2804] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:28.732863  6315 consensus_meta.cc:287] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.701s	user 0.004s	sys 0.008s
I20260709 12:14:28.665645  6406 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:14:28.736259  6482 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:28.747902  6527 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:28.749743  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.751073  6247 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:28.744601  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:28.745999  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 404165us
W20260709 12:14:28.737775  6453 consensus_meta.cc:287] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260709 12:14:28.767539  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.776047  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.778144  3896 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:28.780189  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.788712  3260 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:28.790982  3263 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 3.
I20260709 12:14:28.791864  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:28.792217  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:28.786715  3156 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.751s (SENT)
I20260709 12:14:28.790994  3262 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:28.776932  6438 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.781805  6518 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:28.797541  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:28.801016  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:28.802531  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:28.803344  3263 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:28.804827  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:28.791263  3267 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:28.783252  5949 raft_consensus.cc:697] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:28.808317  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.808914  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:28.811774  3267 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 9: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:28.811041  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:28.812872  3334 raft_consensus.cc:2393] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:28.788204  6527 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:28.783937  6315 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.833942  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.812955  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:28.870141  3341 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:28.879040  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:28.879841  3341 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:28.835148  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:28.866444  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:28.834787  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:28.853255  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:28.879235  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:28.885480  3267 raft_consensus.cc:2393] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:28.881981  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:28.882481  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:28.882546  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:28.814610  3336 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:28.832690  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:28.840179  3157 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:28.889712  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:28.889982  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 49894.6us
I20260709 12:14:28.797114  6452 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:28.891773  3262 raft_consensus.cc:2393] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:28.892998  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:28.893296  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:28.893724  3191 raft_consensus.cc:2393] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:28.893628  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:28.893838  3193 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:14:28.894727  3186 raft_consensus.cc:2410] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:28.797372  6482 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:28.782137  6512 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.895393  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:28.922142  3926 raft_consensus.cc:2410] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:28.885404  3929 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:28.896972  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:28.898955  6481 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:28.898823  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:28.899533  3928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:14:28.889977  6247 consensus_queue.cc:1059] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:14:28.903604  6486 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:14:28.884354  6527 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:28.912493  3189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1806) took 1712 ms. Trace:
I20260709 12:14:28.936955  3189 rpcz_store.cc:276] 0709 12:14:27.200055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.200178 (+   123us) service_pool.cc:224] Handling call
0709 12:14:27.200433 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.236409 (+ 35976us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:27.319624 (+ 83215us) log.cc:844] Serialized 14 byte log entry
0709 12:14:28.241826 (+922202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:28.241882 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:28.241935 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.912244 (+670309us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b54002ed454. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:28.912294 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.912428 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44198,"prepare.queue_time_us":347640,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":18761,"raft.queue_time_us":74818,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"spinlock_wait_cycles":82207488,"thread_start_us":960530,"threads_started":2,"wal-append.queue_time_us":1137237}
I20260709 12:14:28.897722  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:28.914389  3264 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:28.866714  6374 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:28.916847  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:28.924568  3184 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:28.924683  3928 raft_consensus.cc:606] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:28.930305  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:28.946357  3193 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:28.795092  6453 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.932456  3187 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:28.933080  3268 raft_consensus.cc:2393] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:28.807086  6438 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:28.948556  3192 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:28.935529  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:28.935900  3260 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:28.915390  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.940585  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:28.950975  3267 raft_consensus.cc:2393] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:28.939091  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:28.887705  6323 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:28.953013  3156 leader_election.cc:336] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.805s (SENT)
I20260709 12:14:28.953469  3156 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:28.953771  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:28.947300  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:28.951654  3189 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.955300  3193 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.960392  3267 raft_consensus.cc:1240] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:28.963779  3156 leader_election.cc:336] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.887s (SENT)
I20260709 12:14:28.964104  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:28.964205  3156 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:28.935702  6486 consensus_queue.cc:1243] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:28.889276  6478 consensus_queue.cc:1059] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:14:28.938388  6467 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.979918  3189 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:28.948220  6502 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.943991  6452 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.006196  3265 raft_consensus.cc:2393] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 11: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:28.999820  6481 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:14:29.008721  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 44960.8us
I20260709 12:14:29.008944  6462 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:29.009456  3156 leader_election.cc:336] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.964s (SENT)
I20260709 12:14:29.001060  6467 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.010174  3156 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.001509  6502 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.011041  6517 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:29.013092  6502 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:29.015360  6475 log.cc:927] Time spent T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.506s	user 0.001s	sys 0.003s
I20260709 12:14:29.016136  6358 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.979451  6516 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.019692  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:29.020251  6516 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.022236  3189 raft_consensus.cc:1275] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:29.022563  6516 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:29.023101  6375 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:29.024221  3190 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:29.028666  3156 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.028677  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.030601  3266 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:29.032411  3928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
mode: GRACEFUL
new_leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
 from {username='slave'} at 127.0.0.1:41262
I20260709 12:14:29.032891  6540 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:29.031895  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:29.034897  3268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2055) took 1019 ms. Trace:
I20260709 12:14:29.035251  3268 rpcz_store.cc:276] 0709 12:14:28.016024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.016199 (+   175us) service_pool.cc:224] Handling call
0709 12:14:29.034710 (+1018511us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54003a93d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:29.034843 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987976448}
I20260709 12:14:29.036332  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.036844  3268 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:29.037644  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.038458  3268 raft_consensus.cc:2393] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:29.039135  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:28.992661  3193 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:29.040621  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:29.040787  3191 raft_consensus.cc:1240] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:29.041805  6508 consensus_queue.cc:1059] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 12:14:29.048177  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:29.081831  3190 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:29.087783  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:29.088995  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:29.089835  3191 raft_consensus.cc:2393] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:29.092087  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.009368  6453 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:29.007332  6442 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.050531  6539 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:29.051853  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:29.051887  6518 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:29.053346  6368 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:29.053833  3232 connection.cc:256] RPC call timeout handler was delayed by -1.0520181239999147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260709 12:14:29.056650  6206 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.979632  6489 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:29.000265  6478 consensus_queue.cc:1243] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:29.006824  5949 consensus_queue.cc:237] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.086220  6516 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:29.067761  3333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 778) took 1757 ms. Trace:
I20260709 12:14:28.963549  6323 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.000113  6247 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:28.989394  3263 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:29.128507  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.061896  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:29.073526  3895 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.076681  3266 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:29.129761  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:29.130060  3261 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.958019  6374 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.130409  3263 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:29.080773  3156 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:29.131997  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 51284us
I20260709 12:14:29.082417  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:29.086074  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 599) took 2851 ms. Trace:
I20260709 12:14:29.086352  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:29.135802  3337 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:29.135586  3924 rpcz_store.cc:276] 0709 12:14:26.226872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.227016 (+   144us) service_pool.cc:224] Handling call
0709 12:14:26.279356 (+ 52340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.041970 (+762614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.078013 (+2036043us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54004ee8d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:29.078185 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1709766400}
I20260709 12:14:29.137004  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:29.137694  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 64255us
I20260709 12:14:29.087250  3231 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:29.048321  6534 log.cc:927] Time spent T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:14:29.060923  6512 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:29.066886  6315 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:29.146898  3184 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:29.033504  6540 raft_consensus.cc:697] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:29.072932  6502 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:29.098946  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:29.101042  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:29.149772  3931 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:29.105147  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:29.059396  6455 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 2.119s	user 0.003s	sys 0.000s
I20260709 12:14:29.005535  6452 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.116457  3333 rpcz_store.cc:276] 0709 12:14:27.310059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.310234 (+   175us) service_pool.cc:224] Handling call
0709 12:14:27.310594 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.751093 (+440499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.751121 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.751156 (+    35us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:27.751185 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.067537 (+1316352us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b540036d154. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:29.067582 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.067706 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012614400}
I20260709 12:14:29.106640  6442 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:29.139984  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:29.140187  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 53023.6us
I20260709 12:14:29.141698  3156 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.096303  3191 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:14:29.147956  3928 raft_consensus.cc:606] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Received request to transfer leadership to TS 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:29.151705  3268 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:29.144449  6453 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:29.154775  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:29.155961  3263 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:29.167032  3231 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:29.079360  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 150799us
I20260709 12:14:29.109265  6539 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.165411  3928 raft_consensus.cc:614] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:29.182533  6539 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:29.184393  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 51714us
I20260709 12:14:29.184576  6408 raft_consensus.cc:3055] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:14:29.184971  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.185140  6408 raft_consensus.cc:740] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:29.185344  3156 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.186152  6408 consensus_queue.cc:260] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.186688  3156 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.111999  6206 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.191629  3156 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:29.187536  6517 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:29.170596  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.199712  3263 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:29.109514  6368 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:29.144070  6489 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:29.109913  6518 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.157567  3232 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:29.209290  3156 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.212026  3261 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:29.213740  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.214927  3261 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:29.184458  6247 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:29.187657  6448 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.159590  6545 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:29.248262  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.249364  3261 raft_consensus.cc:2393] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:29.176774  6453 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:29.239874  3268 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:29.187896  6478 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:29.188954  6303 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:29.187319  6408 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:29.208220  6315 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.242250  3189 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:29.206336  6512 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:29.196213  6438 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:29.206499  6489 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:29.159354  6502 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.294158  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.300429  3259 raft_consensus.cc:2393] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:29.258770  6453 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:29.247960  6508 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:29.302053  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 99788.3us
W20260709 12:14:29.303632  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 133120us
I20260709 12:14:29.305941  3896 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:29.306905  3156 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.308070  6517 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:29.308815  3156 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:29.310617  6517 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:29.311517  6517 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:29.311856  6545 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:29.312361  6545 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.312819  6545 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:29.313819  3156 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.315852  6512 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:29.316231  6512 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:29.316601  6512 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:29.316746  6452 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:29.299047  6467 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:29.290354  6527 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.303058  6489 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:29.320014  6527 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:29.320708  3187 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:29.321187  6545 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.324491  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.325655  3157 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:29.326318  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:29.327759  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:29.328482  3335 raft_consensus.cc:2393] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:29.329120  6462 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:29.329859  6462 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:29.330192  6462 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.330523  6462 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:29.332764  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:29.333511  3337 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:29.333846  6466 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:29.335479  6303 raft_consensus.cc:2764] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:29.335556  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:29.336333  3337 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:29.340163  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.342061  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:29.342824  3268 raft_consensus.cc:2393] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 4: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:29.343761  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:29.344470  3924 raft_consensus.cc:2368] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7.
I20260709 12:14:29.345105  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:29.346546  6323 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:29.349125  6374 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:29.350152  6544 log.cc:927] Time spent T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:14:29.351485  6206 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:29.352787  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.353403  3261 raft_consensus.cc:2376] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9. Re-sending same reply.
I20260709 12:14:29.354358  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.356220  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.368655  3263 raft_consensus.cc:2410] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:29.355394  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:29.370666  3157 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:29.259610  6247 raft_consensus.cc:697] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:14:29.371649  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 58115.6us
I20260709 12:14:29.365357  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:29.429961  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 272414us
I20260709 12:14:29.384018  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.431486  3156 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:29.365886  3337 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:29.342547  3896 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:29.372361  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.433564  3263 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:29.434829  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.435715  3263 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:29.435878  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.436540  3268 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:29.253458  6448 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:29.439806  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 97334.7us
I20260709 12:14:29.438352  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.444873  3267 raft_consensus.cc:2410] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:29.446287  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.450968  3156 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.457481  3156 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:29.426518  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 55954.1us
I20260709 12:14:29.373413  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:29.287566  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 145023us
I20260709 12:14:29.443002  3896 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:29.447047  3267 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:29.286962  6443 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.175s
I20260709 12:14:29.494494  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:29.292440  6315 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.502903  3264 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:14:29.506862  3265 raft_consensus.cc:1240] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:29.506690  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:29.536430  3924 raft_consensus.cc:2410] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:14:29.358096  6545 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:29.541328  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.542212  3268 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 11.
I20260709 12:14:29.362720  6518 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:29.360787  6368 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:29.439970  6333 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.413378  6517 raft_consensus.cc:697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:29.439821  6480 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:29.442098  6506 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.472123  6481 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:29.558621  3339 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:29.287138  6540 consensus_queue.cc:237] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.592715  3259 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:29.569069  3268 raft_consensus.cc:1240] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:29.569888  6548 log.cc:927] Time spent T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:14:29.589183  6247 consensus_queue.cc:237] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:29.404508  6527 consensus_queue.cc:1059] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 12:14:29.597132  3267 raft_consensus.cc:1240] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:14:29.492988  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:29.614270  3263 raft_consensus.cc:2393] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:29.559928  6480 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.627961  3268 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:29.592263  6206 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:29.566920  6333 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.640743  6480 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:29.652200  3261 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:29.639499  6527 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:29.593428  6506 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.663064  3268 raft_consensus.cc:1275] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:14:29.656522  6547 log.cc:927] Time spent T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 12:14:29.655992  6551 log.cc:927] Time spent T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:14:29.655344  6549 log.cc:927] Time spent T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:14:29.739090  3925 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:29.742868  6438 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.747206  6563 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.747416  6438 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.747830  6563 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.749761  6368 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.750257  6368 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.756253  6315 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:29.653276  6517 consensus_queue.cc:237] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.659878  6489 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:29.768872  6489 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:29.770496  6410 raft_consensus.cc:3055] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:29.770913  6410 raft_consensus.cc:740] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:29.771824  3260 raft_consensus.cc:1240] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:29.771660  6410 consensus_queue.cc:260] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:29.772609  6410 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:29.773845  3260 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:29.774904  3260 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:29.776165  3260 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:29.779868  6478 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:29.734525  6548 log.cc:927] Time spent T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:14:29.792650  3266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.044s	sys 0.090s
W20260709 12:14:29.793268  3266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.044s	sys 0.090s
I20260709 12:14:29.794023  3266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1656) took 1021 ms. Trace:
I20260709 12:14:29.794498  3266 rpcz_store.cc:276] 0709 12:14:28.772557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.139724 (+367167us) service_pool.cc:224] Handling call
0709 12:14:29.140112 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.140395 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:29.152547 (+ 12152us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.793646 (+641099us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:29.793708 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:29.793759 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.793826 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.793963 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9397,"prepare.queue_time_us":11906,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":65139,"spinlock_wait_cycles":106535808,"thread_start_us":640491,"threads_started":2,"wal-append.queue_time_us":149361}
W20260709 12:14:29.800458  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.801458  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 344034us
I20260709 12:14:29.802783  3156 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.906934  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1646) took 1137 ms. Trace:
I20260709 12:14:29.911257  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:29.912318  3189 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:29.915738  3188 raft_consensus.cc:1275] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:29.918211  3193 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:29.907557  3262 rpcz_store.cc:276] 0709 12:14:28.769817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.917396 (+147579us) service_pool.cc:224] Handling call
0709 12:14:28.917755 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.918206 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.918235 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.918730 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:14:29.127904 (+209174us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:29.148876 (+ 20972us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.149108 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.149187 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:29.906614 (+757427us) raft_consensus.cc:1685] finished
0709 12:14:29.906657 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.906848 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21158,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":9525,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":18895,"thread_start_us":152730,"threads_started":1,"wal-append.queue_time_us":293982}
I20260709 12:14:29.793485  6315 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:29.790748  6562 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:29.923520  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 120800us
I20260709 12:14:29.926527  3184 raft_consensus.cc:1240] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:29.933180  3156 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.935006  3156 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:29.936189  3156 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:29.886976  6448 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:29.938584  3265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1663) took 1002 ms. Trace:
I20260709 12:14:29.932288  6489 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:29.944360  6560 log.cc:927] Time spent T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:14:29.935599  6303 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:29.959643  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:29.962219  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:29.963869  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:29.965265  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:29.965911  3189 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:29.928015  6315 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:29.973562  3189 raft_consensus.cc:2410] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:29.974684  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:29.981732  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:29.985560  3191 raft_consensus.cc:2393] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:29.985986  3193 raft_consensus.cc:2410] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:14:29.949098  6448 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:29.986420  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:29.950222  6489 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:29.990806  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:29.992069  3184 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
W20260709 12:14:29.994324  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.950749  3265 rpcz_store.cc:276] 0709 12:14:28.936584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.534701 (+598117us) service_pool.cc:224] Handling call
0709 12:14:29.535064 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.535321 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:29.599805 (+ 64484us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.938119 (+338314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:29.938191 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:29.938264 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.938357 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.938508 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57623,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2741,"thread_start_us":336436,"threads_started":1}
W20260709 12:14:29.975013  6453 consensus_meta.cc:287] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.585s	user 0.021s	sys 0.000s
I20260709 12:14:29.958295  6365 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:29.982888  6206 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:29.980614  6527 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:30.004851  6509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.006s	sys 0.012s
I20260709 12:14:29.991004  6489 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.007995  6333 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:29.940157  6562 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:29.959618  6303 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:30.016266  6408 consensus_meta.cc:287] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.727s	user 0.007s	sys 0.004s
I20260709 12:14:30.013952  6206 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.004885  6448 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:30.019851  6517 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.055092  6206 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:30.011868  6453 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:30.056247  6566 log.cc:927] Time spent T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.116s	user 0.003s	sys 0.000s
W20260709 12:14:30.067700  3157 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.008s	sys 0.010s
W20260709 12:14:30.070775  3157 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.008s	sys 0.011s
W20260709 12:14:30.071491  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 579218us
I20260709 12:14:30.076835  3333 raft_consensus.cc:1275] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:14:30.078186  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:30.079803  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:30.080721  3339 raft_consensus.cc:2410] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:30.081983  3335 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:30.086465  3190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1828) took 1023 ms. Trace:
I20260709 12:14:30.087576  6206 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:30.088924  3191 raft_consensus.cc:2393] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:30.090723  6206 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:30.092660  6562 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:30.093859  6512 consensus_meta.cc:287] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.777s	user 0.010s	sys 0.000s
I20260709 12:14:30.093979  6315 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.097734  3157 leader_election.cc:400] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7.
I20260709 12:14:30.086935  3190 rpcz_store.cc:276] 0709 12:14:29.062674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.151022 (+ 88348us) service_pool.cc:224] Handling call
0709 12:14:29.167651 (+ 16629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:29.168056 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:29.168096 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:29.188295 (+ 20199us) log.cc:844] Serialized 26 byte log entry
0709 12:14:29.403359 (+215064us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:29.403403 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.403528 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:30.086239 (+682711us) raft_consensus.cc:1685] finished
0709 12:14:30.086265 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.086402 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":563,"raft.queue_time_us":899,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":7562,"thread_start_us":207151,"threads_started":1,"wal-append.queue_time_us":837180}
I20260709 12:14:30.098088  3157 leader_election.cc:403] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:14:30.094286  6512 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:30.063953  6517 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:30.166953  6448 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:30.169214  6512 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.171663  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 637) took 1068 ms. Trace:
I20260709 12:14:30.172143  3261 rpcz_store.cc:276] 0709 12:14:29.103510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.731288 (+627778us) service_pool.cc:224] Handling call
0709 12:14:29.746417 (+ 15129us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:29.900421 (+154004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:29.900453 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:29.906283 (+  5830us) log.cc:844] Serialized 26 byte log entry
0709 12:14:30.056742 (+150459us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:30.056809 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.057025 (+   216us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:30.171390 (+114365us) raft_consensus.cc:1685] finished
0709 12:14:30.171414 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.171594 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":153450,"raft.queue_time_us":156273,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":16293,"thread_start_us":113103,"threads_started":1,"wal-append.queue_time_us":168297}
I20260709 12:14:30.158355  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40510 (request call id 1997) took 1262 ms. Trace:
I20260709 12:14:30.094517  6480 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:30.079316  6564 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:30.174994  3192 rpcz_store.cc:276] 0709 12:14:28.896202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.897019 (+   817us) service_pool.cc:224] Handling call
0709 12:14:28.948208 (+ 51189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.948962 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.158139 (+1209177us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b5400061150. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:30.158290 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109350144}
W20260709 12:14:30.175403  6462 consensus_meta.cc:287] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.002s
I20260709 12:14:30.133893  6569 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.179520  6315 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.181130  6562 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.176997  6580 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.189414  6562 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:30.176725  6453 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.191991  6562 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.192690  6579 consensus_queue.cc:1059] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:30.192946  6480 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.195068  6517 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.182003  6564 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:30.195914  6466 consensus_meta.cc:287] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.862s	user 0.013s	sys 0.002s
I20260709 12:14:30.189491  6580 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:30.187674  6315 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:30.202149  6315 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:30.185240  6462 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:30.206018  6462 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:30.207624  6502 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.209510  6465 raft_consensus.cc:3055] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:30.209952  6465 raft_consensus.cc:740] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:30.199496  6564 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.200273  6580 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.214870  6489 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:30.215588  6418 consensus_queue.cc:260] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:30.216740  6418 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:30.198329  6206 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.219910  6206 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:30.220288  6303 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.226173  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 827) took 1389 ms. Trace:
I20260709 12:14:30.226574  3925 rpcz_store.cc:276] 0709 12:14:28.837071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.837192 (+   121us) service_pool.cc:224] Handling call
0709 12:14:28.837444 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.740942 (+903498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.225931 (+484989us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54006d4a54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:30.226103 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2072973056}
I20260709 12:14:30.227604  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:30.227504  6527 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:30.228626  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:30.232522  6442 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:30.234680  6438 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:30.237864  6563 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:30.242398  3188 raft_consensus.cc:2410] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:14:30.253654  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.241536  6542 log.cc:927] Time spent T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 1.306s	user 0.003s	sys 0.000s
I20260709 12:14:30.259707  6489 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.210872  6465 consensus_queue.cc:260] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:30.256930  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 96453.4us
I20260709 12:14:30.264914  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 602) took 1116 ms. Trace:
I20260709 12:14:30.268124  3156 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:30.267645  3931 rpcz_store.cc:276] 0709 12:14:29.156283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.162341 (+  6058us) service_pool.cc:224] Handling call
0709 12:14:29.190142 (+ 27801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.254741 (+ 64599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:29.254783 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:29.254841 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:29.254893 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.264653 (+1009760us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b54006f0c54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:30.264714 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.264853 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147946880}
I20260709 12:14:30.277427  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:30.278368  3193 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:30.279604  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:30.279747  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:30.281052  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:30.281296  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:30.282419  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:30.282356  3193 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:30.283788  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:30.288890  3193 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:30.292208  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:30.292884  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:30.293633  3192 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 4.
I20260709 12:14:30.292282  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:30.301875  3184 raft_consensus.cc:2368] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:30.292937  3190 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:30.284888  6481 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.291095  6465 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:30.332198  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.319788  6489 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:30.336606  3185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1817) took 2320 ms. Trace:
I20260709 12:14:30.339275  3185 rpcz_store.cc:276] 0709 12:14:28.013060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.023099 (+ 10039us) service_pool.cc:224] Handling call
0709 12:14:28.073100 (+ 50001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.148106 (+ 75006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.148154 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.160770 (+ 12616us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.734628 (+573858us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b1800252a60. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4c2e07 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1aee16720b 00007f1aee16cd23 00007f1aee16d0d1 00007f1aee588a0f
0709 12:14:28.786767 (+ 52139us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:28.786919 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.787101 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:30.240856 (+1453755us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:30.333555 (+ 92699us) raft_consensus.cc:1685] finished
0709 12:14:30.333579 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.333782 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93136,"raft.queue_time_us":130629,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":25195,"spinlock_wait_cycles":24383488,"thread_start_us":51473,"threads_started":1,"wal-append.queue_time_us":605587}
I20260709 12:14:30.346671  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:30.347344  3185 raft_consensus.cc:2376] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8. Re-sending same reply.
I20260709 12:14:30.352015  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:30.352766  3184 raft_consensus.cc:2368] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8.
I20260709 12:14:30.344259  6489 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:30.376788  6489 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:30.386191  6506 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.398788  6489 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:30.399577  6481 consensus_queue.cc:1048] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:30.404050  3335 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:30.404984  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:30.406838  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:30.407218  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:30.408023  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:30.408442  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:30.421327  3342 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:30.408916  3231 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:30.421475  3261 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:30.409700  6569 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7.
I20260709 12:14:30.410329  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:30.411012  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:30.411885  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:30.412006  6448 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.427628  6563 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:30.428026  6448 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:30.428234  6563 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:30.412561  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:30.413213  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:30.431032  6499 raft_consensus.cc:3055] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:30.432714  3340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 790) took 1563 ms. Trace:
I20260709 12:14:30.433075  3340 rpcz_store.cc:276] 0709 12:14:28.869624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.871288 (+  1664us) service_pool.cc:224] Handling call
0709 12:14:28.889316 (+ 18028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.149518 (+260202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:29.149568 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:29.149631 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:29.149661 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.432508 (+1282847us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540036d654. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:30.432550 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.432660 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597838720}
I20260709 12:14:30.423192  3268 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:30.417230  6482 raft_consensus.cc:3055] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:30.423774  3262 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:30.437378  3231 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:30.438513  3342 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
W20260709 12:14:30.442893  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.442948  3231 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:30.443893  6303 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:30.442111  6482 raft_consensus.cc:740] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:30.445659  6206 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.439958  6438 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:30.450006  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 1.00701e+06us
I20260709 12:14:30.450251  6324 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:30.450450  3189 raft_consensus.cc:2410] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:30.450812  6324 raft_consensus.cc:697] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:30.451730  6324 consensus_queue.cc:237] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:30.452364  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.452955  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.453737  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 954491us
I20260709 12:14:30.436136  6499 raft_consensus.cc:740] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:30.455525  3895 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:30.456368  6499 consensus_queue.cc:260] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:30.457046  6368 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:30.457417  6499 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:30.458180  6501 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:30.458613  6501 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.458940  6501 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:30.459357  6448 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:30.460193  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.460649  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.460933  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.462651  6418 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.463100  6418 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:30.464023  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.464447  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 833) took 1549 ms. Trace:
I20260709 12:14:30.445421  6569 consensus_queue.cc:1059] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:30.466025  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:30.477901  3336 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:30.467751  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.469435  3231 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:30.469614  3930 rpcz_store.cc:276] 0709 12:14:28.914715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.914946 (+   231us) service_pool.cc:224] Handling call
0709 12:14:28.915327 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.915639 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:29.200044 (+284405us) log.cc:844] Serialized 14 byte log entry
0709 12:14:30.447202 (+1247158us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b180030e4a0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb45ac0a 00007f1af4b9a219 00007f1aeb4e2a40 00007f1aeb4dd4e4 00007f1aeb4dd455 00007f1aee5c5060 00007f1aee5d7716 00007f1aee5e8287 00007f1aee5e8208
0709 12:14:30.447391 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:30.464153 (+ 16762us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:30.464206 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.464274 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.464394 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111260,"prepare.queue_time_us":561274,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":1006502,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":13908864,"thread_start_us":510914,"threads_started":2,"wal-append.queue_time_us":500958}
I20260709 12:14:30.470818  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.480265  3231 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:30.480597  3157 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:30.491350  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:30.499851  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:30.500140  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.500536  3336 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:30.502651  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.478483  6556 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:30.511207  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 54888.9us
I20260709 12:14:30.512073  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.566545  3926 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:30.526180  3157 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:30.552841  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.574115  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 49588us
I20260709 12:14:30.575402  6545 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:30.577190  6545 consensus_queue.cc:1059] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:30.578154  6545 raft_consensus.cc:3055] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:30.578490  6545 raft_consensus.cc:740] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:30.580246  6545 consensus_queue.cc:260] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:30.583894  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 103726us
I20260709 12:14:30.585016  3231 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:30.465315  6406 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:30.506805  6358 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:30.588063  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 61974.8us
I20260709 12:14:30.588413  3231 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:30.589916  3231 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:30.506489  6303 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:30.592615  3305 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:30.595603  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.596227  3931 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:30.598547  3231 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:30.599565  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:30.502104  6438 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:30.597537  3157 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:30.567994  6489 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:30.567790  6452 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:30.608464  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:30.609319  3263 raft_consensus.cc:2393] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 9: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:30.609488  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:30.612287  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:30.613521  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:30.614270  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:30.610131  3260 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:30.478750  6114 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 12:14:30.612946  3188 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:30.622819  3185 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:30.626179  3263 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:30.623386  3186 raft_consensus.cc:2393] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:30.635373  3188 raft_consensus.cc:1275] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:30.635923  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:30.595237  6465 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:30.643944  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:30.644148  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:30.598436  6580 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:30.598585  6564 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:30.647171  3266 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:30.604328  6562 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:30.635058  6517 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:30.617555  6527 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:30.595112  6543 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:14:30.587503  6556 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:30.658726  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.632762  6489 raft_consensus.cc:697] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:30.635317  6442 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:30.683244  3187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47276 (request call id 471) took 1635 ms (client timeout 1923 ms). Trace:
I20260709 12:14:30.601768  6206 consensus_queue.cc:1059] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:14:30.599608  6406 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:30.681581  3926 raft_consensus.cc:1240] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:30.604053  6453 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:14:30.674940  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9
W20260709 12:14:30.683451  3259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40120 (request call id 643) took 1550 ms (client timeout 2051 ms). Trace:
I20260709 12:14:30.684150  3267 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:14:30.685168  3187 rpcz_store.cc:269] 0709 12:14:29.048127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.051604 (+  3477us) service_pool.cc:224] Handling call
0709 12:14:30.683078 (+1631474us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54002dc8d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:30.683188 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513383808}
I20260709 12:14:30.644767  6545 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.594348  6303 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:30.643875  5949 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:30.696241  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 74554.7us
I20260709 12:14:30.697098  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.654990  6452 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:30.719292  6303 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.733355  6452 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:30.733822  6452 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.652205  6562 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:30.738093  6562 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:30.739509  3264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1648) took 1969 ms. Trace:
I20260709 12:14:30.739894  3264 rpcz_store.cc:276] 0709 12:14:28.770347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.940275 (+169928us) service_pool.cc:224] Handling call
0709 12:14:29.502627 (+562352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:29.533766 (+ 31139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.739272 (+1205506us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b540046ebd0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:30.739443 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292452608}
I20260709 12:14:30.656253  6527 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.668099  6564 raft_consensus.cc:697] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:30.744505  6564 consensus_queue.cc:237] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:30.746773  6527 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:30.714828  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.715570  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.649073  6374 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:14:30.712199  3930 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:14:30.710956  3259 rpcz_store.cc:269] 0709 12:14:29.133326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.306237 (+172911us) service_pool.cc:224] Handling call
0709 12:14:30.683277 (+1377040us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540046f0d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:30.683383 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371347200}
I20260709 12:14:30.715751  3895 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:30.665431  6412 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 12:14:30.728288  6573 log.cc:927] Time spent T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.549s	user 0.003s	sys 0.000s
I20260709 12:14:30.731643  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 832) took 1687 ms. Trace:
I20260709 12:14:30.732352  5949 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:30.880962  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 162152us
I20260709 12:14:30.732646  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.757788  3895 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:30.684904  6442 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:30.658337  6517 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:30.894307  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.792940  6588 consensus_queue.cc:1059] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:30.699064  6438 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:30.822078  6452 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:30.731509  6324 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:30.824342  6501 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:30.825244  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 47749.2us
I20260709 12:14:30.665640  6323 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:14:30.828971  6556 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:30.830122  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.921206  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.830802  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.831456  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.835870  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.762686  6448 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 12:14:30.840312  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 81502.7us
I20260709 12:14:30.840950  6418 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:30.844427  6406 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:30.846132  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.853266  3267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56754 (request call id 1667) took 1829 ms. Trace:
I20260709 12:14:30.856984  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55426 (request call id 590) took 1784 ms. Trace:
I20260709 12:14:30.859494  6358 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:30.892864  6442 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:30.900389  6453 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:30.900377  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 142650us
I20260709 12:14:31.035601  3895 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:30.877748  3923 rpcz_store.cc:276] 0709 12:14:28.879544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.952382 (+ 72838us) service_pool.cc:224] Handling call
0709 12:14:29.007964 (+ 55582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.008210 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:29.239721 (+231511us) log.cc:844] Serialized 14 byte log entry
0709 12:14:30.566741 (+1327020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:30.566794 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:30.566841 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.566999 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.567097 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":796174,"prepare.queue_time_us":539177,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":839484,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":45544,"thread_start_us":736018,"threads_started":3,"wal-append.queue_time_us":647064}
I20260709 12:14:30.918977  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.923053  3306 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:31.037452  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 114501us
I20260709 12:14:30.898532  6206 consensus_queue.cc:1243] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer 6f0cdd57c5934921829c205d32b2b8a5 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:31.042750  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:30.984197  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 60730.8us
W20260709 12:14:31.044227  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.045056  3896 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:30.952258  6596 log.cc:927] Time spent T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.060s	user 0.002s	sys 0.000s
I20260709 12:14:30.922377  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.897184  3341 raft_consensus.cc:1275] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:31.009250  3267 rpcz_store.cc:276] 0709 12:14:29.023639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.614959 (+591320us) service_pool.cc:224] Handling call
0709 12:14:30.683821 (+1068862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:30.726118 (+ 42297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.852993 (+126875us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540046f0d0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:30.853185 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457076096}
I20260709 12:14:31.023219  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:31.031620  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:31.033090  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:31.038272  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:30.919307  6509 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:31.076508  3926 raft_consensus.cc:2410] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:30.920230  6518 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.015518  3929 rpcz_store.cc:276] 0709 12:14:29.072887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.073171 (+   284us) service_pool.cc:224] Handling call
0709 12:14:29.073530 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.183847 (+110317us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:29.471180 (+287333us) log.cc:844] Serialized 14 byte log entry
0709 12:14:30.478782 (+1007602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:30.478834 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:30.478876 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.856681 (+377805us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54005b27d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:30.856740 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.856912 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":699148,"prepare.queue_time_us":407122,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":724415,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":45107,"spinlock_wait_cycles":253070080,"thread_start_us":603204,"threads_started":2,"wal-append.queue_time_us":607291}
I20260709 12:14:30.910979  6324 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
W20260709 12:14:31.082535  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 45782.2us
I20260709 12:14:31.087893  3932 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:14:30.884946  6557 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:14:31.094342  3932 pending_rounds.cc:85] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Aborting all ops after (but not including) 7
I20260709 12:14:31.094770  3932 pending_rounds.cc:107] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:14:31.095149  3932 raft_consensus.cc:2889] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:30.921933  6438 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:30.921420  6582 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.177s
I20260709 12:14:31.014935  6358 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.950109  6333 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:31.102273  3895 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:31.102494  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.106586  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:31.079890  6502 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:31.090005  6443 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:31.090430  6509 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:31.131038  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.105377  6324 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:31.126013  6600 log.cc:927] Time spent T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:14:31.049799  6453 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:31.122191  6588 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.101459  6206 consensus_queue.cc:1048] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:14:31.108337  6540 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:14:31.113763  6412 consensus_queue.cc:1048] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:14:30.924656  6489 consensus_queue.cc:237] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:31.150789  3231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.011s	sys 0.010s
I20260709 12:14:31.132824  6556 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:31.134061  6443 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.153900  6443 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.108954  6518 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:31.151770  3231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.011s	sys 0.010s
I20260709 12:14:31.137429  6509 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.141026  6517 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:31.157743  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 559248us
I20260709 12:14:31.124990  6333 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:31.145761  6588 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:31.158974  3263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.007s	sys 0.016s
W20260709 12:14:31.193819  3263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.007s	sys 0.016s
W20260709 12:14:31.205168  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 167035us
I20260709 12:14:31.182998  3231 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:31.217366  3931 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.005s	sys 0.023s
W20260709 12:14:31.217748  3931 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.005s	sys 0.023s
W20260709 12:14:31.228400  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 154754us
W20260709 12:14:31.232292  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.205125  6588 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.236358  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.214646  6438 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:31.234022  6303 consensus_meta.cc:287] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.500s	user 0.004s	sys 0.005s
I20260709 12:14:31.258404  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:31.244410  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:31.245807  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:31.246853  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 130622us
I20260709 12:14:31.256881  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:31.270085  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:31.274535  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:31.242800  6517 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.297452  3306 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:31.242188  5949 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:31.247915  6501 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:31.273214  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:31.304679  3184 raft_consensus.cc:1240] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:14:31.256429  6452 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:31.242890  6604 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:31.305621  3306 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:31.256134  6438 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.274348  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:31.238122  6562 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:31.311036  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 301803us
W20260709 12:14:31.320932  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 137985us
I20260709 12:14:31.283854  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:31.345592  3231 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:31.291085  6508 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:31.331076  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:31.346485  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.346809  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.346971  3186 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:31.239876  6564 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.355449  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.356052  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.358045  3231 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:31.264505  6303 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:31.308511  6587 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.364985  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.365406  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.359133  3231 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:31.377080  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:31.378152  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.364233  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:31.366798  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.380203  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.381230  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.383908  3895 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:31.384007  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.384819  3335 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:31.389863  3186 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:31.393844  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:31.406370  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.343899  6447 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.413120  6629 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:31.348079  6604 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:31.416118  6303 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:31.417243  6608 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:31.419727  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.393679  6501 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 12:14:31.423072  6611 log.cc:927] Time spent T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:14:31.424597  6610 log.cc:927] Time spent T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:14:31.424719  6622 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.494259  6452 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.374984  6564 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:31.429666  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.520031  3341 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:31.430831  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.521685  3336 raft_consensus.cc:2368] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:31.431526  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:31.351315  6438 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:31.359124  6616 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.432731  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.306813  6517 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:31.474504  6594 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:31.480134  6562 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:31.484133  6617 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:31.485374  6518 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:31.486270  6481 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:31.461206  6499 consensus_meta.cc:287] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.990s	user 0.005s	sys 0.007s
I20260709 12:14:31.460340  6453 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:31.425235  6603 log.cc:927] Time spent T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
I20260709 12:14:31.494279  6622 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.477272  6608 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.524842  3339 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:14:31.583125  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.592370  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:31.584573  3260 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:31.529837  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.595314  3266 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:31.546604  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 248556us
W20260709 12:14:31.563781  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 204692us
I20260709 12:14:31.547887  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:31.596908  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 493905us
I20260709 12:14:31.602094  3333 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:31.594889  3336 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:31.602715  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.603884  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:31.612747  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.613129  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:31.606410  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:31.614593  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:31.615199  3260 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:31.600167  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.599018  3231 leader_election.cc:400] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:31.617059  3231 leader_election.cc:403] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:31.504797  6508 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:31.618625  3898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.015s
I20260709 12:14:31.619501  3231 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:31.619716  3266 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:31.505626  6452 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:31.576395  6611 log.cc:927] Time spent T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:14:31.624840  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.630916  3336 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
W20260709 12:14:31.623756  3898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.000s	sys 0.015s
I20260709 12:14:31.592685  5997 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.627645  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.519480  6333 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:31.596321  6608 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:31.596504  6622 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.627008  6452 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.615906  6604 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:31.639372  3931 raft_consensus.cc:1217] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Deduplicated request from leader. Original: 6.5->[6.6-6.6]   Dedup: 6.6->[]
I20260709 12:14:31.621783  5949 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.625926  6247 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.687032  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:31.687368  3931 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 12:14:31.680182  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 56116.5us
I20260709 12:14:31.594599  6617 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:31.700623  6617 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:31.623231  6562 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.713421  6617 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:31.692549  6447 consensus_queue.cc:1059] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:14:31.717347  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 85634.8us
W20260709 12:14:31.719161  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 99751.6us
I20260709 12:14:31.720125  3231 leader_election.cc:400] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8.
I20260709 12:14:31.721037  3231 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:31.622186  6621 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:14:31.723384  3231 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:31.715574  5949 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:31.681473  6333 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:14:31.641230  5997 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:31.722023  6626 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:31.728808  6604 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:31.680805  6632 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:31.740563  3305 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:31.735535  3266 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:31.629061  6499 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 12:14:31.787597  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:31.788430  3338 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:14:31.717600  6611 log.cc:927] Time spent T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:14:31.787137  3895 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:31.799926  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:31.800778  3191 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 2.
I20260709 12:14:31.802518  3187 raft_consensus.cc:1240] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:14:31.804054  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:31.804872  3186 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:31.806011  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:31.807868  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:31.742641  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.612115  6481 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:31.754086  3260 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: [6.5-6.6]
I20260709 12:14:31.812846  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:31.758430  6527 consensus_meta.cc:287] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 1.011s	user 0.010s	sys 0.003s
I20260709 12:14:31.759922  5997 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:31.761339  6374 raft_consensus.cc:3055] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:31.764770  6562 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:31.775910  6632 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:31.777616  6564 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:31.779533  6635 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:31.781630  5949 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:31.782183  6633 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:31.634676  6508 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:31.839721  3335 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:31.784859  6617 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:31.789494  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 49025.6us
I20260709 12:14:31.792272  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:31.794979  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 76197.3us
I20260709 12:14:31.842680  3926 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:31.842742  3305 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:31.796258  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.812206  6631 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.723206  6247 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:31.731217  6569 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:31.807199  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:31.811093  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:31.855939  3192 raft_consensus.cc:2393] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:31.813855  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:31.857414  3260 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.823803  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:31.858572  3268 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.741606  6315 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:31.825778  6333 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:31.817673  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.817020  3156 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:31.759840  6517 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:31.822206  3895 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:31.839484  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.873682  3339 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
W20260709 12:14:31.873687  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 51539.5us
I20260709 12:14:31.752117  6303 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:31.875767  6303 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:31.795285  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:31.844233  3261 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:14:31.787552  6563 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:31.739784  6634 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:31.844019  3232 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:31.879017  6303 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:31.847290  3305 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:31.847450  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:31.815323  6619 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:31.853514  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.817898  6374 raft_consensus.cc:740] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:31.824962  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:31.912724  3193 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.865312  3335 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:31.819240  6481 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:31.812618  6501 consensus_queue.cc:1059] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:14:31.813925  6465 consensus_queue.cc:1059] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:14:31.814469  6618 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.891965  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:31.900326  6588 consensus_meta.cc:287] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.000s
W20260709 12:14:31.903021  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 55806.5us
I20260709 12:14:31.850692  6642 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:31.855208  6447 raft_consensus.cc:2804] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:31.826452  6527 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:31.880517  6358 consensus_meta.cc:287] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.754s	user 0.009s	sys 0.002s
I20260709 12:14:31.888489  3895 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:31.866935  6569 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:31.839869  6635 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:31.844856  6633 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:31.855509  6631 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:31.956322  3260 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:32.072074  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:32.072913  3260 raft_consensus.cc:2393] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 10: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:32.073498  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:32.033901  3268 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:32.075206  3305 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:32.075878  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:31.915318  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:32.051283  3193 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:14:31.885571  5949 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:31.960711  6303 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:32.030093  6324 consensus_meta.cc:287] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.885s	user 0.011s	sys 0.000s
W20260709 12:14:31.986251  6443 consensus_meta.cc:287] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.832s	user 0.013s	sys 0.000s
W20260709 12:14:31.996318  6645 log.cc:927] Time spent T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:14:32.105772  3185 raft_consensus.cc:2368] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:32.086189  3305 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:32.082195  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 110648us
W20260709 12:14:32.084303  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 195924us
W20260709 12:14:32.059732  6509 consensus_meta.cc:287] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.855s	user 0.012s	sys 0.000s
I20260709 12:14:31.903378  6617 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.892313  6644 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:32.025617  6640 log.cc:927] Time spent T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:14:32.112339  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:31.904021  6626 raft_consensus.cc:697] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:31.881055  6333 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:31.916049  6114 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.960189  6643 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:32.056435  6604 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.982191  6616 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:31.979308  6612 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.972074  6613 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.971995  6517 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.135408  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:31.912647  6634 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.246606  3260 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:32.125180  3268 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
W20260709 12:14:32.182348  3232 leader_election.cc:336] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.508s (SENT)
I20260709 12:14:32.248049  3232 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:32.249161  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 66843.5us
I20260709 12:14:32.076493  6447 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:32.106213  6499 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:31.911948  6438 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.041328  6563 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.109726  6579 raft_consensus.cc:2804] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:32.189224  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:32.106061  6465 consensus_queue.cc:1243] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer 6f0cdd57c5934921829c205d32b2b8a5 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:14:32.201148  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 86674us
I20260709 12:14:32.078644  6618 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:31.959991  6406 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.216s
I20260709 12:14:32.313818  3190 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.134919  5949 raft_consensus.cc:697] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:31.996767  6452 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.081537  6588 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.175304  6617 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.915467  6506 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.272s
I20260709 12:14:32.177385  6632 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.263598  6508 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:32.215337  6442 consensus_meta.cc:287] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 1.172s	user 0.007s	sys 0.006s
I20260709 12:14:32.305797  6579 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:32.257951  6612 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.264966  6553 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:32.429425  3340 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
W20260709 12:14:32.266381  6639 log.cc:927] Time spent T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
I20260709 12:14:32.081664  6358 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.116174  6303 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.265977  6597 raft_consensus.cc:2804] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:32.298581  3334 raft_consensus.cc:2410] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:32.036650  6374 consensus_queue.cc:260] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.117561  6443 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.174306  6509 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.259173  6447 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:32.280032  6564 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:32.267769  6247 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.355357  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:32.260221  3232 leader_election.cc:336] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.541s (SENT)
I20260709 12:14:32.313472  6618 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.117727  6324 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:32.327960  6654 log.cc:927] Time spent T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
I20260709 12:14:32.084131  6642 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.269309  6517 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.352969  6617 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.244419  6604 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:14:32.241161  6643 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.427472  6579 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:32.427173  6508 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:32.458547  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 341935us
I20260709 12:14:32.306035  6563 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.430025  6553 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.465269  3930 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:32.444980  6592 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:32.469684  6655 log.cc:927] Time spent T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 12:14:32.358909  5997 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:14:32.474170  3923 raft_consensus.cc:2393] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 9: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
W20260709 12:14:32.458851  6648 log.cc:927] Time spent T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.291s	user 0.000s	sys 0.003s
I20260709 12:14:32.426705  6442 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.449839  6597 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:32.186555  6644 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.263880  6613 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.464617  6438 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.422593  6482 consensus_queue.cc:260] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.492837  6553 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.491009  6527 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.494298  6569 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.354087  6626 consensus_queue.cc:237] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.579376  6597 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:32.622201  6633 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.580375  6631 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.554963  6499 raft_consensus.cc:697] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:32.489641  6637 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.291s
I20260709 12:14:32.496027  6508 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.500962  6592 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:32.638355  6659 log.cc:927] Time spent T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
W20260709 12:14:32.638989  6656 log.cc:927] Time spent T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 12:14:32.638702  6499 consensus_queue.cc:237] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.639707  6508 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.647513  6563 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.647699  6642 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.650601  6612 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.647687  6643 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:32.652094  6608 consensus_meta.cc:287] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.930s	user 0.008s	sys 0.003s
I20260709 12:14:32.652536  6608 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.654636  6608 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.632045  6635 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:32.656196  6653 log.cc:927] Time spent T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:14:32.657183  6592 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:32.664765  6644 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.665477  6618 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.659685  6634 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.661265  6617 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.664317  6613 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:32.668316  6622 consensus_meta.cc:287] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.974s	user 0.012s	sys 0.000s
I20260709 12:14:32.669024  6617 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.668879  6622 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:32.698860  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.353718  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 536741us
I20260709 12:14:32.705468  3156 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:32.457845  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 197652us
I20260709 12:14:32.467198  3260 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.722150  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:32.717334  3264 raft_consensus.cc:1240] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 3. Current term is 5. Ops: []
I20260709 12:14:32.725448  3265 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:32.726699  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:32.728138  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 236016us
I20260709 12:14:32.728713  3342 raft_consensus.cc:1240] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:32.729787  3338 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:32.731563  3156 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:32.738567  3260 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:32.655601  6588 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.784407  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55426 (request call id 603) took 1951 ms. Trace:
I20260709 12:14:32.784634  6644 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:32.784785  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.784961  3923 rpcz_store.cc:276] 0709 12:14:30.833106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.050356 (+217250us) service_pool.cc:224] Handling call
0709 12:14:32.783725 (+1733369us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54005b3454. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:32.784102 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3120192768}
I20260709 12:14:32.787667  6644 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.788427  6644 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.789227  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55426 (request call id 604) took 1002 ms. Trace:
I20260709 12:14:32.789640  3930 rpcz_store.cc:276] 0709 12:14:31.786354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.786894 (+   540us) service_pool.cc:224] Handling call
0709 12:14:31.787174 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.495715 (+708541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.788703 (+292988us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54005b27d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:32.789040 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558900608}
I20260709 12:14:32.745044  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:32.745976  6324 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:14:32.746901  6509 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:32.598767  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 291822us
I20260709 12:14:32.661371  6604 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.472198  5949 consensus_queue.cc:237] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:32.750144  6502 consensus_meta.cc:287] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 1.615s	user 0.013s	sys 0.001s
I20260709 12:14:32.750643  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:32.620337  6438 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.714948  3190 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:32.671550  6622 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.760834  6442 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.768905  6443 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.772764  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 659) took 1252 ms. Trace:
I20260709 12:14:32.803684  3262 rpcz_store.cc:276] 0709 12:14:31.520248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.520797 (+   549us) service_pool.cc:224] Handling call
0709 12:14:32.771374 (+1250577us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b58001c3898. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:14:32.771769 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.772180 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.772205 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:32.772264 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:32.772369 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.772424 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.772574 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54535424}
I20260709 12:14:32.776487  6358 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.778245  6517 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.779280  6452 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.808007  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:32.808854  3262 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 2.
I20260709 12:14:32.809330  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2144) took 1007 ms. Trace:
I20260709 12:14:32.778764  6579 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.809835  6502 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:32.792366  6644 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.792517  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2134) took 1035 ms. Trace:
I20260709 12:14:32.811403  3260 rpcz_store.cc:276] 0709 12:14:31.756617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.308391 (+551774us) service_pool.cc:224] Handling call
0709 12:14:32.792243 (+483852us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b5400421654. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:32.792401 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22544640}
I20260709 12:14:32.811822  6579 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.813542  3260 raft_consensus.cc:1275] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:14:32.785214  6642 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:32.814355  6642 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:32.814904  6642 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:32.784533  6643 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.817708  6643 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.792796  6303 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.813694  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:32.809612  3262 rpcz_store.cc:276] 0709 12:14:31.801505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.807585 (+1006080us) service_pool.cc:224] Handling call
0709 12:14:32.809277 (+  1692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.834779  6618 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.835893  3339 raft_consensus.cc:1240] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:32.838399  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:32.839395  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:32.856827  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 125642us
I20260709 12:14:32.857760  6597 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.813470  6438 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.859138  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2131) took 1078 ms. Trace:
I20260709 12:14:32.863538  3260 rpcz_store.cc:276] 0709 12:14:31.755808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.812627 (+1056819us) service_pool.cc:224] Handling call
0709 12:14:32.813079 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.833919 (+ 20840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.834193 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.872788  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2132) took 1116 ms. Trace:
I20260709 12:14:32.873282  3262 rpcz_store.cc:276] 0709 12:14:31.756058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.850264 (+1094206us) service_pool.cc:224] Handling call
0709 12:14:32.872047 (+ 21783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.872388 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.872423 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:32.872491 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:32.872526 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.872578 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.872701 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.875406  6597 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.876497  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:32.877341  3336 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:32.863296  6644 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.880182  3930 raft_consensus.cc:1240] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:32.879943  6644 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.882089  3265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2145) took 1065 ms. Trace:
I20260709 12:14:32.883078  3265 rpcz_store.cc:276] 0709 12:14:31.801825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.805244 (+1003419us) service_pool.cc:224] Handling call
0709 12:14:32.867044 (+ 61800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.885032  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:32.888584  6527 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.889007  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:32.889458  6527 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.890347  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:32.891594  6579 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:14:32.894860  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 862357us
I20260709 12:14:32.896041  3896 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:32.894237  6579 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:32.897112  6412 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:32.897337  6579 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:32.899739  3156 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:32.903863  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:32.912410  6303 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.913298  6303 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.915848  6588 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:32.918416  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:32.916056  6517 consensus_queue.cc:1059] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:32.922062  6499 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:32.905465  6669 consensus_queue.cc:1059] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:32.924566  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:32.924932  6669 raft_consensus.cc:3055] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:32.925346  6669 raft_consensus.cc:740] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:32.926456  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:32.928409  6642 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:32.930502  3232 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.677s (SENT)
I20260709 12:14:32.931042  3232 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:32.921178  6303 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.921466  6569 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:32.922183  3265 pending_rounds.cc:85] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 5
I20260709 12:14:32.931733  6452 consensus_queue.cc:1059] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:32.932737  6622 consensus_queue.cc:1059] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:32.933673  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:32.932781  6642 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.920902  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:32.946996  6622 raft_consensus.cc:3055] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:32.950366  6556 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:32.909114  6438 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:32.951644  6438 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.944294  3265 pending_rounds.cc:107] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:14:32.947207  6604 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:32.956199  3260 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:32.962332  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2137) took 1202 ms. Trace:
I20260709 12:14:32.962890  3260 rpcz_store.cc:276] 0709 12:14:31.757394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.870861 (+1113467us) service_pool.cc:224] Handling call
0709 12:14:32.944027 (+ 73166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.959502 (+ 15475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.959681 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.949625  6622 raft_consensus.cc:740] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:32.956606  3265 raft_consensus.cc:2889] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:32.968353  6569 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.970036  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:32.970665  6569 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.971391  6643 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.972076  3334 raft_consensus.cc:1240] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:32.972700  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:32.974489  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 624) took 1693 ms. Trace:
I20260709 12:14:32.978464  6490 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:32.983045  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 83444.9us
I20260709 12:14:32.984005  3156 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:32.984483  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:32.985806  3156 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:32.986569  3340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58568 (request call id 2179) took 1606 ms. Trace:
I20260709 12:14:32.986730  6517 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:32.988569  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2130) took 1233 ms. Trace:
I20260709 12:14:32.988996  3261 rpcz_store.cc:276] 0709 12:14:31.755490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.755598 (+   108us) service_pool.cc:224] Handling call
0709 12:14:31.755997 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:31.880880 (+124883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.988008 (+1107128us) spinlock_profiling.cc:243] Waited 88 ms on lock 0x7b54003f07d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:32.988374 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202310528}
I20260709 12:14:32.990533  6644 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.990883  6206 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:32.991537  6206 raft_consensus.cc:697] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:32.993830  6206 consensus_queue.cc:237] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:32.997414  6622 consensus_queue.cc:260] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:32.967801  6527 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:32.926486  6669 consensus_queue.cc:260] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:33.009106  6669 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:33.014844  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:33.015069  6588 consensus_queue.cc:1059] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:33.016182  6588 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:33.013597  6579 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:33.017256  6499 raft_consensus.cc:3055] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:33.017751  6499 raft_consensus.cc:740] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:14:33.019551  6315 consensus_meta.cc:287] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 1.089s	user 0.004s	sys 0.017s
I20260709 12:14:33.020030  6315 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:33.021915  6490 raft_consensus.cc:697] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:33.022749  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:32.987051  3340 rpcz_store.cc:276] 0709 12:14:31.380374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.406066 (+ 25692us) service_pool.cc:224] Handling call
0709 12:14:32.986139 (+1580073us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001d79d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:32.986327 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2350683008}
I20260709 12:14:32.999145  6622 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.038612  6594 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:33.023085  6490 consensus_queue.cc:237] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:33.049121  6556 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:33.049640  6556 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:33.053396  6438 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:33.039217  6594 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:33.018824  6499 consensus_queue.cc:260] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:33.056785  6630 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.057548  6630 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:33.019032  6579 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:33.086923  6630 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:32.979403  3932 rpcz_store.cc:276] 0709 12:14:31.267344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.267578 (+   234us) service_pool.cc:224] Handling call
0709 12:14:31.267978 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:31.268433 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:31.268474 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:31.269006 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 12:14:32.805194 (+1536188us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b18003a2100. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4c2e07 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1aee16720b 00007f1aee16cd23 00007f1aee16d0d1 00007f1aee588a0f
0709 12:14:32.944084 (+138890us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:32.946057 (+  1973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.949319 (+  3262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:32.949359 (+    40us) raft_consensus.cc:1685] finished
0709 12:14:32.949369 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.960742 (+ 11373us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":26840,"spinlock_wait_cycles":6998784,"thread_start_us":93665,"threads_started":1,"wal-append.queue_time_us":1642797}
W20260709 12:14:33.088610  6652 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.776s	user 0.003s	sys 0.000s
I20260709 12:14:33.092070  6553 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:33.095266  3923 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:33.096540  6553 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:33.125942  3261 raft_consensus.cc:2368] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7.
I20260709 12:14:33.127329  3336 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:33.093556  6499 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:33.146147  3260 raft_consensus.cc:1275] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:33.418679  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2142) took 1617 ms. Trace:
I20260709 12:14:33.419100  3260 rpcz_store.cc:276] 0709 12:14:31.800823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.966716 (+1165893us) service_pool.cc:224] Handling call
0709 12:14:33.128370 (+161654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.418320 (+289950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.418588 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.282311  3259 raft_consensus.cc:1240] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:33.382640  3266 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
W20260709 12:14:33.346095  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 358689us
W20260709 12:14:33.292294  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:33.214272  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 283930us
I20260709 12:14:33.287338  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55438 (request call id 848) took 1440 ms. Trace:
W20260709 12:14:33.275671  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.204444  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:33.463172  3259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 658) took 1975 ms. Trace:
I20260709 12:14:33.427117  3924 rpcz_store.cc:276] 0709 12:14:31.846956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.847133 (+   177us) service_pool.cc:224] Handling call
0709 12:14:33.286714 (+1439581us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54006784d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:33.287043 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2332114688}
W20260709 12:14:33.284225  6646 log.cc:927] Time spent T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 1.177s	user 0.007s	sys 0.009s
W20260709 12:14:33.276834  3231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.527s (SENT) [suppressed 51 similar messages]
I20260709 12:14:33.463913  3259 rpcz_store.cc:276] 0709 12:14:31.487881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.488671 (+   790us) service_pool.cc:224] Handling call
0709 12:14:33.281125 (+1792454us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b58001c3898. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:14:33.281612 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:33.421513 (+139901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.463080 (+ 41567us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61950336}
I20260709 12:14:33.475908  3337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 2163) took 2130 ms. Trace:
I20260709 12:14:33.476334  3337 rpcz_store.cc:276] 0709 12:14:31.345503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.345682 (+   179us) service_pool.cc:224] Handling call
0709 12:14:31.346000 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:31.346298 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:31.346322 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:31.357685 (+ 11363us) log.cc:844] Serialized 26 byte log entry
0709 12:14:31.769985 (+412300us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b18002464c0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4c2e07 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1aee16720b 00007f1aee16cd23 00007f1aee16d0d1 00007f1aee588a0f
0709 12:14:31.882035 (+112050us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:31.912252 (+ 30217us) log.cc:844] Serialized 14 byte log entry
0709 12:14:31.912462 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.912534 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:33.032749 (+1120215us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b18002464c0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
0709 12:14:33.283049 (+250300us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:33.475501 (+192452us) raft_consensus.cc:1685] finished
0709 12:14:33.475523 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:33.475724 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1174,"prepare.queue_time_us":30225,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":7189,"raft.queue_time_us":5081,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":44810,"spinlock_wait_cycles":120710528,"thread_start_us":111873,"threads_started":1,"wal-append.queue_time_us":641960}
I20260709 12:14:33.478776  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:33.220964  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:33.482620  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:33.148921  6447 consensus_meta.cc:287] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.678s	user 0.007s	sys 0.006s
I20260709 12:14:33.548813  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:33.306900  6616 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.481524  6517 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:33.150990  6556 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:33.584771  3157 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:33.594867  3931 raft_consensus.cc:2410] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:33.615836  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:33.636740  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 170443us
W20260709 12:14:33.638844  6669 consensus_meta.cc:287] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.005s
I20260709 12:14:33.639827  3333 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:33.640291  3336 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 3.
I20260709 12:14:33.650153  6206 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:33.585222  6604 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:33.663859  6206 raft_consensus.cc:697] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:14:33.665603  3185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40510 (request call id 2028) took 1868 ms (client timeout 1561 ms). Trace:
I20260709 12:14:33.665748  6206 consensus_queue.cc:237] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:33.668620  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:33.666468  3185 rpcz_store.cc:269] 0709 12:14:31.796907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.805722 (+  8815us) service_pool.cc:224] Handling call
0709 12:14:33.655559 (+1849837us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54002f4254. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:33.665262 (+  9703us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687308032}
I20260709 12:14:33.656637  3335 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:33.696708  6315 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.697553  6315 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:33.702451  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.700757  6315 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:33.713174  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:33.721683  3157 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:33.582765  6447 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:33.724102  6556 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:33.724550  3157 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:33.740737  3157 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:33.725188  6489 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:33.741545  3336 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:33.742100  6517 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:33.742338  3340 raft_consensus.cc:1240] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:33.742489  6517 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.742910  6517 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.726500  3192 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:33.727947  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:33.730777  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:33.732234  6452 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:33.733134  3232 leader_election.cc:336] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.589s (SENT)
I20260709 12:14:33.746888  3184 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:33.747802  6452 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:33.749979  6452 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:33.753034  3232 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:33.741837  6489 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:33.751295  6622 consensus_meta.cc:287] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.718s	user 0.006s	sys 0.009s
I20260709 12:14:33.772819  6489 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:33.773370  6604 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:33.787298  6408 raft_consensus.cc:3055] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:33.787640  6481 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:33.787803  6408 raft_consensus.cc:740] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:33.788090  6481 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.788493  6481 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:33.788895  6408 consensus_queue.cc:260] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:33.701467  6616 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:33.744513  6447 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:33.797700  3267 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
W20260709 12:14:33.827135  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 550467us
I20260709 12:14:33.808820  6452 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:33.821427  6408 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:33.844046  6594 consensus_meta.cc:287] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.790s	user 0.012s	sys 0.000s
I20260709 12:14:33.844512  6594 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:33.846733  6594 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:33.858338  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.821508  6612 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:33.863469  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 130356us
W20260709 12:14:33.857661  3156 connection.cc:256] RPC call timeout handler was delayed by -1.612953128999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 12:14:33.851445  6481 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:33.873224  3156 connection.cc:256] RPC call timeout handler was delayed by -1.5103531289998955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
I20260709 12:14:33.884713  6482 raft_consensus.cc:3060] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:33.867180  6612 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:33.889693  6612 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:33.890502  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:33.891103  3266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2133) took 2134 ms. Trace:
I20260709 12:14:33.891477  3260 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:33.891551  3266 rpcz_store.cc:276] 0709 12:14:31.756355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.756564 (+   209us) service_pool.cc:224] Handling call
0709 12:14:33.890867 (+2134303us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000cfb54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:33.891018 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2776127744}
W20260709 12:14:33.893128  3190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40510 (request call id 2030) took 2095 ms (client timeout 1527 ms). Trace:
I20260709 12:14:33.894256  3262 raft_consensus.cc:1240] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:14:33.876618  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:33.893514  3190 rpcz_store.cc:269] 0709 12:14:31.797506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.807535 (+ 10029us) service_pool.cc:224] Handling call
0709 12:14:33.892941 (+2085406us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54000be854. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:33.893064 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1161893632}
I20260709 12:14:33.907904  6651 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:33.908177  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:33.909024  3190 raft_consensus.cc:2393] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:33.908861  6651 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:33.919610  3259 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
W20260709 12:14:33.926437  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 45524us
W20260709 12:14:33.935124  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 194513us
I20260709 12:14:33.942584  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:33.944169  3342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 806) took 2883 ms. Trace:
I20260709 12:14:33.944626  3190 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:14:33.944674  3342 rpcz_store.cc:276] 0709 12:14:31.060390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.060523 (+   133us) service_pool.cc:224] Handling call
0709 12:14:31.097031 (+ 36508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.729426 (+1632395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.925571 (+1196145us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54000c3ad4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:33.944090 (+ 18519us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3750926592}
W20260709 12:14:33.951017  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.936806  6651 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:33.963392  3268 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:33.964244  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:33.964933  3259 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
W20260709 12:14:33.966130  6679 log.cc:927] Time spent T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:14:33.970266  3334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 824) took 1070 ms. Trace:
I20260709 12:14:33.970607  3334 rpcz_store.cc:276] 0709 12:14:32.899893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.072655 (+172762us) service_pool.cc:224] Handling call
0709 12:14:33.130224 (+ 57569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:33.209471 (+ 79247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:33.209521 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:33.484283 (+274762us) log.cc:844] Serialized 26 byte log entry
0709 12:14:33.774739 (+290456us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:33.774822 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.774960 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:33.970055 (+195095us) raft_consensus.cc:1685] finished
0709 12:14:33.970074 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:33.970200 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58187,"raft.queue_time_us":69125,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":158,"thread_start_us":152916,"threads_started":1,"wal-append.queue_time_us":242828}
W20260709 12:14:34.026803  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.104878  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.108305  3342 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:33.955592  6604 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:34.100359  6616 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:34.126828  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.106384  6517 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:34.137143  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:34.141989  6680 log.cc:927] Time spent T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:14:34.141882  6626 raft_consensus.cc:3055] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:14:34.142576  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.142714  6626 raft_consensus.cc:740] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:34.143570  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.143769  6626 consensus_queue.cc:260] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.144296  3260 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:34.144899  6626 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:34.153869  3267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40120 (request call id 657) took 2666 ms (client timeout 2051 ms). Trace:
W20260709 12:14:34.154366  3267 rpcz_store.cc:269] 0709 12:14:31.487258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.487391 (+   133us) service_pool.cc:224] Handling call
0709 12:14:33.220610 (+1733219us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b58001c3898. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:34.153649 (+933039us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54003d3bd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:34.153782 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543298688}
I20260709 12:14:34.156793  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 665) took 2374 ms. Trace:
I20260709 12:14:34.157578  3259 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.159390  6632 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.159996  6632 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.160449  3333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2182) took 1108 ms. Trace:
I20260709 12:14:34.161053  3333 rpcz_store.cc:276] 0709 12:14:33.051817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.676853 (+625036us) service_pool.cc:224] Handling call
0709 12:14:33.772618 (+ 95765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.833989 (+ 61371us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:33.937240 (+103251us) log.cc:844] Serialized 14 byte log entry
0709 12:14:34.159648 (+222408us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.159699 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:34.159754 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.160260 (+   506us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.160375 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":278107,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":2748,"raft.queue_time_us":1568,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":304865,"threads_started":2}
I20260709 12:14:34.163975  3189 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:34.157191  3262 rpcz_store.cc:276] 0709 12:14:31.782472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.874279 (+1091807us) service_pool.cc:224] Handling call
0709 12:14:33.894023 (+1019744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:33.894627 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.156586 (+261959us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000cfb50. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:34.156733 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344197376}
I20260709 12:14:34.170699  3268 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
W20260709 12:14:34.171175  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 52996.1us
I20260709 12:14:34.171135  6489 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:34.173274  3190 raft_consensus.cc:1240] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:14:34.173623  6489 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:34.174350  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:34.175143  3184 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:34.176235  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:34.177026  3186 raft_consensus.cc:2393] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 8: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:34.177203  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:34.177933  3192 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.178957  3184 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:34.178122  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:34.140857  6481 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:34.166971  6465 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.249s
I20260709 12:14:34.208515  3263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 656) took 2771 ms. Trace:
I20260709 12:14:34.208981  3263 rpcz_store.cc:276] 0709 12:14:31.436647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.471504 (+ 34857us) service_pool.cc:224] Handling call
0709 12:14:31.545116 (+ 73612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.545408 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:31.602292 (+ 56884us) log.cc:844] Serialized 14 byte log entry
0709 12:14:34.101754 (+2499462us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b180027be00. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4c2e07 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1aee16720b 00007f1aee16cd23 00007f1aee16d23a 00007f1aee5d7a2a
0709 12:14:34.193463 (+ 91709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.208028 (+ 14565us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:34.208083 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.208179 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.208340 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56696,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3454,"raft.queue_time_us":22398,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":147,"spinlock_wait_cycles":27334272,"thread_start_us":31606,"threads_started":1,"wal-append.queue_time_us":2595114}
I20260709 12:14:34.215265  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.221148  3268 raft_consensus.cc:2393] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:34.223063  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.224251  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.224550  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.224637  3263 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:34.223881  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.225061  3260 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:34.225278  3267 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:34.225701  3262 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:34.226281  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.227041  3266 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:34.228955  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.230239  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.230286  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.231324  3262 raft_consensus.cc:2410] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:34.231446  3266 raft_consensus.cc:2393] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 5: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:34.232589  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.233659  3267 raft_consensus.cc:2393] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:34.235945  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.236397  3231 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:34.236652  3263 raft_consensus.cc:2376] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9. Re-sending same reply.
I20260709 12:14:34.237608  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.238770  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.241288  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.242214  3260 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:34.243119  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.243894  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.244380  3260 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.245203  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.243929  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.248243  3262 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:34.248852  3931 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:34.249274  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:34.249917  6676 log.cc:927] Time spent T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.460s	user 0.004s	sys 0.003s
I20260709 12:14:34.250097  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:34.250597  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.251523  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:34.251873  3262 raft_consensus.cc:2393] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 9: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:34.251713  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:34.252871  3262 raft_consensus.cc:1240] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:34.253232  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:34.254433  3338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52822 (request call id 819) took 2388 ms (client timeout 1601 ms). Trace:
I20260709 12:14:34.250947  3932 raft_consensus.cc:2368] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9.
W20260709 12:14:34.254822  3338 rpcz_store.cc:269] 0709 12:14:31.865907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.866040 (+   133us) service_pool.cc:224] Handling call
0709 12:14:34.254213 (+2388173us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b540035d4d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:34.254351 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1514252160}
I20260709 12:14:34.255682  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.255911  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:34.250963  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:34.258479  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:34.259685  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.259744  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.261230  6333 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:34.260438  3261 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:34.261837  6677 log.cc:927] Time spent T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.518s	user 0.001s	sys 0.004s
I20260709 12:14:34.252748  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.262796  3927 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:34.266109  6374 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:34.261420  3931 raft_consensus.cc:2410] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:34.267124  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.260392  3930 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:34.268103  3267 raft_consensus.cc:2393] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:34.271624  3265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2141) took 2471 ms. Trace:
I20260709 12:14:34.271798  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.273306  3334 raft_consensus.cc:3055] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:34.272063  3265 rpcz_store.cc:276] 0709 12:14:31.800506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.886898 (+1086392us) service_pool.cc:224] Handling call
0709 12:14:32.921871 (+ 34973us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:33.003899 (+ 82028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:33.003944 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:33.004838 (+   894us) log.cc:844] Serialized 52 byte log entry
0709 12:14:33.292217 (+287379us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:33.673892 (+381675us) log.cc:844] Serialized 14 byte log entry
0709 12:14:33.677238 (+  3346us) log.cc:844] Serialized 14 byte log entry
0709 12:14:33.677434 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.677521 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:34.248653 (+571132us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18001f9e40. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4ae2a6 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db
0709 12:14:34.249156 (+   503us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:34.271391 (+ 22235us) raft_consensus.cc:1685] finished
0709 12:14:34.271409 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.271566 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4372,"prepare.queue_time_us":692676,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":1488,"raft.queue_time_us":7731,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":19140,"spinlock_wait_cycles":129604608,"thread_start_us":495953,"threads_started":2,"wal-append.queue_time_us":673473}
I20260709 12:14:34.273691  3334 raft_consensus.cc:740] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:34.274653  3334 consensus_queue.cc:260] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:34.276001  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.276611  3338 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:34.276760  3260 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:34.277549  3334 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:34.279995  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.280314  6517 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:34.280536  3232 leader_election.cc:336] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.794s (SENT)
I20260709 12:14:34.280999  3232 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:34.281304  3264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2128) took 2527 ms. Trace:
I20260709 12:14:34.281813  6612 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:34.281738  3264 rpcz_store.cc:276] 0709 12:14:31.754270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.754395 (+   125us) service_pool.cc:224] Handling call
0709 12:14:31.754683 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.724038 (+969355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.281042 (+1557004us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b540048eed4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:34.281243 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2212277120}
I20260709 12:14:34.282547  6612 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.283805  6664 consensus_queue.cc:1059] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:34.284845  6612 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:34.285377  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.285454  6612 raft_consensus.cc:3055] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:14:34.285938  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.237529  6499 consensus_meta.cc:287] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.775s	user 0.010s	sys 0.002s
I20260709 12:14:34.283077  6682 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:34.287385  3337 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
W20260709 12:14:34.287925  3923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55426 (request call id 611) took 1365 ms (client timeout 1606 ms). Trace:
I20260709 12:14:34.285949  6612 raft_consensus.cc:740] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:14:34.288323  3923 rpcz_store.cc:269] 0709 12:14:32.922759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.942488 (+ 19729us) service_pool.cc:224] Handling call
0709 12:14:34.287692 (+1345204us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54006d01d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:34.287842 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278231808}
I20260709 12:14:34.289181  3337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58564 (request call id 2180) took 1258 ms. Trace:
I20260709 12:14:34.289558  3337 rpcz_store.cc:276] 0709 12:14:33.031258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.478517 (+447259us) service_pool.cc:224] Handling call
0709 12:14:34.288997 (+810480us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54001d6fd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:34.289118 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858175872}
I20260709 12:14:34.276553  3339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 821) took 2392 ms. Trace:
I20260709 12:14:34.290899  3339 rpcz_store.cc:276] 0709 12:14:31.883932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.884047 (+   115us) service_pool.cc:224] Handling call
0709 12:14:31.884371 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.862556 (+978185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.276327 (+1413771us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b540036d154. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:34.276497 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2183182208}
I20260709 12:14:34.291445  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.293613  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.294719  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.295606  6669 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:34.295954  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.291292  3189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47276 (request call id 482) took 3660 ms. Trace:
I20260709 12:14:34.296427  6669 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.297219  3189 rpcz_store.cc:276] 0709 12:14:30.630485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.631567 (+  1082us) service_pool.cc:224] Handling call
0709 12:14:30.631966 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.170278 (+3538312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.291019 (+120741us) spinlock_profiling.cc:243] Waited 3.53 s on lock 0x7b54002d41d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:34.291210 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8121571584}
I20260709 12:14:34.298203  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.280359  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.297572  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.299218  3266 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:34.283095  3306 leader_election.cc:400] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9.
I20260709 12:14:34.299671  3340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 827) took 1381 ms. Trace:
I20260709 12:14:34.299846  3306 leader_election.cc:403] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:14:34.300159  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.300472  6499 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.301198  3339 raft_consensus.cc:2393] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 12: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:34.302163  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.302877  3339 raft_consensus.cc:2393] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:34.300053  3340 rpcz_store.cc:276] 0709 12:14:32.917973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.027684 (+109711us) service_pool.cc:224] Handling call
0709 12:14:33.028207 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.742761 (+714554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.299405 (+556644us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b540035e8d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:34.299593 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1641886464}
I20260709 12:14:34.303049  3086 catalog_manager.cc:5697] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 4 to 8, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 8 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:34.303706  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.304463  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.305217  3340 raft_consensus.cc:2393] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:34.305173  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.306581  3261 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:34.306740  3086 catalog_manager.cc:5697] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 5 to 6, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 6 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:34.298856  3336 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:34.309883  3086 catalog_manager.cc:5697] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 4 to 7, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 7 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:34.311532  3263 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:34.311882  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.337604  3333 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:34.312462  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:34.314383  3087 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48764 (request call id 296) took 31642 ms (client timeout 15000 ms). Trace:
I20260709 12:14:34.315165  3266 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:34.298915  6669 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:34.316828  3338 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:34.320479  3192 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:34.287774  6682 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.321913  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.322225  3930 raft_consensus.cc:1240] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:34.322655  3259 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:34.322198  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:34.187151  6657 log.cc:927] Time spent T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 1.767s	user 0.007s	sys 0.024s
I20260709 12:14:34.333654  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.336077  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.324285  6604 raft_consensus.cc:2804] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:34.318295  6465 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.349236  3306 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:34.357791  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.359012  3192 raft_consensus.cc:1240] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:34.360252  3190 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:34.362912  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.363660  3336 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:34.364213  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.364295  3157 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:34.364962  3338 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:34.336800  6650 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:34.369176  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.372265  3157 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:34.373940  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:34.356010  6604 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:34.360893  6481 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:34.381146  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 144941us
W20260709 12:14:34.384159  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.384809  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 104314us
I20260709 12:14:34.380493  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.370019  6669 raft_consensus.cc:2804] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:34.391721  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.390295  3339 raft_consensus.cc:2393] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:34.393154  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.384274  6582 consensus_queue.cc:1059] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:14:34.394582  6683 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:34.395038  6683 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.395367  6683 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:34.365267  6482 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:34.367619  6465 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.406085  3190 raft_consensus.cc:1240] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:34.386358  6604 raft_consensus.cc:3060] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:34.408030  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.289573  6612 consensus_queue.cc:260] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.385558  6651 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:34.392102  6669 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.386010  6481 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:34.411758  3232 leader_election.cc:336] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.855s (SENT)
I20260709 12:14:34.416759  3232 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:34.420935  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:34.422710  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.424407  3337 raft_consensus.cc:2410] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:14:34.338503  3087 rpcz_store.cc:269] 0709 12:14:02.672013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.672632 (+   619us) service_pool.cc:224] Handling call
0709 12:14:34.314110 (+31641478us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:25.556037 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:25.736419 (+180382us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:25.736453 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:14:25.736470 (+    17us) tablet.cc:662] Decoding operations
0709 12:14:25.736848 (+   378us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:25.736920 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:25.736952 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:14:25.737141 (+   189us) tablet.cc:701] Row locks acquired
0709 12:14:25.737160 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:14:25.737306 (+   146us) write_op.cc:270] Start()
0709 12:14:25.737428 (+   122us) write_op.cc:276] Timestamp: P: 1783599265737258 usec, L: 0
0709 12:14:25.737452 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:14:25.738186 (+   734us) log.cc:844] Serialized 538 byte log entry
0709 12:14:26.085965 (+347779us) op_driver.cc:464] REPLICATION: finished
0709 12:14:26.313524 (+227559us) write_op.cc:301] APPLY: starting
0709 12:14:26.362905 (+ 49381us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:26.381197 (+ 18292us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:26.454382 (+ 73185us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:26.473501 (+ 19119us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:26.497123 (+ 23622us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:14:26.505309 (+  8186us) write_op.cc:312] APPLY: finished
0709 12:14:26.525072 (+ 19763us) log.cc:844] Serialized 23 byte log entry
0709 12:14:26.565245 (+ 40173us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:26.565334 (+    89us) write_op.cc:454] Released schema lock
0709 12:14:26.565391 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:26.567758 (+  2367us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:26.567810 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":209079,"apply.run_cpu_time_us":23023,"apply.run_wall_time_us":264259,"num_ops":1,"prepare.queue_time_us":285823,"prepare.run_cpu_time_us":3398,"prepare.run_wall_time_us":202811,"replication_time_us":315668,"thread_start_us":216060,"threads_started":2}]]}
I20260709 12:14:34.427105  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.429831  3337 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:34.420742  6651 raft_consensus.cc:697] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:34.432070  6651 consensus_queue.cc:237] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:34.432639  6499 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9.
I20260709 12:14:34.419993  6669 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:34.435372  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.451550  6612 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.437145  3339 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
W20260709 12:14:34.438277  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.441316  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.443918  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.456759  3932 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:34.441637  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.442026  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:34.457990  3930 raft_consensus.cc:2410] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:34.458714  3336 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
W20260709 12:14:34.459028  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 426117us
I20260709 12:14:34.436960  3086 catalog_manager.cc:5697] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:34.419891  6481 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:34.462821  3231 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:34.464599  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.461889  6579 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.471351  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.465544  3931 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:34.473801  6579 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:34.480053  3190 raft_consensus.cc:2468] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:34.480293  3340 raft_consensus.cc:1275] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:34.482298  6465 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:34.483510  6650 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:34.485091  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.485951  3336 raft_consensus.cc:2368] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:34.447329  6683 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:34.487254  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 78283.2us
I20260709 12:14:34.443089  6664 raft_consensus.cc:3055] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:34.417788  6482 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:34.489120  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.489677  6650 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:34.493866  3232 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.916s (SENT)
I20260709 12:14:34.495402  3190 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:14:34.494042  3338 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:34.499924  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.502146  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.500460  3334 raft_consensus.cc:1275] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:34.505471  6453 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:34.506963  6683 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:34.510432  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.511063  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.511777  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.512589  3337 raft_consensus.cc:2368] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:34.513414  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.514510  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.515015  3337 raft_consensus.cc:2376] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8. Re-sending same reply.
I20260709 12:14:34.515947  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.517000  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.518155  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.523825  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:34.524758  3189 raft_consensus.cc:2393] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 8: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:34.532228  3187 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:34.533335  6557 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.533923  6557 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.535055  6682 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:34.536768  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 847) took 2691 ms. Trace:
I20260709 12:14:34.537176  3926 rpcz_store.cc:276] 0709 12:14:31.844921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.854230 (+  9309us) service_pool.cc:224] Handling call
0709 12:14:31.854544 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:31.997552 (+143008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:31.997597 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:31.998198 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:14:32.107053 (+108855us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:32.171943 (+ 64890us) log.cc:844] Serialized 14 byte log entry
0709 12:14:32.224437 (+ 52494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.890419 (+665982us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18001216c0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e0522 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
0709 12:14:32.989362 (+ 98943us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400660154. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:32.989408 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:33.223418 (+234010us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b18001216c0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4ae2a6 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e0522 00007f1aeb4e27c1
0709 12:14:33.224936 (+  1518us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b18001216c0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e0522 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
0709 12:14:34.186323 (+961387us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:34.504924 (+318601us) raft_consensus.cc:1685] finished
0709 12:14:34.504957 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.536578 (+ 31621us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67610,"prepare.queue_time_us":69161,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":81927,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":18858,"spinlock_wait_cycles":320785280,"thread_start_us":58076,"threads_started":1,"wal-append.queue_time_us":218662}
I20260709 12:14:34.539736  6579 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:34.541507  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.541612  3335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 828) took 1623 ms. Trace:
W20260709 12:14:34.543618  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.543731  3341 raft_consensus.cc:1240] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:34.542272  3335 rpcz_store.cc:276] 0709 12:14:32.918309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.683031 (+764722us) service_pool.cc:224] Handling call
0709 12:14:33.739562 (+ 56531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:33.894602 (+155040us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:33.894649 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.116526 (+221877us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.360958 (+244432us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:34.361016 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.361129 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:34.541287 (+180158us) raft_consensus.cc:1685] finished
0709 12:14:34.541324 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.541528 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39696,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":14387,"thread_start_us":357562,"threads_started":2,"wal-append.queue_time_us":282980}
W20260709 12:14:34.544651  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 56631us
I20260709 12:14:34.546098  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.547395  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.533939  3337 raft_consensus.cc:3055] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:34.548820  3337 raft_consensus.cc:740] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:34.511875  3342 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:34.542805  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.550621  3340 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:34.552393  3231 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:34.491142  6664 raft_consensus.cc:740] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:34.496735  6650 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:34.555728  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.555343  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.555397  6517 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:14:34.561319  6482 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:34.566991  6664 consensus_queue.cc:260] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.569454  6632 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:34.570093  3086 catalog_manager.cc:5697] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 5 to 8, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 8 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:34.596516  6557 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:34.571201  6502 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:34.564607  3341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2186) took 1508 ms. Trace:
I20260709 12:14:34.494642  6669 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.598554  3341 rpcz_store.cc:276] 0709 12:14:33.055851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.686659 (+630808us) service_pool.cc:224] Handling call
0709 12:14:34.543535 (+856876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.544172 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.564390 (+ 20218us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b540038c2d0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:34.564523 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890162560}
I20260709 12:14:34.601274  6669 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:34.597879  3086 catalog_manager.cc:5697] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 3 to 5, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 5 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:34.602098  3192 raft_consensus.cc:1240] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:34.591318  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.593083  6465 consensus_queue.cc:1048] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:34.603291  3086 catalog_manager.cc:5697] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:14:34.594292  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 92867.1us
I20260709 12:14:34.596066  6453 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:34.598351  6502 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.587168  3333 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:34.617910  3268 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:34.631778  3231 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:34.640839  3337 consensus_queue.cc:260] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:34.643616  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.645824  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.651407  6453 raft_consensus.cc:697] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:34.652580  6453 consensus_queue.cc:237] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:34.654832  3191 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 10. Current term is 12. Ops: []
I20260709 12:14:34.656388  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.657047  3264 raft_consensus.cc:2376] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8. Re-sending same reply.
I20260709 12:14:34.657454  6502 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:34.657953  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.658174  3187 raft_consensus.cc:1240] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:34.659152  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.660197  3264 raft_consensus.cc:2410] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:14:34.660995  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.661177  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 852) took 1193 ms. Trace:
I20260709 12:14:34.661698  3264 raft_consensus.cc:2368] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5.
I20260709 12:14:34.661849  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.662617  3268 raft_consensus.cc:2368] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9.
I20260709 12:14:34.662952  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.662627  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.679986  6452 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:34.684365  6452 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.679962  6626 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:34.684877  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.684851  6452 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:34.685246  6626 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:34.661545  3924 rpcz_store.cc:276] 0709 12:14:33.468242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.442386 (+974144us) service_pool.cc:224] Handling call
0709 12:14:34.442815 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.443364 (+   549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.443397 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.443959 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.493056 (+ 49097us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:34.493101 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.493287 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:34.660946 (+167659us) raft_consensus.cc:1685] finished
0709 12:14:34.660964 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.661101 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1354,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":210,"thread_start_us":48643,"threads_started":1,"wal-append.queue_time_us":215226}
I20260709 12:14:34.668879  3265 raft_consensus.cc:2376] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4. Re-sending same reply.
W20260709 12:14:34.687067  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.679802  3232 leader_election.cc:336] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 2.171s (SENT)
I20260709 12:14:34.673609  3266 raft_consensus.cc:1275] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:34.671877  3337 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:34.687877  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.688802  3263 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:34.689951  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.692914  3232 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:34.693289  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.694500  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.695372  3259 raft_consensus.cc:2368] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9.
I20260709 12:14:34.696986  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.697991  3260 raft_consensus.cc:2368] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9.
I20260709 12:14:34.699398  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.693429  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.702616  3262 raft_consensus.cc:2368] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8.
I20260709 12:14:34.684370  3264 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:34.704223  3191 raft_consensus.cc:1240] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:34.705021  3265 raft_consensus.cc:2393] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 9: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:34.708861  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.683199  6664 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:34.715999  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.719148  3266 raft_consensus.cc:2368] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7.
I20260709 12:14:34.717466  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.716101  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:34.720502  3924 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:34.721771  3265 raft_consensus.cc:1240] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:34.715899  3086 catalog_manager.cc:5697] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:34.722074  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.725699  3086 catalog_manager.cc:5697] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 3 to 4, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 4 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:34.736198  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:34.772007  3262 raft_consensus.cc:2393] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:34.774672  6368 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:34.775235  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.738034  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:34.738085  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 58364.7us
I20260709 12:14:34.740733  3342 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:14:34.760192  3190 raft_consensus.cc:1240] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 7. Ops: []
I20260709 12:14:34.785036  3337 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:34.786999  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:34.787786  3931 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:34.790033  6650 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:34.791882  3264 raft_consensus.cc:1240] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 12:14:34.793686  3924 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
W20260709 12:14:34.739838  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 104116us
I20260709 12:14:34.796152  3306 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:34.757050  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.797777  3266 raft_consensus.cc:2368] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9.
W20260709 12:14:34.770486  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.801623  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:34.802994  3340 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 12.
W20260709 12:14:34.756719  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 211681us
I20260709 12:14:34.808343  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:34.757750  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:34.809427  3192 raft_consensus.cc:2410] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:34.808495  3157 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:34.811960  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.809736  3191 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:34.813553  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:34.815771  3895 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:34.817513  6502 raft_consensus.cc:2764] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:34.817168  6406 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:34.818882  3263 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:34.818787  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.824525  3264 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:34.817238  3895 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:34.826541  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:34.827353  3192 raft_consensus.cc:2410] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:34.823359  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:34.806571  6669 raft_consensus.cc:2804] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:34.832262  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:34.833724  3157 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:34.831771  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:34.829030  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:34.834645  3190 raft_consensus.cc:1275] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:34.836740  3184 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:34.842604  6631 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:14:34.841454  6490 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:34.847173  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.847826  3931 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:34.848323  3333 raft_consensus.cc:1240] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:34.824210  6465 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:34.853514  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:34.855087  6490 raft_consensus.cc:697] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 12 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:34.856925  6557 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:34.857403  6557 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.857069  6490 consensus_queue.cc:237] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:34.857786  6557 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.858989  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:34.859776  3191 raft_consensus.cc:2393] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:34.859766  6465 raft_consensus.cc:697] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:34.861819  6465 consensus_queue.cc:237] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:34.868654  6650 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:34.871793  6481 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.873950  6481 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:34.878796  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:34.879381  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.880409  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:34.882572  3896 connection.cc:256] RPC call timeout handler was delayed by -1.6459673589999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 12:14:34.884375  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:34.880088  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:34.891803  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.899034  6669 raft_consensus.cc:697] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:34.901510  3262 raft_consensus.cc:2955] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:34.902235  6669 consensus_queue.cc:237] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.906286  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.906796  3334 raft_consensus.cc:2376] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8. Re-sending same reply.
I20260709 12:14:34.907974  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.909008  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.909752  3264 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
W20260709 12:14:34.910027  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.910513  3335 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:34.912213  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.912919  3333 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:34.911721  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.918025  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.919327  6651 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:34.923620  3338 raft_consensus.cc:2468] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:34.924633  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:34.883296  6626 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:34.918660  3339 raft_consensus.cc:2376] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8. Re-sending same reply.
I20260709 12:14:34.930966  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.931723  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.933244  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.934043  3334 raft_consensus.cc:2393] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:34.935827  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:34.938828  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 54522.1us
I20260709 12:14:34.939741  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:34.940550  3336 raft_consensus.cc:2410] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:34.941346  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.942513  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:34.943292  6704 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:14:34.944398  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.945570  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.947695  6632 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:34.889304  6604 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:34.947028  3157 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:34.957605  3156 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:34.953230  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:34.957002  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.960989  3232 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.517s (SENT)
I20260709 12:14:34.963968  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:34.965369  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:34.966380  3333 raft_consensus.cc:2393] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:34.974251  6604 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:34.978277  6452 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:34.987818  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.993194  3261 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:34.980595  6482 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:34.994874  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 85697.9us
I20260709 12:14:35.005105  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:35.006239  6490 consensus_queue.cc:1048] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:35.006796  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:34.988118  6517 raft_consensus.cc:2804] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:34.988281  6632 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:35.015313  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.025589  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:35.029881  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:35.031876  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:35.032449  3184 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:35.034725  6631 consensus_queue.cc:1048] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:35.035115  3156 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:35.040127  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:35.040155  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:35.042223  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.043839  3232 leader_election.cc:336] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.561s (SENT)
I20260709 12:14:35.044327  3232 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.046839  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.048254  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:35.048846  3185 raft_consensus.cc:3060] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:35.018169  6632 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.014312  6517 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:35.053078  3157 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:35.058432  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.041878  6482 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:35.066648  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:35.067394  3267 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:35.068699  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:35.069348  3267 raft_consensus.cc:2393] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:35.069641  6452 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:35.070569  6482 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:35.071862  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.072755  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:35.073436  3267 raft_consensus.cc:2376] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10. Re-sending same reply.
I20260709 12:14:35.057576  6489 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:35.074761  6489 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:35.075220  3267 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:14:35.076233  3232 leader_election.cc:336] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.601s (SENT)
I20260709 12:14:35.076823  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:35.063369  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:35.077659  3261 raft_consensus.cc:2376] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8. Re-sending same reply.
I20260709 12:14:35.077636  3267 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:35.079304  3185 raft_consensus.cc:2468] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:35.055546  6481 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:35.057917  6517 raft_consensus.cc:3060] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:35.082289  3232 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.055286  6632 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:35.088382  3261 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:35.109315  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:35.077078  6604 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:14:35.095525  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 177414us
I20260709 12:14:35.083833  6481 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.123021  3305 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:35.122350  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 119651us
I20260709 12:14:35.124395  3261 raft_consensus.cc:1275] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:35.128232  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:35.084502  6683 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:14:35.129076  3261 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
W20260709 12:14:35.130203  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.122432  6452 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:35.126163  6481 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:35.132849  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:35.122503  6710 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:35.133822  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 57639.6us
I20260709 12:14:35.087123  6715 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:14:35.129606  6664 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:35.128686  6502 consensus_queue.cc:1059] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 12:14:35.137844  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 84852.7us
I20260709 12:14:35.137351  6721 consensus_queue.cc:1059] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:14:35.139784  6710 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:35.142095  6710 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:35.145442  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 96747.8us
I20260709 12:14:35.157334  3336 raft_consensus.cc:1275] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:35.156646  3156 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.132169  6683 consensus_queue.cc:1243] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:35.193322  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:35.195994  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 79117.7us
W20260709 12:14:35.196153  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 76983.6us
I20260709 12:14:35.197325  3305 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:35.202261  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:35.203461  3259 raft_consensus.cc:2393] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:35.205345  3232 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:35.208741  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 82283.8us
I20260709 12:14:35.209028  3261 raft_consensus.cc:1240] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 12:14:35.209430  6612 raft_consensus.cc:2804] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:35.210916  6715 raft_consensus.cc:3055] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:35.215001  3265 raft_consensus.cc:1240] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:35.214910  3261 raft_consensus.cc:1240] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:35.216001  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:35.217195  3231 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.223232  3263 raft_consensus.cc:1275] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:35.223083  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:35.228952  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:35.230099  3259 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:35.231971  3266 raft_consensus.cc:1240] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:35.235266  3895 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:35.236055  3231 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.238953  3260 raft_consensus.cc:1240] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:35.214920  6612 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.218740  6715 raft_consensus.cc:740] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:35.254755  6715 consensus_queue.cc:260] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:35.257678  6711 log.cc:927] Time spent T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.285s	user 0.000s	sys 0.003s
I20260709 12:14:35.267581  3895 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:35.204819  6664 consensus_queue.cc:1059] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:14:35.275983  3231 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:35.227372  6725 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:35.270320  6727 log.cc:927] Time spent T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:14:35.280354  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 75110.6us
I20260709 12:14:35.269027  6612 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.269280  6650 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:35.269793  6626 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:35.286957  3231 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.283064  3232 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.283598  6710 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:35.275827  6731 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:14:35.324649  3259 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 12.
I20260709 12:14:35.280364  6725 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.331698  3924 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:35.281909  6730 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:35.298209  6490 consensus_queue.cc:1048] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:14:35.279261  6452 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:14:35.328287  6453 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:35.339592  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 84053.8us
I20260709 12:14:35.335192  6720 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:35.336705  6368 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:35.363235  3267 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 12.
I20260709 12:14:35.335575  6725 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:35.326435  6731 consensus_queue.cc:1059] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
W20260709 12:14:35.366642  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 83667.6us
I20260709 12:14:35.369995  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:35.371560  3232 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:35.367699  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 150442us
I20260709 12:14:35.331017  6728 consensus_queue.cc:1059] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 12:14:35.374539  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 122231us
I20260709 12:14:35.365309  6604 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:14:35.383047  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.375530  6626 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:35.389588  6626 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:35.390165  6626 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.350378  6664 consensus_queue.cc:1059] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:14:35.378968  6710 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:35.407037  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 63727.3us
W20260709 12:14:35.399778  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 67745.3us
W20260709 12:14:35.433290  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 51026.3us
W20260709 12:14:35.436102  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 279498us
I20260709 12:14:35.379678  6579 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:14:35.440455  6720 raft_consensus.cc:697] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:35.450006  3156 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.454514  3156 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:35.455345  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.435547  6710 raft_consensus.cc:697] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:14:35.445518  6712 log.cc:927] Time spent T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 12:14:35.485177  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 101377us
I20260709 12:14:35.486464  3232 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:35.489110  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.496397  3156 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:35.501320  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.503278  6579 raft_consensus.cc:3055] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:35.503680  6579 raft_consensus.cc:740] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:35.504518  6579 consensus_queue.cc:260] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:35.505722  6579 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:35.505934  6612 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.509686  6725 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:35.511612  6733 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:35.514576  3156 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.517949  6725 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:35.523007  6453 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:35.522456  6720 consensus_queue.cc:237] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:35.523602  6732 log.cc:927] Time spent T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:14:35.484812  6744 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.497371  6631 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:35.539683  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 53331.8us
W20260709 12:14:35.543471  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 110283us
I20260709 12:14:35.543937  3232 leader_election.cc:400] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:35.544409  3232 leader_election.cc:403] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:14:35.548107  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.540482  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 107443us
W20260709 12:14:35.551963  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.518381  6557 consensus_meta.cc:287] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.660s	user 0.014s	sys 0.000s
W20260709 12:14:35.561048  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 46532.2us
I20260709 12:14:35.561969  3156 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.564747  6557 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.566807  6557 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:35.528254  6368 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.545768  6683 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:35.584939  3156 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:35.586521  3156 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.589340  6722 raft_consensus.cc:3055] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:35.589830  6722 raft_consensus.cc:740] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:35.590914  6722 consensus_queue.cc:260] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.592360  6722 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.543222  6631 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:35.607779  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 48162.3us
I20260709 12:14:35.609965  3156 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:35.568320  6453 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:35.563207  6738 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:35.571943  6725 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:35.608764  6733 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:35.605785  6683 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.620157  6726 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:35.650398  3232 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.528091  6710 consensus_queue.cc:237] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:35.620378  6651 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:35.618453  6631 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:35.658948  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:35.659751  3931 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.605284  6368 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:35.558013  6744 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.626212  6725 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:35.625108  6738 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:35.620327  6481 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.619911  6557 consensus_queue.cc:1059] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 12:14:35.654896  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 154447us
W20260709 12:14:35.663110  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 51001.3us
I20260709 12:14:35.651678  6733 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.653601  6683 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.654670  6612 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:35.667408  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.672086  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.674752  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.665380  6453 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:35.677865  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 133597us
I20260709 12:14:35.667780  6725 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:35.667610  6738 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:35.680331  3156 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:35.657850  6742 consensus_queue.cc:1059] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:14:35.673674  6733 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:35.695158  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:35.695783  6757 raft_consensus.cc:3055] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:35.696260  6757 raft_consensus.cc:740] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:35.697116  6757 consensus_queue.cc:260] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.683830  6739 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.698379  6757 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.704506  6481 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:35.684098  6650 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.708122  6650 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.710212  3305 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:35.710597  6650 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:35.712037  3305 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:35.712160  6744 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:35.660902  6750 consensus_queue.cc:1059] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:14:35.712256  6745 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:35.713357  6745 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:35.713514  6750 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:35.713790  6745 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.713963  3305 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:35.714308  6750 raft_consensus.cc:3055] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:35.714655  6750 raft_consensus.cc:740] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:35.714844  6406 raft_consensus.cc:3055] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:35.715281  6406 raft_consensus.cc:740] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:35.717341  6453 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:35.720343  6406 consensus_queue.cc:260] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:35.721731  6723 log.cc:927] Time spent T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.192s	user 0.000s	sys 0.004s
I20260709 12:14:35.724558  3156 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.727169  6490 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.725561  6481 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:35.727880  6490 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:35.728168  6481 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:35.728886  6481 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:35.730201  6490 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:35.731225  6763 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:35.731927  3156 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.733299  3156 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:35.721647  6406 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.740553  3931 raft_consensus.cc:2468] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:35.742302  3306 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:35.715154  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:35.747797  3305 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:35.746773  6490 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:14:35.764189  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 74625.7us
I20260709 12:14:35.768218  3232 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:35.762769  3895 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:35.771711  6720 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:35.691299  6612 consensus_queue.cc:1059] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:14:35.777369  6612 raft_consensus.cc:3055] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:35.777886  6612 raft_consensus.cc:740] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:35.759966  6737 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:35.779160  6612 consensus_queue.cc:260] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:35.781267  6612 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.783819  6746 consensus_queue.cc:1059] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:35.784988  6502 raft_consensus.cc:3055] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:35.785401  6502 raft_consensus.cc:740] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:35.786342  6502 consensus_queue.cc:260] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.788309  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:35.787998  6750 consensus_queue.cc:260] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:35.790015  6750 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:35.790197  3895 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.791219  6744 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:35.791774  6744 raft_consensus.cc:697] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:35.792861  6744 consensus_queue.cc:237] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.761214  6664 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:35.793943  6490 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:35.774307  6720 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:35.796520  6452 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:35.797782  6664 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.796087  6737 raft_consensus.cc:697] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:35.821017  6739 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:35.823958  6745 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.801657  6651 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:14:35.826947  6715 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:35.805233  6632 consensus_meta.cc:287] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.684s	user 0.013s	sys 0.000s
I20260709 12:14:35.808926  3895 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.795468  6765 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:35.817476  6741 raft_consensus.cc:3055] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:35.819620  6754 raft_consensus.cc:2804] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:35.820627  6517 consensus_meta.cc:287] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.699s	user 0.012s	sys 0.000s
I20260709 12:14:35.828598  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:35.841581  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 76787.7us
W20260709 12:14:35.840088  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 71972.3us
I20260709 12:14:35.840320  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:35.811901  6720 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:35.843374  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:35.844563  3232 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:35.833088  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.840668  6632 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.847767  6368 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:35.848321  6368 raft_consensus.cc:2764] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:14:35.848315  6704 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:35.849058  6368 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:35.849231  6754 raft_consensus.cc:697] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:35.849597  6368 raft_consensus.cc:697] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:35.850400  6754 consensus_queue.cc:237] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.849072  6704 raft_consensus.cc:697] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:35.852623  6704 consensus_queue.cc:237] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.811254  6452 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:35.855706  6452 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.720973  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:35.856549  6517 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.859133  6517 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:35.850582  6368 consensus_queue.cc:237] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:35.860074  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 73111.2us
I20260709 12:14:35.860581  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.861452  3156 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.826463  6745 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:35.827967  6664 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:35.865185  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 292799us
I20260709 12:14:35.804829  6490 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.872711  6777 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:35.874224  6490 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:35.875516  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 127807us
I20260709 12:14:35.877314  3305 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:35.878783  3232 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.879352  3305 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:35.839798  6741 raft_consensus.cc:740] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:35.842280  6730 raft_consensus.cc:697] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:35.882908  3895 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.849589  6632 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:35.865862  6626 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.889425  6743 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:35.892942  6579 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:35.909677  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:35.912125  3189 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.892469  6650 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.901765  3188 raft_consensus.cc:1240] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:35.919853  3267 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:35.915853  3193 raft_consensus.cc:1240] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:35.922040  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:35.924928  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:35.883808  3896 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.915648  3184 raft_consensus.cc:1275] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:35.925118  3187 raft_consensus.cc:3060] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.880357  6777 raft_consensus.cc:697] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:35.941602  6777 consensus_queue.cc:237] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.941963  6720 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.918527  3924 raft_consensus.cc:1240] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:35.952178  6481 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:35.954771  6481 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:35.909283  6453 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:35.930203  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:35.930380  6669 raft_consensus.cc:3055] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:35.931682  6502 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.932842  6722 raft_consensus.cc:2955] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:14:35.935295  6767 log.cc:927] Time spent T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:14:35.936038  3259 raft_consensus.cc:1240] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:35.936285  6626 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:35.936862  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:35.936630  6737 consensus_queue.cc:237] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.916699  6766 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:35.957267  6741 consensus_queue.cc:260] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:35.961724  3192 raft_consensus.cc:1240] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:35.920455  3232 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:35.970777  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.975698  3187 raft_consensus.cc:2468] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
W20260709 12:14:35.983855  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 122500us
W20260709 12:14:36.028697  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.029078  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.983845  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 100134us
I20260709 12:14:35.920897  6739 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:35.987457  3262 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:35.907400  6725 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:36.027527  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 65561.6us
I20260709 12:14:36.030279  3896 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:35.978715  6669 raft_consensus.cc:740] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:14:36.032793  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 112375us
I20260709 12:14:36.034186  3232 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:35.985304  6406 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:35.947203  6733 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:36.036139  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 142837us
I20260709 12:14:35.967268  6683 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:36.038443  3305 leader_election.cc:336] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.516s (SENT)
I20260709 12:14:36.039402  3156 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.043583  3335 raft_consensus.cc:1240] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:36.044030  3340 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 11. Current term is 12. Ops: []
W20260709 12:14:36.035738  6772 log.cc:927] Time spent T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:14:36.031486  6453 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:35.990067  6452 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:36.053617  3156 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.034029  6766 raft_consensus.cc:697] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:36.057893  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:36.058796  3232 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.059957  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:36.060984  3339 raft_consensus.cc:1240] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:36.062798  3185 raft_consensus.cc:1240] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:36.064284  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:36.043393  6757 raft_consensus.cc:2764] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:36.040740  6739 raft_consensus.cc:697] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:36.068367  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:36.069661  3927 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:36.069993  6651 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:36.070564  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:36.054678  6771 raft_consensus.cc:2804] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:36.076587  6452 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:36.083082  6717 raft_consensus.cc:3055] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:14:36.087220  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 48811.4us
I20260709 12:14:36.089462  3189 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:36.092331  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:36.094513  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:36.095165  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:36.071043  3156 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:36.049232  6626 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:36.082685  6664 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:36.096874  6720 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:36.097790  6453 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:36.044520  6482 consensus_queue.cc:1048] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 12:14:36.100137  6774 log.cc:927] Time spent T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:14:36.095692  6721 consensus_queue.cc:1059] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:14:36.094697  3157 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.102893  6725 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:36.103554  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 44806.8us
I20260709 12:14:36.103557  6669 consensus_queue.cc:260] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:36.135461  6650 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:36.044888  6726 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:14:36.038913  6730 consensus_queue.cc:237] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:36.058028  6741 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:36.119199  6683 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:36.120069  6766 consensus_queue.cc:237] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:36.125691  6739 consensus_queue.cc:237] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:36.130733  6631 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:36.125840  6738 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:36.132164  6771 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:36.161051  3305 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.581s (SENT)
I20260709 12:14:36.161374  3925 raft_consensus.cc:2393] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 9: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:36.104720  6733 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:36.155263  6717 raft_consensus.cc:740] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:36.169188  3232 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:36.173914  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 79383us
W20260709 12:14:36.187978  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.188575  3895 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.187987  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.191277  3260 raft_consensus.cc:1240] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:36.191597  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.191876  3265 raft_consensus.cc:1240] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:14:36.181217  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.182833  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:36.192018  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.174969  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 104040us
I20260709 12:14:36.194967  3231 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.169298  6481 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:36.196589  3895 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:36.198066  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:36.198489  3265 raft_consensus.cc:1240] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:36.199115  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:36.199637  3186 raft_consensus.cc:1240] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:36.199808  3260 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:36.201593  3231 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.191737  3267 raft_consensus.cc:2955] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:36.204980  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:36.206297  6452 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:36.207955  6604 consensus_queue.cc:1059] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:36.208814  6710 raft_consensus.cc:3055] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:36.209174  6710 raft_consensus.cc:740] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:36.209975  6710 consensus_queue.cc:260] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:36.211114  6710 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:36.212242  3266 raft_consensus.cc:1275] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:36.192842  6771 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:36.177914  6778 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:36.220872  3191 raft_consensus.cc:1240] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:36.204314  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 48634us
I20260709 12:14:36.224233  3231 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.220163  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:36.232789  3259 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
I20260709 12:14:36.189213  6669 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:36.240810  6452 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:36.241655  6368 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.242278  3260 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
I20260709 12:14:36.242197  6368 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:36.243685  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.249853  3266 raft_consensus.cc:1240] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: [5.6-9.8]
I20260709 12:14:36.251765  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:36.252449  3266 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:36.256556  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.259653  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:36.260253  3264 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:36.260051  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:36.263002  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:36.265805  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 69275.8us
I20260709 12:14:36.266638  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:36.216645  6746 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:36.214874  6650 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:36.270689  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:36.198141  6754 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:36.274006  3184 raft_consensus.cc:1240] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:14:36.274212  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:36.275211  3266 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:36.224957  6773 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:36.223995  6626 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:36.278275  3264 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:36.271835  3192 raft_consensus.cc:1240] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:36.279974  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 48069.8us
I20260709 12:14:36.279237  3188 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
W20260709 12:14:36.281585  3305 leader_election.cc:336] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.650s (SENT)
I20260709 12:14:36.282089  3305 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:36.283365  3190 raft_consensus.cc:1240] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:36.280115  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.283124  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:36.216146  6704 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:14:36.289896  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:36.309644  3189 raft_consensus.cc:2393] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:36.291141  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:36.311686  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.313408  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:36.267584  6744 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:36.314244  3268 raft_consensus.cc:2393] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 3: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:36.318305  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:36.321393  3333 raft_consensus.cc:1275] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:14:36.322268  3231 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.527s (SENT)
I20260709 12:14:36.273211  6482 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.321283  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:36.322760  3231 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.327677  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:36.328303  3268 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:36.281510  6664 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:36.272897  6557 consensus_queue.cc:1059] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 12:14:36.334309  3231 leader_election.cc:336] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.534s (SENT)
I20260709 12:14:36.334690  3189 raft_consensus.cc:1240] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:36.334899  3231 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:36.290474  6765 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:36.285369  6604 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:36.263165  6683 consensus_queue.cc:1059] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:14:36.338490  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:36.342468  3259 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:36.283398  6777 consensus_queue.cc:1059] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:14:36.316131  6744 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:36.362003  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.343504  6650 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:36.382790  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:36.383734  3189 raft_consensus.cc:2393] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 9: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:36.383736  3187 raft_consensus.cc:1240] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:36.344059  6742 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:36.339008  6735 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:36.399711  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 118149us
I20260709 12:14:36.324119  6748 consensus_queue.cc:1059] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:14:36.332862  6482 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:36.442579  3259 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:36.381343  6744 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:36.381821  6773 raft_consensus.cc:3055] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:14:36.445963  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 111676us
W20260709 12:14:36.451068  3231 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.561s (SENT)
I20260709 12:14:36.403596  3268 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
W20260709 12:14:36.454366  3305 leader_election.cc:336] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.722s (SENT)
I20260709 12:14:36.454825  3305 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:36.459843  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:36.460439  3259 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:36.401140  6650 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:36.462877  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:36.348060  6604 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:36.406199  6742 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.450109  6773 raft_consensus.cc:740] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:36.330840  6717 consensus_queue.cc:260] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:36.466267  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 145064us
I20260709 12:14:36.465353  6765 raft_consensus.cc:2749] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:36.481647  3186 raft_consensus.cc:1240] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:36.484167  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.468681  6631 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:36.485929  3305 leader_election.cc:336] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.864s (SENT)
I20260709 12:14:36.467095  6738 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:36.494697  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:36.495460  3305 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:36.470654  6742 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:36.478353  6626 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:36.493562  6787 log.cc:927] Time spent T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:14:36.517817  3186 raft_consensus.cc:1240] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:36.493507  6664 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.496512  6750 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:36.462493  6735 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:36.535956  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:36.540782  3259 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
W20260709 12:14:36.544549  6794 log.cc:927] Time spent T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:14:36.545035  6735 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:36.480928  6761 consensus_queue.cc:1059] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:14:36.572187  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:36.559700  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 73809.7us
I20260709 12:14:36.568996  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:36.574101  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:36.575127  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:36.573211  3188 raft_consensus.cc:2376] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7. Re-sending same reply.
I20260709 12:14:36.576835  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:36.576738  3186 raft_consensus.cc:2393] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:36.584856  3265 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:14:36.585525  3231 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.585834  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:36.586464  3265 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:36.578132  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:36.649547  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:36.561041  6792 log.cc:927] Time spent T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:14:36.652036  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:36.651228  3156 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:36.655601  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 70156.6us
I20260709 12:14:36.587218  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:36.587818  3305 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.929s (SENT)
I20260709 12:14:36.658006  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:36.615722  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:36.653898  3188 raft_consensus.cc:2393] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 5: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:36.518822  6626 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:36.605055  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.587509  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.660683  3259 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:36.655139  3339 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:36.662354  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:36.664886  3156 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.666497  3156 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:36.667882  3265 raft_consensus.cc:2393] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:36.670300  3156 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:36.560624  6791 log.cc:927] Time spent T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:14:36.671604  3156 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.674389  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:36.536862  6664 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:36.683166  6664 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:36.683861  6664 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.684389  6664 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:36.686790  6664 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:36.675958  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:36.689559  6664 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:36.568543  6604 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:36.690495  6797 consensus_queue.cc:1059] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:14:36.557663  6773 consensus_queue.cc:260] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:36.560137  6482 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:36.668740  6557 consensus_queue.cc:1059] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:14:36.678073  6737 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:36.654403  6725 consensus_queue.cc:1048] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:14:36.701855  6733 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:36.548444  6453 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:36.679385  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:36.791947  3265 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:36.709601  3895 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:36.793628  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 84129.5us
I20260709 12:14:36.674239  6489 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.675550  6631 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:36.744052  3259 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:36.718076  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:36.678254  6651 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:36.675359  6748 consensus_queue.cc:1059] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:14:36.674693  6726 consensus_queue.cc:1048] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 12:14:36.827106  3186 raft_consensus.cc:2393] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 3: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:36.827903  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:36.706604  6704 consensus_queue.cc:1059] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
W20260709 12:14:36.835026  6781 log.cc:927] Time spent T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.672s	user 0.000s	sys 0.004s
I20260709 12:14:36.835641  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:36.839066  6720 raft_consensus.cc:3055] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:36.839613  6796 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.812475  6737 raft_consensus.cc:697] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:36.812211  6502 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:36.844219  6749 raft_consensus.cc:3055] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:36.814611  6736 consensus_queue.cc:1059] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:14:36.814447  6650 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:36.845885  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.846220  6777 raft_consensus.cc:3055] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:36.852705  6626 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:36.868814  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:36.777757  6735 consensus_queue.cc:1059] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
W20260709 12:14:36.871840  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.899171  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.899576  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.870434  6771 consensus_meta.cc:287] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.003s
I20260709 12:14:36.832319  6631 raft_consensus.cc:697] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:36.869638  6720 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:36.893033  6749 raft_consensus.cc:740] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:36.910248  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:36.895396  6777 raft_consensus.cc:740] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:36.916527  3184 raft_consensus.cc:1275] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:36.906051  6735 consensus_queue.cc:1243] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:36.884608  6796 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:36.915184  6669 consensus_meta.cc:287] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.000s
W20260709 12:14:36.909487  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 238011us
W20260709 12:14:36.940325  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 367072us
W20260709 12:14:36.928727  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.941054  3305 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.970s (SENT)
W20260709 12:14:36.941360  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.941548  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:36.939903  3156 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:36.941825  6742 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:36.942581  6739 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:36.943050  6739 raft_consensus.cc:697] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:36.943924  6739 consensus_queue.cc:237] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:36.945072  6796 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:36.946539  3156 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.949226  3156 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.957312  3156 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.928658  6807 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.964571  3156 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:36.929148  6778 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:37.013248  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 130232us
W20260709 12:14:36.977872  6810 log.cc:927] Time spent T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:36.974385  6482 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:36.978811  6669 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:14:36.981014  3305 leader_election.cc:336] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.003s (SENT)
I20260709 12:14:36.983408  3261 raft_consensus.cc:1240] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:37.015705  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:36.991020  3260 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:36.992990  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:36.993745  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:36.994772  3932 raft_consensus.cc:1275] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:36.996348  6749 consensus_queue.cc:260] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:36.998553  6741 consensus_meta.cc:287] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.825s	user 0.004s	sys 0.007s
I20260709 12:14:36.975325  6720 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:36.969491  6651 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:14:37.000000  6631 consensus_queue.cc:237] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:37.001415  3157 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:36.975015  6737 consensus_queue.cc:237] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:37.004235  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 45680.8us
W20260709 12:14:37.018342  6710 consensus_meta.cc:287] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.790s	user 0.007s	sys 0.004s
I20260709 12:14:37.011298  6821 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:37.011862  6807 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:37.012310  6788 log.cc:927] Time spent T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.673s	user 0.002s	sys 0.000s
I20260709 12:14:36.910807  6771 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:36.958366  6489 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:36.958657  6726 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:36.984294  3265 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:37.019546  3261 raft_consensus.cc:1240] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:37.025594  3260 raft_consensus.cc:1240] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:14:37.027678  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 46707.6us
I20260709 12:14:36.958700  6744 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.036347  6664 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:37.017098  6482 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:37.039080  3263 raft_consensus.cc:2410] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:37.040830  3231 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:37.037671  6517 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:14:37.105183  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 64438.9us
I20260709 12:14:37.050045  6742 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:37.097618  3261 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:37.106571  3231 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:37.096763  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:37.058981  3305 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.039s (SENT)
I20260709 12:14:37.048045  6710 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:37.020426  6777 consensus_queue.cc:260] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.040804  6749 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:37.107613  3265 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:37.109361  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:37.111752  3923 raft_consensus.cc:1240] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:37.112221  3231 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:37.114933  6803 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:37.115658  6808 log.cc:927] Time spent T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:14:37.115543  6803 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:37.115830  6814 consensus_queue.cc:1048] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:14:37.095122  6489 raft_consensus.cc:697] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:37.118016  6489 consensus_queue.cc:237] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:37.119727  3342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 838) took 1077 ms. Trace:
W20260709 12:14:37.120942  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.120102  3342 rpcz_store.cc:276] 0709 12:14:36.041875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.042175 (+   300us) service_pool.cc:224] Handling call
0709 12:14:36.042519 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:36.061715 (+ 19196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:36.061747 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:36.088023 (+ 26276us) log.cc:844] Serialized 26 byte log entry
0709 12:14:36.180153 (+ 92130us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:36.180196 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.180262 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:37.011490 (+831228us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:37.114128 (+102638us) raft_consensus.cc:1685] finished
0709 12:14:37.114150 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.119652 (+  5502us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7798,"raft.queue_time_us":5915,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10040,"spinlock_wait_cycles":5846912,"thread_start_us":79366,"threads_started":1,"wal-append.queue_time_us":163141}
I20260709 12:14:37.111827  6817 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.122311  6817 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.053169  6669 consensus_queue.cc:1048] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:14:37.124432  6817 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:37.125814  6771 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:37.114658  6710 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:37.128103  6807 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:37.115285  6777 raft_consensus.cc:3060] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.105088  6517 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.110400  6796 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:37.140723  6765 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.145076  6817 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.157553  3267 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:37.159824  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:37.113010  6822 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:37.162662  3895 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:37.148540  6517 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:37.115624  6626 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:37.149066  6368 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:37.140481  6669 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:37.164209  3342 raft_consensus.cc:1275] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:37.164203  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:37.178917  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:37.106180  6482 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:37.182502  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:37.187139  3932 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:37.181846  3930 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:37.190637  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:37.193339  3232 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:14:37.201721  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 146800us
I20260709 12:14:37.194690  6717 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:37.177577  6765 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:37.205085  6765 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:37.212317  6744 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:37.175649  6814 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:37.215324  6814 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:37.217674  6814 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:37.218014  6803 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:37.177069  6817 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.225770  6817 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:37.226116  6793 log.cc:927] Time spent T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.756s	user 0.003s	sys 0.001s
I20260709 12:14:37.187328  6742 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.226689  6742 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.227815  6822 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:37.228264  6822 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:37.228617  6822 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:37.228729  6742 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:37.235388  3926 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:37.246250  6746 raft_consensus.cc:3055] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:37.196614  6797 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:14:37.250412  6746 raft_consensus.cc:740] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:37.200302  6733 consensus_queue.cc:1048] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:14:37.251353  6746 consensus_queue.cc:260] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.242548  3266 raft_consensus.cc:1275] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:37.200888  6757 consensus_queue.cc:1059] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:14:37.238134  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:37.254163  6757 raft_consensus.cc:3055] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:37.254577  6757 raft_consensus.cc:740] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:37.255549  6757 consensus_queue.cc:260] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.247879  6722 consensus_queue.cc:1059] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:14:37.257292  6797 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.257819  6797 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.190934  6741 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:37.259878  6741 raft_consensus.cc:697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:37.260773  6741 consensus_queue.cc:237] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:37.262969  3305 leader_election.cc:336] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.097s (SENT)
I20260709 12:14:37.263538  3305 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:37.246050  6773 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:37.264622  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 61922.1us
I20260709 12:14:37.265179  6765 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:37.200747  6406 consensus_queue.cc:1059] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
W20260709 12:14:37.266192  3305 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.108s (SENT)
I20260709 12:14:37.266508  6406 consensus_queue.cc:1243] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:37.266749  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:37.244910  6721 raft_consensus.cc:3055] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:37.267051  6406 raft_consensus.cc:3055] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:37.268090  6721 raft_consensus.cc:740] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:37.268198  6406 raft_consensus.cc:740] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:37.269006  6721 consensus_queue.cc:260] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.269088  6406 consensus_queue.cc:260] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.270049  6721 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:37.270432  6406 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:37.252678  6746 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:37.248557  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1871) took 1349 ms. Trace:
W20260709 12:14:37.273488  6790 log.cc:927] Time spent T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.942s	user 0.002s	sys 0.000s
I20260709 12:14:37.273425  3191 rpcz_store.cc:276] 0709 12:14:35.899578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.899727 (+   149us) service_pool.cc:224] Handling call
0709 12:14:35.910527 (+ 10800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.264436 (+353909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.248256 (+983820us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54002436d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:37.248439 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713176448}
I20260709 12:14:37.278801  6759 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:37.267779  6765 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:37.279724  6502 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:37.285065  3265 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 11.
I20260709 12:14:37.287094  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:14:37.291529  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.267740  6757 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:37.291785  6452 raft_consensus.cc:2804] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:37.298815  6452 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.299170  6452 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:37.300843  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.303247  3895 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:14:37.311367  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 45196.6us
I20260709 12:14:37.313377  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:37.292498  6726 raft_consensus.cc:697] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:37.315349  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:37.316483  3305 leader_election.cc:336] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.125s (SENT)
I20260709 12:14:37.320592  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:37.321295  3264 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:37.309092  6744 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:37.323966  3895 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:14:37.351949  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.353005  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:37.354933  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.308835  6806 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:14:37.358785  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.364118  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.336750  6742 raft_consensus.cc:2804] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:37.353628  6744 raft_consensus.cc:697] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:37.367856  6797 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:37.385092  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.392113  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.372944  6742 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.405798  6626 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.406471  6626 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.410851  6626 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:37.411059  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:37.391616  6517 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:37.421940  6744 consensus_queue.cc:237] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.424731  6710 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:37.427176  6822 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.429541  6822 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:37.430536  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:37.435462  6742 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:37.436636  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:37.437281  3335 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:37.437897  3923 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:37.381289  6726 consensus_queue.cc:237] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:37.440080  3232 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:14:37.443900  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.447055  3335 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:37.457600  3157 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:37.460000  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 107290us
W20260709 12:14:37.464114  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.488209  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.491557  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:37.494748  3926 raft_consensus.cc:2410] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:14:37.459101  6822 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:37.421970  6517 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:37.466156  6738 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:14:37.508903  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.466475  6632 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:37.509516  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.493558  6664 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:37.523903  3932 raft_consensus.cc:1240] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:37.497750  6815 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:14:37.535676  6815 consensus_queue.cc:1243] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:37.514942  6664 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.541462  6664 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:37.509119  6822 raft_consensus.cc:697] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:37.510861  6717 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.530357  6452 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.518391  6406 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.544730  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:37.517939  6738 raft_consensus.cc:697] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:37.552759  6738 consensus_queue.cc:237] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:37.555569  6406 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.559096  3187 raft_consensus.cc:1240] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:37.559335  3191 raft_consensus.cc:1240] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:37.559722  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:37.560577  3192 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:37.560822  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2180) took 1360 ms. Trace:
I20260709 12:14:37.564399  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:37.565394  6717 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.569622  6717 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:37.526384  6818 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:37.590832  3189 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:37.594522  6818 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:37.595196  6818 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.596256  3185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40510 (request call id 2060) took 1029 ms. Trace:
I20260709 12:14:37.596678  3185 rpcz_store.cc:276] 0709 12:14:36.566950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.828864 (+261914us) service_pool.cc:224] Handling call
0709 12:14:37.595968 (+767104us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54001b17d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:37.596149 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131800320}
I20260709 12:14:37.600531  6822 consensus_queue.cc:237] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.601137  6482 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:37.604545  3193 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:37.517498  6632 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:37.607092  6632 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:37.561267  3262 rpcz_store.cc:276] 0709 12:14:36.200671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.203578 (+  2907us) service_pool.cc:224] Handling call
0709 12:14:36.203866 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:36.207595 (+  3729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:36.207628 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:36.208247 (+   619us) log.cc:844] Serialized 52 byte log entry
0709 12:14:36.271293 (+ 63046us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:36.474558 (+203265us) log.cc:844] Serialized 14 byte log entry
0709 12:14:36.480133 (+  5575us) log.cc:844] Serialized 14 byte log entry
0709 12:14:36.715021 (+234888us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b480018c258. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af34f6aa1 00007f1af34edb37 00007f1af34ed9ca 00007f1af35e526f 00007f1af35e4f37 00007f1af35f955c 00007f1af35f9508 00007f1af35f9488 00007f1af35f9443 00007f1af35f86ec 00007f1af2522a96
0709 12:14:36.837157 (+122136us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b1800091de0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
0709 12:14:36.992297 (+155140us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b1800091de0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4ae2a6 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1
0709 12:14:36.992745 (+   448us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b1800091de0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
0709 12:14:37.224330 (+231585us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b1800091de0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4ae2a6 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb3669c4 00007f1aeb364acb 00007f1aeb51fdc9
0709 12:14:37.225803 (+  1473us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b24002abaf8. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb3669c4 00007f1aeb364acb 00007f1aeb51fdc9 00007f1aeb51fa55 00007f1aeb51f09d 00007f1aee15110e 00007f1aee16888c 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221
0709 12:14:37.560389 (+334586us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b1800091de0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aee1754bc 00007f1aeb4c348b 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dd455 00007f1aee5c5060 00007f1aee5d7716 00007f1aee5e8287
0709 12:14:37.560507 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.560575 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:37.560617 (+    42us) raft_consensus.cc:1685] finished
0709 12:14:37.560629 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.560763 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77001,"prepare.queue_time_us":455313,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":73,"raft.queue_time_us":153989,"raft.run_cpu_time_us":2703,"raft.run_wall_time_us":220715,"spinlock_wait_cycles":239259392,"thread_start_us":382851,"threads_started":3,"wal-append.queue_time_us":179442}
I20260709 12:14:37.612479  3339 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:14:37.615285  3265 raft_consensus.cc:2393] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:37.607998  3335 raft_consensus.cc:2955] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:37.619326  3189 raft_consensus.cc:1275] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:37.621830  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:37.623134  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:37.631789  3189 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:37.635675  3342 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:37.637871  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:37.639590  3189 raft_consensus.cc:2393] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:37.634438  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:37.640617  3185 raft_consensus.cc:2393] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:37.541982  6742 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.578446  6815 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:37.603320  6482 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:37.650769  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 159342us
W20260709 12:14:37.655764  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.632982  6664 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.657500  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:37.657560  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:37.631769  6632 consensus_queue.cc:1059] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:14:37.660756  3305 leader_election.cc:400] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7.
I20260709 12:14:37.664772  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:37.665634  3342 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:37.669183  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:37.670648  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:37.671789  3189 raft_consensus.cc:2410] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:14:37.676504  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:37.680068  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:37.680958  3189 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:37.680949  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:37.677197  3334 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:37.698498  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:37.706749  3231 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:37.708076  3231 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:37.704314  3896 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:37.636471  6739 consensus_queue.cc:1059] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:14:37.653522  6465 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:14:37.718449  3895 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:37.719774  3341 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:37.722867  3231 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:37.724066  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:37.727718  3305 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:37.729060  6759 consensus_queue.cc:1059] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:14:37.727375  6715 raft_consensus.cc:2804] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:37.709810  6806 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.658697  6815 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.713356  6818 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:37.738138  6557 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:14:37.752942  6849 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:37.766042  6806 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.767047  3156 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:37.767987  6482 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:37.768329  3333 raft_consensus.cc:1240] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:37.720497  6631 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.724968  6807 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:37.726430  6817 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:37.681811  6664 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.727340  6803 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:37.770071  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:37.832912  3333 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:37.737411  6739 consensus_queue.cc:1243] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer 6f0cdd57c5934921829c205d32b2b8a5 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:14:37.724360  6626 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:14:37.788322  3305 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:37.752851  6715 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.774060  6807 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:37.775215  6849 consensus_queue.cc:1059] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:14:37.811350  6817 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:37.811342  6669 consensus_queue.cc:1048] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:37.751174  6822 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:37.815629  6814 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:37.751104  6797 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:14:37.768561  6482 raft_consensus.cc:697] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:37.768433  6742 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:37.734267  6749 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:14:37.848043  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 59786.9us
I20260709 12:14:37.833874  6744 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.858752  3333 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
W20260709 12:14:37.862434  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 108385us
I20260709 12:14:37.876060  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:37.867800  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 144992us
I20260709 12:14:37.836014  6452 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:37.841427  6715 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:37.797104  6631 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.841226  6807 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:37.877430  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 64622.1us
I20260709 12:14:37.878875  3231 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:37.889541  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:37.890383  3262 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:37.859594  6765 raft_consensus.cc:3055] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:37.895709  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:37.875560  6854 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:37.874490  6849 consensus_queue.cc:1059] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:14:37.905762  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:37.906432  3264 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:37.909448  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:37.910275  3189 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
W20260709 12:14:37.911644  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.902611  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:37.917784  3260 raft_consensus.cc:1275] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:37.916165  3262 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:37.893780  6765 raft_consensus.cc:740] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:37.869349  6822 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:37.928004  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 44595.6us
W20260709 12:14:37.930236  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.883483  6818 consensus_queue.cc:1059] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:14:37.876858  6744 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:37.919298  6855 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:14:37.928263  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:37.906814  6806 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:37.941789  3264 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:37.907074  6778 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.923892  6765 consensus_queue.cc:260] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:37.946669  6778 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.947539  6765 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:37.949568  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:37.942737  3928 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:14:37.958220  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:37.959143  3261 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:37.961994  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.921221  6858 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:37.938674  6669 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:37.982359  6631 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:37.984424  6744 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:37.986129  6715 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:37.987401  3932 raft_consensus.cc:2393] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:37.987950  6817 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:37.988289  6715 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:37.989576  6730 raft_consensus.cc:3055] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:37.990083  6730 raft_consensus.cc:740] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:37.991503  6720 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:37.992929  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:37.993541  3340 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:37.994119  6778 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:37.994606  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:37.995203  3333 raft_consensus.cc:3060] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:37.997033  6854 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.997601  6854 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.000113  6822 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.000375  6738 raft_consensus.cc:3055] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:38.000880  6738 raft_consensus.cc:740] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:38.001761  6738 consensus_queue.cc:260] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.002986  6738 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:38.003023  3896 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:38.004267  3896 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:38.005199  6797 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:38.006645  6797 raft_consensus.cc:2804] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:38.006755  6846 log.cc:927] Time spent T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.293s	user 0.002s	sys 0.000s
I20260709 12:14:38.008095  6749 raft_consensus.cc:2804] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:38.008497  6749 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.008870  6749 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:37.991170  6730 consensus_queue.cc:260] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.012837  6815 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.013041  6730 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:38.014007  6664 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.016471  3335 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:38.007155  6797 raft_consensus.cc:697] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:37.923592  6482 consensus_queue.cc:237] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.018232  6797 consensus_queue.cc:237] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.019946  6807 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.022035  6807 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.023932  6722 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:38.024086  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:38.024899  3262 raft_consensus.cc:2393] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 10: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:38.025864  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:38.026957  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:38.028558  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:38.029996  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:38.032327  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:38.033277  3267 raft_consensus.cc:2393] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:38.031210  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:38.035211  3268 raft_consensus.cc:2410] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:38.035755  3333 raft_consensus.cc:2468] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:38.037200  3896 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:38.042601  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:38.043896  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:38.044536  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.046249  6715 raft_consensus.cc:2804] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:38.049029  6854 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:38.053234  3266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2198) took 1471 ms. Trace:
I20260709 12:14:38.053727  3266 rpcz_store.cc:276] 0709 12:14:36.581639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.581785 (+   146us) service_pool.cc:224] Handling call
0709 12:14:36.582060 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.253260 (+671200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.052952 (+799692us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b540048eed4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:38.053160 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1518101888}
I20260709 12:14:38.066598  6632 raft_consensus.cc:3055] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:38.070518  3267 raft_consensus.cc:1240] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:14:38.071887  3266 raft_consensus.cc:1240] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:14:38.079216  3261 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
W20260709 12:14:38.081527  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.067214  6632 raft_consensus.cc:740] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:38.039499  6807 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:38.106769  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:38.107697  3930 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:38.109911  3929 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:14:38.074128  6715 raft_consensus.cc:697] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:38.110445  3929 pending_rounds.cc:85] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Aborting all ops after (but not including) 7
I20260709 12:14:38.110834  3929 pending_rounds.cc:107] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:14:38.111148  3929 raft_consensus.cc:2889] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:38.113811  3925 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:14:38.114240  3925 pending_rounds.cc:85] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: Aborting all ops after (but not including) 7
I20260709 12:14:38.114487  3925 pending_rounds.cc:107] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:14:38.114758  3925 raft_consensus.cc:2889] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:38.111694  3157 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:38.109678  6722 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.113888  6817 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.131116  6632 consensus_queue.cc:260] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.111069  6807 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.150010  6669 raft_consensus.cc:697] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 12 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:38.153235  6715 consensus_queue.cc:237] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.162662  6869 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:38.159828  6749 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.159842  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:38.149121  6818 consensus_queue.cc:1243] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:38.136889  6722 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.138339  6817 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.164865  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:38.171031  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:38.173429  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.163286  6869 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.174964  3189 raft_consensus.cc:1240] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:38.175221  6735 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:38.175621  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.156141  6861 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.173117  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.157392  6778 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:38.183943  3185 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:38.182211  3190 raft_consensus.cc:1240] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:38.179291  3924 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:38.182824  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:38.186297  3930 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:38.191557  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:38.184237  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.188678  3187 raft_consensus.cc:1275] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:14:38.200179  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 70742.4us
I20260709 12:14:38.180938  6631 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:38.183490  6856 log.cc:927] Time spent T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:14:38.202346  3305 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:38.204198  3232 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:38.184252  6778 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.177461  6854 consensus_queue.cc:1048] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:14:38.187608  6871 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:38.216518  6871 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.218674  6722 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:38.218986  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:38.219264  3188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40510 (request call id 2059) took 1652 ms (client timeout 1806 ms). Trace:
I20260709 12:14:38.207965  3306 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:38.183466  6849 consensus_queue.cc:1059] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:14:38.219632  3188 rpcz_store.cc:269] 0709 12:14:36.566702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.674119 (+107417us) service_pool.cc:224] Handling call
0709 12:14:38.219084 (+1544965us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54002dd7d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:38.219210 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480634240}
I20260709 12:14:38.220253  3306 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:38.220548  6849 raft_consensus.cc:2804] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:38.220945  6849 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:38.221318  6849 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:38.221418  6824 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:38.221828  6824 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.222155  6824 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:38.156973  6669 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.224689  6749 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:38.208230  6631 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.218681  6871 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.209112  6814 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:38.227670  6814 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.228220  6814 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.181119  6737 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:14:38.229588  6807 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:38.209311  3924 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:14:38.214733  6406 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:38.227646  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:38.212471  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 283086us
I20260709 12:14:38.207305  6778 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:38.235569  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:38.236141  3341 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:38.187495  6861 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.238114  3191 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:38.239460  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:38.240060  3924 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:38.241506  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:38.241716  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:38.242108  3262 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:38.246546  3262 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:38.246912  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.248291  3262 raft_consensus.cc:1240] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:38.247512  3188 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:38.252823  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.253609  3188 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:38.254618  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:38.256702  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 54503.8us
I20260709 12:14:38.207526  6876 consensus_queue.cc:1059] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:14:38.260309  6869 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:38.260417  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.260809  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.262094  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:38.263590  6815 consensus_queue.cc:1059] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:38.263866  6876 raft_consensus.cc:3055] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:38.264268  6876 raft_consensus.cc:740] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:38.264577  6815 raft_consensus.cc:3055] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:38.264954  6815 raft_consensus.cc:740] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:38.265100  6876 consensus_queue.cc:260] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.265743  6815 consensus_queue.cc:260] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.266328  6876 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.266796  3187 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:38.267046  6815 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.267509  6765 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:38.268100  6765 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.263278  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.269032  3185 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:38.269501  6664 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:38.270045  6664 raft_consensus.cc:697] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:38.270252  6765 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.271015  6664 consensus_queue.cc:237] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.271450  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:38.266719  6849 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.273957  6849 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.275027  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:38.282418  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.284313  3341 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:38.287693  3896 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:38.290491  3262 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:14:38.296661  3263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2189) took 2027 ms (client timeout 2506 ms). Trace:
W20260709 12:14:38.297075  3263 rpcz_store.cc:269] 0709 12:14:36.259866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.262859 (+  2993us) service_pool.cc:224] Handling call
0709 12:14:38.287561 (+2024702us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b540046f5d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:38.287708 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1774512896}
I20260709 12:14:38.299934  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:38.300595  3262 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:38.303191  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:38.304227  3261 raft_consensus.cc:3060] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:38.315037  3305 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:38.319605  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:38.321018  3156 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:38.321165  3305 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:38.322580  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:38.323127  3263 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:38.324463  3262 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:14:38.292632  6862 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:38.296535  6749 raft_consensus.cc:2804] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:38.327812  3232 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:38.328490  3261 raft_consensus.cc:2468] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:38.331702  3895 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:38.332842  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:38.333489  3263 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:38.334427  3232 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 2.043s (SENT) [suppressed 38 similar messages]
I20260709 12:14:38.333374  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:38.295717  6765 consensus_queue.cc:1059] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:14:38.319177  6872 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:38.340832  3929 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 5.
I20260709 12:14:38.365244  6766 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:38.340281  3927 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 12.
I20260709 12:14:38.324222  6807 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.308887  6817 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.327380  6862 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:38.342924  6749 raft_consensus.cc:697] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:38.329051  6818 consensus_queue.cc:1059] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 12:14:38.346881  3306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.329674  6735 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.330904  6822 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:38.324404  6849 consensus_queue.cc:1059] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:14:38.335959  6650 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.365749  6765 raft_consensus.cc:3055] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:38.327545  6869 consensus_queue.cc:1059] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:14:38.373344  3895 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:38.377200  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:38.327853  6854 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:38.406193  3263 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
W20260709 12:14:38.395714  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 51192.4us
I20260709 12:14:38.336338  6669 consensus_queue.cc:1048] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:14:38.368614  6862 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:38.449008  6765 raft_consensus.cc:740] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:38.369122  6861 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:38.450271  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 77014.5us
W20260709 12:14:38.391752  6881 log.cc:927] Time spent T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
I20260709 12:14:38.448036  6650 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.466617  6650 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:38.459895  6746 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:38.467810  6746 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.366751  6875 raft_consensus.cc:2804] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:38.451606  6872 raft_consensus.cc:3055] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:38.460134  6631 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.468178  6746 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.368229  6807 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.493544  6807 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:38.473301  6872 raft_consensus.cc:740] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:38.493580  6814 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.494727  6872 consensus_queue.cc:260] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.463275  6849 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:38.496770  6849 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:38.497943  3927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55426 (request call id 628) took 1260 ms (client timeout 1627 ms). Trace:
I20260709 12:14:38.498672  6849 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:38.479548  6406 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:14:38.501477  6778 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.502753  3184 raft_consensus.cc:2393] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:38.482810  6865 raft_consensus.cc:3055] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:38.507923  6865 raft_consensus.cc:740] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:38.489315  6863 raft_consensus.cc:3055] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:38.508764  6863 raft_consensus.cc:740] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:38.509675  3156 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:38.509632  6863 consensus_queue.cc:260] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.327930  6867 consensus_queue.cc:1048] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.145s
W20260709 12:14:38.491215  6887 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:14:38.319468  6873 consensus_queue.cc:1059] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.160s
I20260709 12:14:38.512444  6867 consensus_queue.cc:1048] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:38.391561  6735 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.514484  6867 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:38.514799  6735 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:38.511117  6863 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.518213  6766 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.518640  6766 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:38.518951  6807 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:38.519480  6807 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.475176  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:38.522116  6807 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:38.510953  3156 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:38.498347  3927 rpcz_store.cc:269] 0709 12:14:37.237666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.237838 (+   172us) service_pool.cc:224] Handling call
0709 12:14:38.497765 (+1259927us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54005bb654. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:38.497886 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498070912}
I20260709 12:14:38.336820  6858 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.142s
I20260709 12:14:38.461861  6669 consensus_queue.cc:1243] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer 7ac63b674f204bc4805ab989f8c965d3 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:38.462177  6859 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.372085  6720 consensus_queue.cc:1059] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:14:38.530679  3342 raft_consensus.cc:1240] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:38.531314  3339 raft_consensus.cc:1275] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:38.532042  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.534652  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:38.537362  3232 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:38.560042  3232 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:38.549129  3262 raft_consensus.cc:1275] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:38.562462  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.549849  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:38.551800  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:38.566006  3261 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
W20260709 12:14:38.533901  6853 log.cc:927] Time spent T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.885s	user 0.002s	sys 0.001s
I20260709 12:14:38.556016  3263 raft_consensus.cc:1275] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:38.556881  3268 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:14:38.572660  3268 pending_rounds.cc:85] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 7
I20260709 12:14:38.572921  3268 pending_rounds.cc:107] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:14:38.573153  3268 raft_consensus.cc:2889] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:38.566179  3266 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 5.
I20260709 12:14:38.548875  3895 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:38.545956  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 220028us
I20260709 12:14:38.560050  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:38.543732  3157 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:38.577114  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.583181  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.393163  6704 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 12:14:38.583314  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:38.593641  3340 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:38.586817  3333 raft_consensus.cc:1240] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:14:38.588992  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:38.583977  3339 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:38.596060  3338 raft_consensus.cc:2410] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:14:38.590957  3260 raft_consensus.cc:1240] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:38.369343  6749 consensus_queue.cc:237] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.597568  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:38.525386  6852 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.800s	user 0.002s	sys 0.000s
I20260709 12:14:38.599850  3262 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:38.606609  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.606781  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.622066  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.607414  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:38.611001  6850 log.cc:927] Time spent T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.962s	user 0.000s	sys 0.004s
I20260709 12:14:38.611634  6803 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:38.612231  6865 consensus_queue.cc:260] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.592321  6822 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:38.613036  6738 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.613472  6875 raft_consensus.cc:697] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:38.614177  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:38.556809  6883 log.cc:927] Time spent T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 12:14:38.616084  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 72448.3us
I20260709 12:14:38.617760  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.624320  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.523396  6867 raft_consensus.cc:697] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:38.568624  6868 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:38.625236  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:38.625545  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.612619  6722 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:38.593220  6650 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:38.672012  6650 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.672413  6650 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:38.643703  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:38.676548  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.676298  6824 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.625238  6861 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.678604  6824 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.678871  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.615190  6765 consensus_queue.cc:260] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.568044  6859 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.680003  6765 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:38.680167  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:38.681149  6859 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:38.645615  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.684245  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:38.684921  3334 raft_consensus.cc:2393] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:38.685649  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.686235  3334 raft_consensus.cc:2393] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:38.686441  6746 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.660266  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:38.687451  3928 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.649541  3337 raft_consensus.cc:2410] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:38.666298  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.621466  6720 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:38.667479  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:38.667883  3190 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:38.694473  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.627182  6778 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.697423  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:38.669629  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.671157  6867 consensus_queue.cc:237] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.686857  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.676326  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:38.706971  3340 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:38.660266  3338 raft_consensus.cc:2393] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:38.690280  3335 raft_consensus.cc:2393] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:38.632926  6814 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.690582  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:38.692170  3232 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:38.709475  3232 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:38.695102  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:38.698747  3333 raft_consensus.cc:2410] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:14:38.690088  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.711148  3923 raft_consensus.cc:2393] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 9: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:38.732436  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.733332  3333 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:14:38.658725  6406 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.735704  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.635015  6803 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.738330  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.743364  3188 raft_consensus.cc:1240] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:38.745095  3188 raft_consensus.cc:1240] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:38.746577  6875 consensus_queue.cc:237] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.748013  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:38.748694  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 53672.5us
I20260709 12:14:38.748785  3342 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:38.749524  3305 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:38.750093  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.750468  6854 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:38.751112  6854 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:38.754626  6406 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.755759  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.757269  6406 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:38.757735  3338 raft_consensus.cc:1275] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:38.762671  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.670522  6865 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:38.771553  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:38.750983  3305 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:38.759073  3338 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:38.739382  3337 raft_consensus.cc:2410] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:38.667594  6849 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:38.777349  3190 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
I20260709 12:14:38.731719  6859 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:38.728950  6890 log.cc:927] Time spent T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:14:38.696012  6720 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:38.767477  6895 log.cc:927] Time spent T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:14:38.648528  6738 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:38.806458  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 55570.1us
I20260709 12:14:38.739393  6803 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:38.731416  6862 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.821604  3338 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:38.857761  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.863314  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 54988.2us
I20260709 12:14:38.797029  6720 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:38.866789  3305 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:38.791456  6814 consensus_queue.cc:1059] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:14:38.809937  6824 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:38.872283  3337 raft_consensus.cc:1275] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:38.873226  3185 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:38.793433  6849 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.867105  6741 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.890705  3336 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:38.891378  3336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 848) took 1312 ms. Trace:
W20260709 12:14:38.892524  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.892349  3305 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:38.894333  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:38.867300  6894 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:38.891700  3336 rpcz_store.cc:276] 0709 12:14:37.578792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.579512 (+   720us) service_pool.cc:224] Handling call
0709 12:14:38.890189 (+1310677us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b5800042698. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8a22 00007f1af43c18d9 00007f1af351bee0 00007f1af35e50ab 00007f1af35e5131 00007f1af35a6fc0 00007f1af3591929 00007f1af35913d2 00007f1aecb08bd4
0709 12:14:38.890386 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:38.891134 (+   748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.891323 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2743040}
W20260709 12:14:38.899955  3265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40120 (request call id 701) took 1587 ms (client timeout 1567 ms). Trace:
W20260709 12:14:38.900336  3265 rpcz_store.cc:269] 0709 12:14:37.312985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.313102 (+   117us) service_pool.cc:224] Handling call
0709 12:14:38.899774 (+1586672us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54003d36d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:38.899893 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692352896}
I20260709 12:14:38.873566  6631 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.873690  6869 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:38.915030  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.915776  3305 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:38.898775  6824 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:38.901950  6858 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:38.904537  6860 raft_consensus.cc:3055] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:14:38.924983  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 195358us
I20260709 12:14:38.926086  3232 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:38.930115  3232 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:38.930548  6859 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:38.903769  6406 consensus_queue.cc:1048] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:14:38.946058  6406 consensus_queue.cc:1243] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:38.947749  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:38.902896  6741 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.948709  3193 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:14:38.925354  6860 raft_consensus.cc:740] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:38.910910  6631 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:38.960184  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 293622us
I20260709 12:14:38.928560  6854 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:38.930332  6900 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:38.953881  6908 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.965674  6908 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.968288  6738 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.954207  6746 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:38.957655  6803 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:38.907130  6894 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:38.985236  6894 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:38.987607  6766 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:38.990236  6862 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.991752  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55426 (request call id 632) took 1115 ms. Trace:
I20260709 12:14:38.992110  3932 rpcz_store.cc:276] 0709 12:14:37.876381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.876740 (+   359us) service_pool.cc:224] Handling call
0709 12:14:38.991596 (+1114856us) spinlock_profiling.cc:243] Waited 90.7 ms on lock 0x7b54006603d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:38.991701 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208622848}
I20260709 12:14:38.993011  6631 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:38.994139  6849 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.997548  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:38.998121  3184 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.980345  3928 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
I20260709 12:14:38.982731  6818 raft_consensus.cc:3055] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:39.029600  3342 raft_consensus.cc:1275] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:38.927798  6650 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.108412  6899 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.108596  6799 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:39.110826  3339 raft_consensus.cc:1275] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:14:39.113654  3339 pending_rounds.cc:85] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 2
I20260709 12:14:39.114197  3339 pending_rounds.cc:107] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:14:39.114593  3339 raft_consensus.cc:2889] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.029211  6818 raft_consensus.cc:740] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:39.125070  6908 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:39.132159  6482 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.134615  6858 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:39.135118  6858 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.134655  6482 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.137645  6482 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:39.140702  6865 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.141302  6865 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:39.142804  6741 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:39.143640  6818 consensus_queue.cc:260] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:39.143414  6865 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:39.144773  6818 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:39.120613  6860 consensus_queue.cc:260] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:39.156625  6650 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:39.163929  6861 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:39.116660  6799 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.166953  6799 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:39.169016  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:39.169777  3337 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:39.171934  6746 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.172515  6746 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.174775  6746 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:39.176512  6746 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:39.177610  6860 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.178119  3335 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.109138  6899 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.181260  6899 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:39.182511  3340 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:39.185622  6650 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.186326  6650 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.188715  6650 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:39.194535  3184 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:39.196720  3896 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:39.198091  6741 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:39.198486  6741 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.198812  6741 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.203609  6720 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.204459  6799 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:39.206036  6720 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:39.209316  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:39.210157  3928 raft_consensus.cc:2393] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:39.212724  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:39.216133  3340 raft_consensus.cc:1275] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:39.216840  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:39.217548  3337 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:39.221123  3335 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:14:39.229496  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:39.230352  3340 raft_consensus.cc:2393] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:39.235811  3896 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:39.236763  6799 consensus_queue.cc:1048] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:14:39.237556  6842 log.cc:927] Time spent T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 1.228s	user 0.000s	sys 0.005s
I20260709 12:14:39.239740  3259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 702) took 1926 ms. Trace:
I20260709 12:14:39.239271  6799 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:39.240331  3259 rpcz_store.cc:276] 0709 12:14:37.313303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.313417 (+   114us) service_pool.cc:224] Handling call
0709 12:14:37.322391 (+  8974us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:37.322794 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.322836 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:37.335361 (+ 12525us) log.cc:844] Serialized 78 byte log entry
0709 12:14:37.456769 (+121408us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:37.501999 (+ 45230us) log.cc:844] Serialized 14 byte log entry
0709 12:14:37.502288 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.502388 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:37.573028 (+ 70640us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b1800466de0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e0522 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
0709 12:14:37.643444 (+ 70416us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b1800466de0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb45ac0a 00007f1af4b9a219 00007f1af24a158f 00007f1aeb4e0571 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd
0709 12:14:38.009181 (+365737us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b1800466de0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
0709 12:14:39.237285 (+1228104us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b24002abaf8. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb3669c4 00007f1aeb364acb 00007f1aeb51fdc9 00007f1aeb51fa55 00007f1aeb51f09d 00007f1aee15110e 00007f1aee16888c 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221
0709 12:14:39.239406 (+  2121us) raft_consensus.cc:1685] finished
0709 12:14:39.239469 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.239662 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1990,"prepare.queue_time_us":41490,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":5685,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":9387,"spinlock_wait_cycles":79437952,"thread_start_us":84754,"threads_started":1,"wal-append.queue_time_us":151108}
I20260709 12:14:39.241815  6799 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:39.295233  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 177596us
I20260709 12:14:39.288606  6766 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:39.316700  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.226500  6741 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.313041  3232 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:39.292325  6799 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:39.293814  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 378142us
I20260709 12:14:39.280336  6858 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.283955  6899 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 12:14:39.318789  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 342167us
I20260709 12:14:39.336346  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:39.337857  3262 raft_consensus.cc:1240] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:39.338084  3259 raft_consensus.cc:1275] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:39.338214  3266 raft_consensus.cc:1275] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:39.345949  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:39.347674  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:39.348261  3263 raft_consensus.cc:3060] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:39.349720  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.398370  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.408366  3265 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 3.
I20260709 12:14:39.337540  6807 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:39.401666  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:39.410986  3928 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:14:39.409541  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 62047us
I20260709 12:14:39.412774  6822 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.413223  6822 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:39.401906  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 65673.8us
I20260709 12:14:39.415302  6891 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:39.415624  3232 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:39.416646  6710 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:14:39.418227  6911 log.cc:927] Time spent T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:14:39.346653  3925 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:14:39.399904  3260 pending_rounds.cc:85] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 5
I20260709 12:14:39.424768  3260 pending_rounds.cc:107] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:14:39.425077  3260 raft_consensus.cc:2889] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.409513  3263 raft_consensus.cc:2468] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:39.407207  6910 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:39.427501  6858 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:39.431545  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:39.432408  3932 raft_consensus.cc:2393] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:39.435315  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:39.436950  6916 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:39.437116  6807 raft_consensus.cc:697] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:39.437542  6916 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:39.438009  6807 consensus_queue.cc:237] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:39.441562  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.423807  3928 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 13.
I20260709 12:14:39.446468  6913 raft_consensus.cc:476] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 12:14:39.447690  6741 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:39.452313  3927 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:39.456884  6632 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:39.459518  3157 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:39.461165  6913 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:39.461480  3925 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:39.461688  6913 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:39.463271  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.464417  6913 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:39.468189  6913 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:39.468722  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:39.469318  3925 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:39.470541  3306 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:39.472229  6913 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:39.472577  6913 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:39.472941  6913 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:39.473189  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 922381us
I20260709 12:14:39.478650  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:39.484074  3305 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:39.484724  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:39.486007  3190 pending_rounds.cc:85] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3: Aborting all ops after (but not including) 4
I20260709 12:14:39.486325  3190 pending_rounds.cc:107] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:14:39.486548  3190 raft_consensus.cc:2889] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.477967  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:39.494663  3188 raft_consensus.cc:3060] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:39.473948  3231 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:39.500111  3231 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:39.502064  3185 raft_consensus.cc:1240] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:39.502496  3157 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:39.512634  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:39.513398  3338 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.516146  3231 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:39.518584  3305 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:39.520010  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:39.526896  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:39.529874  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:39.530890  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:39.531595  3333 raft_consensus.cc:2368] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7.
I20260709 12:14:39.533510  3184 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:39.533950  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.534520  3262 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:39.498349  6916 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:39.546052  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:39.537598  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:39.540071  3929 raft_consensus.cc:2368] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7.
I20260709 12:14:39.549942  3184 raft_consensus.cc:2393] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:39.551152  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:39.551779  3261 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:39.551798  3926 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:39.528983  6815 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:39.523519  6631 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:39.507884  6650 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:39.542900  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:39.519834  6858 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:39.565130  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:39.546355  6865 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:39.562409  3338 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:39.535905  6910 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:39.570842  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:39.563844  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 114775us
W20260709 12:14:39.565017  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 149455us
I20260709 12:14:39.566185  3341 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:39.537879  3262 raft_consensus.cc:1275] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:39.574946  3232 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:39.536146  6739 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:14:39.580839  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:39.559844  6631 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.583599  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.594568  6631 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.594813  3261 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:39.498142  6875 consensus_queue.cc:1059] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:14:39.596689  6875 raft_consensus.cc:3055] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:39.597178  6875 raft_consensus.cc:740] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:39.597749  6822 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.599340  3265 raft_consensus.cc:2393] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:39.598776  6875 consensus_queue.cc:260] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.600598  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:39.600951  6875 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:39.601210  3341 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:39.602947  3341 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:14:39.604249  3186 raft_consensus.cc:1275] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:39.605046  6725 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.605326  6664 raft_consensus.cc:3055] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:39.605741  6664 raft_consensus.cc:740] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:39.605520  6725 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.606562  6664 consensus_queue.cc:260] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:39.607578  6664 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.608590  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:39.608698  3895 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:39.609267  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:39.609136  6799 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.609998  3193 raft_consensus.cc:2393] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:39.610822  3895 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:39.610822  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:39.612255  3187 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:39.551115  6900 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:14:39.569674  6865 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:39.623891  6865 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:39.619280  6872 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:39.628795  6725 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:39.599778  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:39.630741  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 55868.4us
I20260709 12:14:39.609503  6746 raft_consensus.cc:2804] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:39.638696  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.653201  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:39.632553  3232 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:39.670202  3186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47276 (request call id 534) took 1422 ms. Trace:
W20260709 12:14:39.681723  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 49293.4us
I20260709 12:14:39.682484  3232 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:39.673666  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 62904.9us
I20260709 12:14:39.684895  3305 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:39.679118  3186 rpcz_store.cc:276] 0709 12:14:38.248247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.248434 (+   187us) service_pool.cc:224] Handling call
0709 12:14:38.248685 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.604631 (+1355946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.669873 (+ 65242us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54001b12d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:39.670123 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3116798208}
I20260709 12:14:39.685994  3191 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:39.686923  3266 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:39.687002  6481 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:39.687593  6481 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:39.637859  6860 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:39.689968  6664 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:39.691701  6858 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.692054  6859 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:39.692166  6858 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.692656  6859 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.693105  6859 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:39.694211  6858 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:39.702267  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.706168  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:39.716149  3232 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:39.633486  6746 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.721652  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.708964  3895 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:39.648556  6799 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:39.669849  6916 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.702195  6730 raft_consensus.cc:2804] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:39.743808  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.744663  3266 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:39.720762  6860 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:39.764094  6822 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:39.727839  6858 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:39.743526  6916 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:39.769419  6739 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:39.778535  3334 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
I20260709 12:14:39.778861  6872 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:39.735759  6746 raft_consensus.cc:3060] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:39.741570  3188 raft_consensus.cc:2468] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:39.828779  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:39.794835  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 78762.3us
I20260709 12:14:39.737214  6749 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:39.765549  6730 raft_consensus.cc:697] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:39.832479  6730 consensus_queue.cc:237] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.839571  6872 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.771206  6865 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.843664  6725 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:39.843941  3305 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:39.843907  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.846627  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:39.848807  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:39.851783  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.793869  3895 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:39.854511  3266 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:39.843185  6872 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:39.844282  6725 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.859457  3232 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:39.860270  3264 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:14:39.863531  3306 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:39.866510  3232 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:39.867707  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:39.869086  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:39.871989  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 78175.5us
I20260709 12:14:39.873442  3895 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:39.867506  6715 raft_consensus.cc:3055] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:39.887100  3232 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:39.887835  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.891750  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:39.883406  6715 raft_consensus.cc:740] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:39.898258  6720 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:39.898524  3341 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:39.898691  6715 consensus_queue.cc:260] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.899672  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:39.900072  6715 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.900310  3192 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 3.
I20260709 12:14:39.890611  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:39.901449  6725 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:39.821010  6859 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:39.897753  3262 raft_consensus.cc:1240] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:39.856496  6815 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.903406  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.903460  6866 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:39.904026  6815 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:39.906414  6815 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:39.908212  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.909384  3306 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:39.910360  6765 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:39.910746  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:39.911263  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:39.912344  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.856420  6669 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.857461  6900 raft_consensus.cc:2804] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:39.922472  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.904343  6866 consensus_queue.cc:1243] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:39.914299  3156 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:39.926963  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.915410  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.845032  6865 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:39.839607  6818 consensus_queue.cc:1059] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:14:39.923063  3264 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 11.
I20260709 12:14:39.918984  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:39.868315  6910 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:39.935974  6910 consensus_queue.cc:1048] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:39.928610  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.868136  6710 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:14:39.937510  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.937990  6909 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:39.921957  6860 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:39.938760  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.869457  6872 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:39.927347  6669 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.940418  6929 consensus_queue.cc:1048] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:39.941586  6669 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:39.942631  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.942807  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:39.926379  6650 consensus_queue.cc:1048] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:14:39.921954  6720 consensus_queue.cc:1048] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:14:39.931730  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.931829  6828 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:39.933776  6735 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:39.933823  6916 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:39.934005  6913 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.827201  6739 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:39.930564  6517 raft_consensus.cc:2764] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:14:39.945250  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:39.970463  3305 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:39.948398  6720 consensus_queue.cc:1243] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer 7ac63b674f204bc4805ab989f8c965d3 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:14:39.946699  6900 raft_consensus.cc:697] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:39.972734  3305 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:39.903576  6859 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:39.947233  3262 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:39.950259  3264 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:39.955524  6828 consensus_queue.cc:1243] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:39.927552  6631 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:39.960815  6818 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:39.963322  6669 raft_consensus.cc:3055] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:39.980535  3262 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:39.981863  3339 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:39.982060  3264 raft_consensus.cc:1275] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:39.984622  3305 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:39.985971  3305 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:39.947578  3156 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:39.988577  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.991190  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.965277  6664 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.961280  6875 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:14:40.003684  6739 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:40.004395  6778 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:40.004647  6900 consensus_queue.cc:237] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:39.993768  6815 raft_consensus.cc:2749] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:39.997162  6489 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:40.008141  6489 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.007664  6664 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:40.008558  6489 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:40.010361  6664 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:39.994357  6669 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:40.011946  6669 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:40.013455  6669 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:39.971521  6746 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:40.016619  6746 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:39.999080  3305 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:39.976838  6865 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:40.019690  6865 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.020033  6865 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:40.021044  3305 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:40.021852  6818 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.022326  6818 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:40.024495  6818 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:40.025008  6818 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:40.027359  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:40.029016  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:40.029673  3264 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:40.030269  6489 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:40.036767  6739 consensus_queue.cc:1048] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:39.976698  6765 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:40.043978  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:39.971776  6872 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:39.974967  6749 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.045070  3260 raft_consensus.cc:2393] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 9: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:40.049227  3268 raft_consensus.cc:1240] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:40.057663  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:40.077718  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.078400  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:40.079263  3266 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:40.091764  3266 raft_consensus.cc:1240] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:14:40.092778  3188 raft_consensus.cc:2393] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:40.083344  3231 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:40.136263  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:40.137070  3185 raft_consensus.cc:3060] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:40.140000  3260 pending_rounds.cc:85] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 6
I20260709 12:14:40.140450  3260 pending_rounds.cc:107] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:14:40.140750  3260 raft_consensus.cc:2889] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:40.142035  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:40.142872  3191 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
W20260709 12:14:40.161309  3259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.006s	sys 0.031s
I20260709 12:14:40.164178  3192 pending_rounds.cc:85] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Aborting all ops after (but not including) 7
I20260709 12:14:40.165629  3192 pending_rounds.cc:107] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:14:40.165952  3192 raft_consensus.cc:2889] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:40.062896  6859 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:40.091959  6916 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:40.170632  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:40.105012  6899 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.017s	sys 0.017s
I20260709 12:14:40.131002  6815 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:40.155460  6807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.052s	sys 0.023s
I20260709 12:14:40.128412  6746 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:40.180882  6859 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:40.179982  6815 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.189014  6815 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:40.188818  6746 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:40.190310  6859 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:40.191546  6807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.053s	sys 0.023s
I20260709 12:14:40.192348  6807 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.192925  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:40.193208  6871 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:40.193001  6807 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:40.193758  6871 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:40.194195  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:40.194882  3191 raft_consensus.cc:2393] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:40.194818  6746 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:40.162571  3259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.006s	sys 0.031s
I20260709 12:14:40.196770  6930 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:40.201603  6865 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:40.210770  6737 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.211359  6737 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:40.211753  6866 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:40.212339  6866 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:40.157430  6765 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:40.220916  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.221643  3157 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:40.227735  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:40.160254  6818 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:40.126693  6872 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:40.154131  6803 raft_consensus.cc:2804] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:40.233639  3189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.018s	sys 0.014s
I20260709 12:14:40.228541  3191 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
W20260709 12:14:40.233949  3189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.018s	sys 0.014s
I20260709 12:14:40.173414  3185 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 4.
I20260709 12:14:40.236858  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:40.237859  3157 leader_election.cc:400] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7.
I20260709 12:14:40.238186  3157 leader_election.cc:403] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:14:40.238838  3267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.023s	sys 0.063s
W20260709 12:14:40.245085  3267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.023s	sys 0.063s
I20260709 12:14:40.249949  3156 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:40.253810  3157 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:40.235714  6803 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.181526  6916 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:40.258988  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:40.232471  6909 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:40.238699  6865 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:40.242067  6799 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.243839  6631 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:40.246515  6735 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:40.274219  3187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.018s	sys 0.002s
W20260709 12:14:40.274966  3187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.018s	sys 0.002s
I20260709 12:14:40.255775  6632 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:40.231336  6765 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:40.236168  6818 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:40.262995  6778 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7.
I20260709 12:14:40.266731  6803 raft_consensus.cc:3060] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:40.235769  6872 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:40.268193  6799 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:40.268450  6865 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:40.366655  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:40.251017  3156 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:40.374532  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 123591us
I20260709 12:14:40.341315  3896 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:40.375711  3156 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:40.379488  3895 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:40.383211  3336 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.010s	sys 0.010s
W20260709 12:14:40.383778  3336 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.010s	sys 0.010s
I20260709 12:14:40.331380  6913 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:40.265825  6817 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.009s	sys 0.039s
I20260709 12:14:40.278808  6632 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:40.332285  3923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55438 (request call id 883) took 2215 ms (client timeout 1687 ms). Trace:
W20260709 12:14:40.469630  3923 rpcz_store.cc:269] 0709 12:14:38.105956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.106664 (+   708us) service_pool.cc:224] Handling call
0709 12:14:38.690464 (+583800us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b5800221198. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb4a8b71 00007f1aeb4a8eee 000000000036eb39 00007f1af351c1e0 00007f1af35e50c4 00007f1af35e5131 00007f1af35930a0 00007f1af3592984 00007f1aecb0d6d4 00007f1aecb0d662
0709 12:14:40.321118 (+1630654us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b5400373a54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:40.321331 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11579392}
I20260709 12:14:40.274613  6735 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.276787  6858 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:40.342653  3334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58568 (request call id 2263) took 1728 ms (client timeout 2200 ms). Trace:
W20260709 12:14:40.471201  3334 rpcz_store.cc:269] 0709 12:14:38.614834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.686648 (+ 71814us) service_pool.cc:224] Handling call
0709 12:14:40.342446 (+1655798us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400020654. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:40.342581 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2463920896}
I20260709 12:14:40.329805  6866 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:40.265889  6766 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.006s	sys 0.013s
I20260709 12:14:40.363508  6737 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:40.360774  6865 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:40.371778  6730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.005s	sys 0.016s
I20260709 12:14:40.371443  6489 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:40.466706  3338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.017s	sys 0.020s
I20260709 12:14:40.485864  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:40.374823  6631 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:40.397516  6909 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:40.417378  6817 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.012s	sys 0.044s
W20260709 12:14:40.491712  3928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.031s	sys 0.026s
W20260709 12:14:40.547242  3928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.034s	sys 0.028s
I20260709 12:14:40.406481  6871 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:40.551119  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 892) took 1027 ms. Trace:
W20260709 12:14:40.531409  6715 consensus_meta.cc:287] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.630s	user 0.005s	sys 0.009s
I20260709 12:14:40.551609  3928 rpcz_store.cc:276] 0709 12:14:39.524021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.524136 (+   115us) service_pool.cc:224] Handling call
0709 12:14:39.529912 (+  5776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.530113 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:39.968809 (+438696us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.550688 (+581879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:40.550755 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:40.550824 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.550909 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.551054 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2912,"prepare.queue_time_us":685342,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"thread_start_us":1002101,"threads_started":2}
I20260709 12:14:40.554632  3157 leader_election.cc:400] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7.
I20260709 12:14:40.530040  6720 raft_consensus.cc:2804] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:40.559666  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 389128us
I20260709 12:14:40.405403  6717 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:40.488970  6632 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.486820  6735 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.537648  3337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52822 (request call id 881) took 1309 ms. Trace:
W20260709 12:14:40.602380  3338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.017s	sys 0.021s
W20260709 12:14:40.528255  6730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.007s	sys 0.017s
I20260709 12:14:40.515712  6807 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:40.491524  3232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.004s	sys 0.032s
W20260709 12:14:40.603746  3232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.004s	sys 0.032s
W20260709 12:14:40.512115  3929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.013s	sys 0.022s
W20260709 12:14:40.604036  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 680817us
W20260709 12:14:40.604498  3929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.013s	sys 0.022s
I20260709 12:14:40.604794  3232 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:40.601531  3337 rpcz_store.cc:276] 0709 12:14:39.228099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.228234 (+   135us) service_pool.cc:224] Handling call
0709 12:14:40.485773 (+1257539us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b5c0013780c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af1f37161 00007f1af20d8a79 00007f1af35929b6 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:40.537573 (+ 51800us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11988224}
I20260709 12:14:40.549422  6909 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:40.529206  6865 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:40.611937  3232 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:40.623152  3267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2234) took 1073 ms. Trace:
I20260709 12:14:40.620865  6913 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:40.629096  3232 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:40.623588  3267 rpcz_store.cc:276] 0709 12:14:39.549888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.550002 (+   114us) service_pool.cc:224] Handling call
0709 12:14:39.550309 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.552032 (+  1723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.552062 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.561651 (+  9589us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.249306 (+687655us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:40.276077 (+ 26771us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.276287 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.276361 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.622933 (+346572us) raft_consensus.cc:1685] finished
0709 12:14:40.622956 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.623092 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11200,"prepare.queue_time_us":26590,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":2299,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":50291,"thread_start_us":641506,"threads_started":1,"wal-append.queue_time_us":1035809}
I20260709 12:14:40.610915  6664 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:40.625193  6909 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.595127  6631 consensus_queue.cc:1048] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:14:40.628592  6710 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:40.627859  6817 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:14:40.625615  6807 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:40.637873  6860 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:40.712143  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:40.712922  3188 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
W20260709 12:14:40.695389  6944 log.cc:927] Time spent T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
I20260709 12:14:40.695029  6916 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:40.699090  6710 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.754839  3191 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:40.755676  3337 raft_consensus.cc:1275] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:40.641017  6913 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:40.763538  3339 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:40.779758  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:40.782478  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:40.709528  6818 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:40.783305  3267 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:40.793110  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:40.793771  3267 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.712182  6860 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:40.755649  6912 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:40.808452  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 409953us
I20260709 12:14:40.724838  6872 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:40.813683  3267 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
W20260709 12:14:40.820482  3189 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.013s	sys 0.010s
I20260709 12:14:40.820866  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:40.829910  3261 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:40.771795  6710 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.824836  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:40.825212  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 677) took 1354 ms. Trace:
I20260709 12:14:40.825485  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:40.827840  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:40.830354  3267 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:40.824015  3334 raft_consensus.cc:1275] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:14:40.830847  3189 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.013s	sys 0.010s
I20260709 12:14:40.834573  3927 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:40.842098  3259 raft_consensus.cc:2393] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:40.791824  6807 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:40.807346  6860 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.853189  3261 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.808841  6799 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:40.864670  3930 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:40.866998  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:40.807761  6818 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.868582  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:40.824451  6916 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.832952  3925 rpcz_store.cc:276] 0709 12:14:39.470939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.471127 (+   188us) service_pool.cc:224] Handling call
0709 12:14:39.471505 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.472227 (+   722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.472278 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.472910 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 12:14:39.970092 (+497182us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:39.970128 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.970206 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.825011 (+854805us) raft_consensus.cc:1685] finished
0709 12:14:40.825030 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.825156 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":496792,"threads_started":1,"wal-append.queue_time_us":790177}
W20260709 12:14:40.877606  3231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.010s	sys 0.039s
W20260709 12:14:40.936885  3231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.010s	sys 0.039s
I20260709 12:14:40.941414  3184 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:40.928442  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:40.955402  3334 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 9: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:40.967926  3927 raft_consensus.cc:2393] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:40.989995  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:40.944336  3231 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:40.846297  6957 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.990898  3923 raft_consensus.cc:2393] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
W20260709 12:14:40.991153  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 46898.7us
I20260709 12:14:40.993543  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:40.998273  3261 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.855693  6872 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:40.928884  6945 log.cc:927] Time spent T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 12:14:40.843152  6715 consensus_queue.cc:1048] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 12:14:40.869796  6817 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:41.026659  3232 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:41.017323  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:41.028643  3191 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:40.834230  6912 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:41.029943  3268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.000s	sys 0.032s
I20260709 12:14:40.994983  6960 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:41.061250  3268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.000s	sys 0.034s
I20260709 12:14:41.000835  6961 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:41.087268  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:40.878870  6807 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.017887  6900 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.991374  6818 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:41.054523  6948 log.cc:927] Time spent T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.417s	user 0.000s	sys 0.001s
W20260709 12:14:41.030320  6899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.007s	sys 0.025s
I20260709 12:14:40.994935  6916 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:41.113188  6916 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:41.113796  6815 consensus_meta.cc:287] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.924s	user 0.009s	sys 0.001s
I20260709 12:14:41.036834  6717 raft_consensus.cc:697] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:41.103477  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:41.086802  6965 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:41.103826  6946 log.cc:927] Time spent T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.319s	user 0.001s	sys 0.001s
I20260709 12:14:41.123701  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:41.124819  3261 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
W20260709 12:14:41.104674  6968 log.cc:927] Time spent T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
W20260709 12:14:41.129089  6956 log.cc:927] Time spent T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.412s	user 0.001s	sys 0.001s
W20260709 12:14:41.129494  6975 log.cc:927] Time spent T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:14:41.129803  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2255) took 1047 ms. Trace:
I20260709 12:14:41.105109  6912 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:41.130566  6717 consensus_queue.cc:237] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:41.105283  6958 log.cc:927] Time spent T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
W20260709 12:14:41.105955  6959 log.cc:927] Time spent T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 12:14:41.015673  6957 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.021965  6872 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.107653  6984 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:41.108394  6977 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:41.096591  6978 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:41.113718  6669 consensus_meta.cc:287] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 1.100s	user 0.012s	sys 0.000s
W20260709 12:14:41.089859  6803 consensus_meta.cc:287] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.703s	user 0.003s	sys 0.007s
I20260709 12:14:41.131325  6818 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:41.119168  6815 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:41.119518  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:41.161448  3341 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:41.097463  6900 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:41.104127  6967 log.cc:927] Time spent T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:14:41.127866  6965 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.134127  3187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1903) took 1502 ms. Trace:
I20260709 12:14:41.130180  3262 rpcz_store.cc:276] 0709 12:14:40.082841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.084404 (+  1563us) service_pool.cc:224] Handling call
0709 12:14:40.084803 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:40.095319 (+ 10516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.095364 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:40.130966 (+ 35602us) log.cc:844] Serialized 52 byte log entry
0709 12:14:40.685755 (+554789us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:40.685819 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.685915 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.129558 (+443643us) raft_consensus.cc:1685] finished
0709 12:14:41.129590 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.129742 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15404,"raft.queue_time_us":10797,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":12345,"thread_start_us":464078,"threads_started":1,"wal-append.queue_time_us":643446}
I20260709 12:14:41.092067  6962 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:41.114566  6899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.009s	sys 0.026s
I20260709 12:14:41.131184  6912 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:41.149469  6966 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:14:41.034811  6817 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:41.149749  6865 consensus_meta.cc:287] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 0.512s	user 0.005s	sys 0.004s
I20260709 12:14:41.150257  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:41.228206  3334 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:41.150821  6814 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:41.096549  6960 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.113727  6916 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:41.026250  6980 consensus_queue.cc:1048] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
W20260709 12:14:41.114362  6953 log.cc:927] Time spent T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.415s	user 0.001s	sys 0.000s
W20260709 12:14:41.152884  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 595036us
I20260709 12:14:41.215965  6873 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:41.096271  6961 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.152921  6715 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:41.103135  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:41.124303  6974 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:41.269925  6715 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.270390  6974 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:41.272424  6715 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:41.163313  3265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.008s	sys 0.035s
I20260709 12:14:41.272682  6974 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:41.273015  3265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.008s	sys 0.035s
I20260709 12:14:41.273613  6807 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:41.121853  3266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2256) took 1038 ms. Trace:
W20260709 12:14:41.170907  3929 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.025s	sys 0.018s
I20260709 12:14:41.274992  6957 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:41.275218  3929 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.025s	sys 0.018s
I20260709 12:14:41.275856  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 897) took 1721 ms. Trace:
I20260709 12:14:41.276186  3929 rpcz_store.cc:276] 0709 12:14:39.554856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.555027 (+   171us) service_pool.cc:224] Handling call
0709 12:14:39.555328 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.555596 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:39.926323 (+370727us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.275540 (+1349217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:41.275591 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:41.275638 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.275701 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.275804 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":660084,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":151170,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":21394,"thread_start_us":1710437,"threads_started":3,"wal-append.queue_time_us":842674}
W20260709 12:14:41.171351  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 412712us
I20260709 12:14:41.278057  3895 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:41.172478  3187 rpcz_store.cc:276] 0709 12:14:39.631237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.631377 (+   140us) service_pool.cc:224] Handling call
0709 12:14:39.681476 (+ 50099us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:39.681841 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.681872 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:39.685603 (+  3731us) log.cc:844] Serialized 52 byte log entry
0709 12:14:40.275358 (+589755us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:40.275399 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.275488 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.133872 (+858384us) raft_consensus.cc:1685] finished
0709 12:14:41.133892 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.134043 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5007,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":589378,"threads_started":1,"wal-append.queue_time_us":1001527}
I20260709 12:14:41.211726  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:41.280647  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:41.157924  6978 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:41.212471  3185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.009s	sys 0.007s
I20260709 12:14:41.214656  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:41.215934  3336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2288) took 1370 ms. Trace:
W20260709 12:14:41.281895  3185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.009s	sys 0.007s
I20260709 12:14:41.274420  3266 rpcz_store.cc:276] 0709 12:14:40.083077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.127853 (+ 44776us) service_pool.cc:224] Handling call
0709 12:14:40.128156 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:40.563608 (+435452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.563651 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:40.611463 (+ 47812us) log.cc:844] Serialized 26 byte log entry
0709 12:14:41.086051 (+474588us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:41.086108 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.086205 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.121592 (+ 35387us) raft_consensus.cc:1685] finished
0709 12:14:41.121618 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.121784 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2666,"raft.queue_time_us":43096,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":10416,"thread_start_us":827114,"threads_started":2,"wal-append.queue_time_us":467226}
I20260709 12:14:41.282049  3336 rpcz_store.cc:276] 0709 12:14:39.845836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.847762 (+  1926us) service_pool.cc:224] Handling call
0709 12:14:39.848102 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.848337 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:40.384263 (+535926us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.215495 (+831232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:41.215564 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:41.215635 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.215730 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.215865 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8649,"prepare.queue_time_us":365556,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":283421,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":1339876,"threads_started":3,"wal-append.queue_time_us":765601}
W20260709 12:14:41.170428  6720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.015s	sys 0.028s
I20260709 12:14:41.222802  3341 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
I20260709 12:14:41.327621  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:41.328547  3341 raft_consensus.cc:2393] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 5: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:41.329507  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:41.330058  3341 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
I20260709 12:14:41.331055  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:41.163851  6669 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:41.154047  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:41.212774  6913 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:41.160787  6803 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.159953  6977 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:41.249836  6942 log.cc:927] Time spent T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.721s	user 0.004s	sys 0.002s
I20260709 12:14:41.238328  6814 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:41.250609  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:41.341856  3334 raft_consensus.cc:3060] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:41.251724  6481 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:41.253870  6741 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.262301  6960 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:38.522409  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:41.217799  6962 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.265547  6817 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:41.266186  6664 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:41.265926  6916 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:41.268600  3339 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:41.325757  3335 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:41.325963  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:41.159754  6984 raft_consensus.cc:697] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:41.332896  3341 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.335394  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47276 (request call id 552) took 1200 ms. Trace:
W20260709 12:14:41.267411  6632 consensus_meta.cc:287] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.001s
I20260709 12:14:41.372463  3192 rpcz_store.cc:276] 0709 12:14:40.135373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.135493 (+   120us) service_pool.cc:224] Handling call
0709 12:14:40.163951 (+ 28458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:40.175080 (+ 11129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.175109 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:40.179855 (+  4746us) log.cc:844] Serialized 52 byte log entry
0709 12:14:40.563246 (+383391us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:40.563302 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.563390 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.335208 (+771818us) raft_consensus.cc:1685] finished
0709 12:14:41.335226 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.335341 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8207,"raft.queue_time_us":9001,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8355,"spinlock_wait_cycles":593152,"thread_start_us":382598,"threads_started":1,"wal-append.queue_time_us":696455}
I20260709 12:14:41.374609  6632 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:41.376271  6984 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.377545  6632 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:41.380643  6986 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:41.381402  6986 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.384855  6814 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:41.386080  3338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2289) took 1540 ms. Trace:
W20260709 12:14:41.347193  6909 consensus_meta.cc:287] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.001s
I20260709 12:14:41.228287  6912 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.270028  6650 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:41.411979  6949 log.cc:927] Time spent T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.997s	user 0.001s	sys 0.009s
I20260709 12:14:41.412122  6650 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:41.412662  6765 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:41.333158  6720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.015s	sys 0.028s
W20260709 12:14:41.414315  6939 log.cc:927] Time spent T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.999s	user 0.003s	sys 0.002s
I20260709 12:14:41.414594  6720 raft_consensus.cc:697] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:41.415541  6720 consensus_queue.cc:237] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.417286  3186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40510 (request call id 2085) took 1528 ms. Trace:
I20260709 12:14:41.418510  6979 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:41.419152  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47276 (request call id 550) took 1285 ms. Trace:
I20260709 12:14:41.419500  6979 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.419678  3193 rpcz_store.cc:276] 0709 12:14:40.134165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.134276 (+   111us) service_pool.cc:224] Handling call
0709 12:14:40.134502 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.134666 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:40.553061 (+418395us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.418718 (+865657us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:41.418786 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:41.418846 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.418938 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.419069 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":646802,"prepare.queue_time_us":478266,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":39,"thread_start_us":636433,"threads_started":2,"wal-append.queue_time_us":553622}
W20260709 12:14:41.422524  6943 log.cc:927] Time spent T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.913s	user 0.004s	sys 0.011s
I20260709 12:14:41.339452  3264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2253) took 1257 ms. Trace:
I20260709 12:14:41.388392  6974 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.423943  6974 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.423604  3264 rpcz_store.cc:276] 0709 12:14:40.082303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.082414 (+   111us) service_pool.cc:224] Handling call
0709 12:14:40.082691 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:40.083010 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.083038 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:40.127245 (+ 44207us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.598111 (+470866us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:40.598172 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.598274 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.339204 (+740930us) raft_consensus.cc:1685] finished
0709 12:14:41.339243 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.339376 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4321,"raft.queue_time_us":8960,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":12889,"thread_start_us":423012,"threads_started":1,"wal-append.queue_time_us":769769}
I20260709 12:14:41.425551  6867 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:41.425802  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:41.426424  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 485909us
I20260709 12:14:41.339622  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:41.427516  3266 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:41.428447  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:41.429191  3266 raft_consensus.cc:2393] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 4: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:41.280757  6766 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:41.429968  6766 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.431015  6866 consensus_queue.cc:1059] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:41.431936  3263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2233) took 1882 ms. Trace:
W20260709 12:14:41.340381  3086 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48778 (request call id 282) took 20575 ms (client timeout 15000 ms). Trace:
I20260709 12:14:41.432809  6766 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:41.232689  6865 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:41.334681  6980 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:41.433923  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 191954us
I20260709 12:14:41.434207  6980 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.434682  6980 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.264297  3088 catalog_manager.cc:5697] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 5 to 6, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 6 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:41.351850  6973 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.435699  6919 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:41.338233  6860 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:41.353139  6981 log.cc:927] Time spent T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:14:41.445253  3088 catalog_manager.cc:5697] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 4 to 7, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 7 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.357324  6799 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.358286  6977 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:41.358855  3334 raft_consensus.cc:2468] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:41.359220  6873 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.370416  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:41.469425  3261 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:41.433172  3086 rpcz_store.cc:269] 0709 12:14:20.764882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.765174 (+   292us) service_pool.cc:224] Handling call
0709 12:14:41.340308 (+20575134us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:34.919328 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:34.926135 (+  6807us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:34.926184 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:14:34.926202 (+    18us) tablet.cc:662] Decoding operations
0709 12:14:34.927150 (+   948us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:34.927227 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:34.927252 (+    25us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:14:34.928132 (+   880us) tablet.cc:701] Row locks acquired
0709 12:14:34.928200 (+    68us) write_op.cc:260] PREPARE: finished
0709 12:14:34.928355 (+   155us) write_op.cc:270] Start()
0709 12:14:34.928507 (+   152us) write_op.cc:276] Timestamp: P: 1783599274928286 usec, L: 0
0709 12:14:34.928532 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:14:34.944288 (+ 15756us) log.cc:844] Serialized 3590 byte log entry
0709 12:14:35.211553 (+267265us) op_driver.cc:464] REPLICATION: finished
0709 12:14:35.434313 (+222760us) write_op.cc:301] APPLY: starting
0709 12:14:35.442933 (+  8620us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:35.522515 (+ 79582us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:35.527614 (+  5099us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:35.694933 (+167319us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:35.695272 (+   339us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:14:35.695317 (+    45us) write_op.cc:312] APPLY: finished
0709 12:14:35.695732 (+   415us) log.cc:844] Serialized 71 byte log entry
0709 12:14:35.695918 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:35.696045 (+   127us) write_op.cc:454] Released schema lock
0709 12:14:35.696108 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:35.696522 (+   414us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:35.696552 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":65219,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":171265,"apply.run_cpu_time_us":5600,"apply.run_wall_time_us":303058,"num_ops":9,"prepare.queue_time_us":186831,"prepare.run_cpu_time_us":54785,"prepare.run_wall_time_us":169978,"raft.queue_time_us":124170,"raft.run_cpu_time_us":12261,"raft.run_wall_time_us":156994,"replication_time_us":282825,"thread_start_us":373113,"threads_started":4,"wal-append.queue_time_us":127155,"wal-append.run_cpu_time_us":21348,"wal-append.run_wall_time_us":1629497}]]}
W20260709 12:14:41.343824  6735 consensus_meta.cc:287] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.000s
I20260709 12:14:41.386560  3338 rpcz_store.cc:276] 0709 12:14:39.846121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.847588 (+  1467us) service_pool.cc:224] Handling call
0709 12:14:39.862923 (+ 15335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.909357 (+ 46434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.909386 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.909922 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.602895 (+692973us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:40.602946 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.367233 (+764287us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b54000c3fd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:41.367299 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.367378 (+    79us) raft_consensus.cc:1685] finished
0709 12:14:41.367398 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.385982 (+ 18584us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":859,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":105790976,"thread_start_us":692582,"threads_started":1,"wal-append.queue_time_us":769950}
I20260709 12:14:41.337131  3262 raft_consensus.cc:2393] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 6: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:41.402637  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:41.471532  3337 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:41.334961  6715 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:14:41.403632  3341 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
W20260709 12:14:41.468061  6947 log.cc:927] Time spent T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.927s	user 0.016s	sys 0.020s
W20260709 12:14:41.407100  6937 log.cc:927] Time spent T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.915s	user 0.007s	sys 0.008s
I20260709 12:14:41.407940  6815 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:41.337793  6669 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:41.366648  6741 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.424762  3189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47276 (request call id 533) took 3176 ms. Trace:
I20260709 12:14:41.326160  6978 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.349727  3895 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:41.961297  3189 rpcz_store.cc:276] 0709 12:14:38.247918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.248024 (+   106us) service_pool.cc:224] Handling call
0709 12:14:38.997243 (+749219us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:39.561416 (+564173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.561454 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:39.569199 (+  7745us) log.cc:844] Serialized 52 byte log entry
0709 12:14:40.234306 (+665107us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:40.836303 (+601997us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.422798 (+586495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.422904 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.422956 (+    52us) raft_consensus.cc:1685] finished
0709 12:14:41.422973 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.424539 (+  1566us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5400243bd0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:41.424688 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":714362,"prepare.queue_time_us":378779,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":726007,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":198,"spinlock_wait_cycles":1722307456,"thread_start_us":1605003,"threads_started":3,"wal-append.queue_time_us":872403}
I20260709 12:14:41.965180  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:41.432353  3263 rpcz_store.cc:276] 0709 12:14:39.549597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.550107 (+   510us) service_pool.cc:224] Handling call
0709 12:14:39.550437 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.559702 (+  9265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.560008 (+   306us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.564979 (+  4971us) log.cc:844] Serialized 26 byte log entry
0709 12:14:39.621036 (+ 56057us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b480018c258. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af34f6aa1 00007f1af34edb37 00007f1af34ed9ca 00007f1af35e526f 00007f1af35e4f37 00007f1af35f955c 00007f1af35f9508 00007f1af35f9488 00007f1af35f9443 00007f1af35f86ec 00007f1af2522a96
0709 12:14:40.075676 (+454640us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:40.144749 (+ 69073us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.400169 (+255420us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18001cfc00. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4c2e07 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dd455 00007f1aee5c5060 00007f1aee5d7716 00007f1aee5e8287 00007f1aee5e8208
0709 12:14:40.808135 (+407966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.808205 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.413606 (+605401us) spinlock_profiling.cc:243] Waited 94.9 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:41.421402 (+  7796us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b480018c258. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af34f6aa1 00007f1af34edb37 00007f1af34ed9ca 00007f1af35e526f 00007f1af35e4f37 00007f1af35f955c 00007f1af35f9508 00007f1af35f9488 00007f1af35f9443 00007f1af35f86ec 00007f1af2522a96
0709 12:14:41.431693 (+ 10291us) raft_consensus.cc:1685] finished
0709 12:14:41.431716 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.431857 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2849,"prepare.queue_time_us":81949,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":48868,"raft.run_cpu_time_us":12553,"raft.run_wall_time_us":1294418,"spinlock_wait_cycles":317697920,"thread_start_us":898114,"threads_started":2,"wal-append.queue_time_us":740752}
I20260709 12:14:41.449968  3896 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:41.966828  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:41.436448  6973 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:41.451500  6917 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:41.417798  3186 rpcz_store.cc:276] 0709 12:14:39.888890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.889047 (+   157us) service_pool.cc:224] Handling call
0709 12:14:39.899095 (+ 10048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.899291 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:40.334296 (+435005us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.416884 (+1082588us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:41.416951 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:41.417017 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.417102 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.417227 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":708033,"prepare.queue_time_us":713142,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":708284,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":804572,"threads_started":2,"wal-append.queue_time_us":740603}
I20260709 12:14:41.433022  6866 raft_consensus.cc:3055] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:41.465183  6900 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:41.372999  6664 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:41.465408  3088 catalog_manager.cc:5697] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: config changed from index 5 to 6, term changed from 4 to 7, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to <none>, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:14:41.945051  6969 log.cc:927] Time spent T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.520s	user 0.002s	sys 0.000s
I20260709 12:14:41.404632  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:41.410101  6965 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:41.403561  6749 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:41.663518  3898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.201s	user 0.025s	sys 0.047s
W20260709 12:14:41.987280  3898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.525s	user 0.032s	sys 0.061s
W20260709 12:14:41.602496  3232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.017s	sys 0.039s
W20260709 12:14:41.988912  3232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.021s	sys 0.043s
I20260709 12:14:41.912882  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:41.648414  6977 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:41.558106  3260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.013s	sys 0.045s
I20260709 12:14:41.917725  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:41.912421  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 477308us
W20260709 12:14:41.999161  3260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.359s	user 0.014s	sys 0.078s
W20260709 12:14:41.757200  3306 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.011s	sys 0.054s
W20260709 12:14:42.000082  3306 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.015s	sys 0.063s
I20260709 12:14:42.000484  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:41.671561  3261 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:42.001242  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2265) took 1005 ms. Trace:
I20260709 12:14:42.001591  3261 rpcz_store.cc:276] 0709 12:14:40.995997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.341990 (+345993us) service_pool.cc:224] Handling call
0709 12:14:42.001180 (+659190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:42.002707  3306 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:41.509994  3339 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
W20260709 12:14:41.773497  3928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.007s	sys 0.050s
W20260709 12:14:42.003542  3928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.128s	user 0.009s	sys 0.053s
I20260709 12:14:42.002838  3088 catalog_manager.cc:5697] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 7 to 8, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 8 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:41.796037  6814 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:41.775548  6990 log.cc:927] Time spent T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:14:41.917771  6980 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:41.886339  6994 log.cc:927] Time spent T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:14:41.475370  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:41.943691  3341 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:41.950670  3342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 885) took 2486 ms. Trace:
I20260709 12:14:41.494866  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:41.917954  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
W20260709 12:14:41.964186  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 614476us
I20260709 12:14:41.437716  3185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40510 (request call id 2090) took 1301 ms. Trace:
I20260709 12:14:41.968113  3263 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:42.019560  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:42.014578  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:42.020236  3263 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 5.
I20260709 12:14:42.020684  3261 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:42.021144  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:42.016197  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:42.021807  3263 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
W20260709 12:14:41.971391  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 521468us
I20260709 12:14:41.524907  6481 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.535480  6912 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:41.473693  6913 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:41.571818  6910 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.473636  6765 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.447820  6909 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:41.773198  6730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.013s	sys 0.014s
I20260709 12:14:41.977600  3231 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:41.521911  6710 consensus_meta.cc:287] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.002s
W20260709 12:14:41.944928  6717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.018s	sys 0.062s
I20260709 12:14:41.941514  6818 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.913086  6986 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:41.941111  6916 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:41.985903  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:41.918498  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:42.010223  6965 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:41.993180  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:41.993420  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:41.993575  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:41.469597  6766 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.508s
I20260709 12:14:41.563356  6859 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:41.571274  6930 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:42.117110  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:42.069096  6979 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:42.004920  3337 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:14:42.005946  3339 raft_consensus.cc:1240] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:41.958520  6865 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:42.006389  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:42.006456  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:41.960745  6860 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:41.995797  6749 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:41.473219  6873 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:41.475530  6735 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:42.022272  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:41.527480  6872 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:41.474246  6799 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:42.016446  3342 rpcz_store.cc:276] 0709 12:14:39.463995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.497527 (+ 33532us) service_pool.cc:224] Handling call
0709 12:14:39.527936 (+ 30409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.536243 (+  8307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.536271 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.546857 (+ 10586us) log.cc:844] Serialized 26 byte log entry
0709 12:14:39.977261 (+430404us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:39.977304 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.977367 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.421826 (+1444459us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:41.912739 (+490913us) raft_consensus.cc:1685] finished
0709 12:14:41.912765 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.950584 (+ 37819us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7908,"raft.queue_time_us":8342,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":6554,"spinlock_wait_cycles":80693504,"thread_start_us":368986,"threads_started":1,"wal-append.queue_time_us":762682}
I20260709 12:14:41.984341  6866 raft_consensus.cc:740] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:41.979497  6993 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:42.073144  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:42.009058  6814 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:42.064486  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:42.027872  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:42.069518  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:42.025914  3340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.000s	sys 0.013s
W20260709 12:14:42.185148  3340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.000s	sys 0.015s
I20260709 12:14:42.031127  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:42.016976  6977 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:42.084563  6765 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:42.079097  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:42.079519  3268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.020s	sys 0.051s
W20260709 12:14:42.214125  3268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.025s	sys 0.056s
I20260709 12:14:42.066622  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:42.018818  3185 rpcz_store.cc:276] 0709 12:14:40.135997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.234690 (+ 98693us) service_pool.cc:224] Handling call
0709 12:14:40.235048 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.235294 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:40.682796 (+447502us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.437272 (+754476us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:41.437339 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:41.437407 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.437493 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.437647 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190313,"prepare.queue_time_us":378001,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":168730,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":929862,"threads_started":2,"wal-append.queue_time_us":649792}
I20260709 12:14:42.015300  6995 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:42.018659  3895 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:14:42.220947  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 202352us
I20260709 12:14:42.086072  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:42.086938  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:42.090830  3190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40494 (request call id 1900) took 2606 ms. Trace:
I20260709 12:14:42.010025  6900 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:42.011211  6988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.016s	sys 0.043s
W20260709 12:14:42.050966  6899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.006s	sys 0.015s
W20260709 12:14:42.025801  6746 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.496s	user 0.010s	sys 0.008s
I20260709 12:14:42.096101  3189 raft_consensus.cc:2410] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:14:42.111301  3088 catalog_manager.cc:5697] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.013448  6987 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:42.004303  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55426 (request call id 644) took 1242 ms. Trace:
I20260709 12:14:42.287683  3928 rpcz_store.cc:276] 0709 12:14:40.762100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.791458 (+ 29358us) service_pool.cc:224] Handling call
0709 12:14:40.832873 (+ 41415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.833121 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:14:40.874974 (+ 41853us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.003952 (+1128978us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.004007 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:42.004052 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.004128 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.004247 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":865,"prepare.queue_time_us":33672,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":11547,"raft.queue_time_us":162734,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":10381,"thread_start_us":1128614,"threads_started":1,"wal-append.queue_time_us":1304434}
I20260709 12:14:42.028301  6974 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:42.023816  6996 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:42.009645  6864 consensus_queue.cc:1048] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 12:14:42.165115  3267 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
W20260709 12:14:42.081327  6730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.460s	user 0.014s	sys 0.018s
I20260709 12:14:42.024798  6489 consensus_queue.cc:1059] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 12:14:42.187153  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2258) took 1193 ms. Trace:
I20260709 12:14:42.318964  3261 rpcz_store.cc:276] 0709 12:14:40.993320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.186307 (+1192987us) service_pool.cc:224] Handling call
0709 12:14:42.186612 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.186809 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.186842 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.186886 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:42.186930 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.186994 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.187098 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:42.079100  3307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.000s	sys 0.015s
W20260709 12:14:42.320808  3307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.000s	sys 0.015s
W20260709 12:14:42.275827  6899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.006s	sys 0.017s
I20260709 12:14:42.166343  6481 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:42.216904  3184 raft_consensus.cc:2368] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8.
W20260709 12:14:42.327564  3265 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.054s	user 0.030s	sys 0.046s
W20260709 12:14:42.328574  3265 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.055s	user 0.031s	sys 0.046s
W20260709 12:14:42.092029  6717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.019s	sys 0.062s
I20260709 12:14:42.224485  3190 rpcz_store.cc:276] 0709 12:14:39.485159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.485485 (+   326us) service_pool.cc:224] Handling call
0709 12:14:39.485813 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:39.526105 (+ 40292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.526134 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:39.532385 (+  6251us) log.cc:844] Serialized 52 byte log entry
0709 12:14:40.051836 (+519451us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:40.561897 (+510061us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.562719 (+   822us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.152404 (+589685us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b1800387760. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb45ac0a 00007f1af4b9a219 00007f1aeb4e2a40 00007f1aeb4dd4e4 00007f1aeb4dd455 00007f1aee5c5060 00007f1aee5d7716 00007f1aee5e8287 00007f1aee5e8208
0709 12:14:41.152586 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.152650 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.343196 (+190546us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:41.416359 (+ 73163us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b1800387760. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb45ac0a 00007f1af4b9a219 00007f1af24a158f 00007f1aeb4e0571 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd
0709 12:14:42.090509 (+674150us) raft_consensus.cc:1685] finished
0709 12:14:42.090545 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.090751 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":883991,"prepare.queue_time_us":611928,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":662254,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":18567,"spinlock_wait_cycles":118579328,"thread_start_us":895277,"threads_started":2,"wal-append.queue_time_us":822628}
W20260709 12:14:42.320639  6997 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:14:42.118247  6965 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:42.096427  6710 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:42.231308  6814 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:42.120947  7001 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 12:14:42.180341  6916 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:42.235211  6988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.017s	sys 0.043s
I20260709 12:14:42.241387  6900 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:42.243402  6962 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:42.246766  6803 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:42.248642  6961 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:42.246757  3338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2306) took 1083 ms. Trace:
I20260709 12:14:42.332046  6973 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:42.254952  3337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 889) took 1042 ms. Trace:
I20260709 12:14:42.383908  3337 rpcz_store.cc:276] 0709 12:14:41.212331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.489487 (+277156us) service_pool.cc:224] Handling call
0709 12:14:42.004686 (+515199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:42.165722 (+161036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.254723 (+ 89001us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b5400078850. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cc8ad 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:42.254882 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184051584}
I20260709 12:14:42.256024  6650 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:42.257005  6741 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:42.257453  6866 consensus_queue.cc:260] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:42.385223  6987 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:42.385730  6987 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:42.385835  6866 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:42.388367  6998 log.cc:927] Time spent T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:14:42.390394  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2252) took 2308 ms. Trace:
I20260709 12:14:42.236919  6995 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:42.390923  6916 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:42.390869  3260 rpcz_store.cc:276] 0709 12:14:40.081835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.081976 (+   141us) service_pool.cc:224] Handling call
0709 12:14:40.139732 (+ 57756us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:40.564307 (+424575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.564351 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:40.597583 (+ 33232us) log.cc:844] Serialized 52 byte log entry
0709 12:14:41.266797 (+669214us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b480018c258. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af34f6aa1 00007f1af34edb37 00007f1af34ed9ca 00007f1af35e526f 00007f1af35e4f37 00007f1af35f955c 00007f1af35f9508 00007f1af35f9488 00007f1af35f9443 00007f1af35f86ec 00007f1af2522a96
0709 12:14:41.999616 (+732819us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:42.026986 (+ 27370us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.027279 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.027402 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.027490 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.310371 (+282881us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b1800453ac0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4ae2a6 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1
0709 12:14:42.390090 (+ 79719us) raft_consensus.cc:1685] finished
0709 12:14:42.390124 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.390315 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":279061,"raft.run_cpu_time_us":6135,"raft.run_wall_time_us":1146257,"spinlock_wait_cycles":81795968,"thread_start_us":1782429,"threads_started":2,"wal-append.queue_time_us":1539863}
W20260709 12:14:42.232889  6937 log.cc:927] Time spent T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:14:42.393035  6916 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:42.176263  6860 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.393960  6860 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:42.395323  3263 pending_rounds.cc:85] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 3
I20260709 12:14:42.395692  3263 pending_rounds.cc:107] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:14:42.395990  3263 raft_consensus.cc:2889] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:42.396095  6860 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:42.220125  6993 consensus_queue.cc:1059] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:14:42.396446  6909 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:42.396992  6993 raft_consensus.cc:3055] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:42.397356  6993 raft_consensus.cc:740] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:42.397815  6765 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:42.398195  6993 consensus_queue.cc:260] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:42.192947  7000 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:42.399611  7000 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:42.400012  7000 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:42.285612  3334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.011s	sys 0.048s
W20260709 12:14:42.310196  3305 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.005s	sys 0.071s
W20260709 12:14:42.403683  6990 log.cc:927] Time spent T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:14:42.403889  3305 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.005s	sys 0.071s
I20260709 12:14:42.405562  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:42.406327  6710 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:42.406801  3264 raft_consensus.cc:2393] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:14:42.403786  3334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.011s	sys 0.049s
I20260709 12:14:42.338235  6986 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:42.321491  3267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2259) took 1327 ms. Trace:
I20260709 12:14:42.188172  3191 raft_consensus.cc:2410] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:14:42.325237  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2260) took 1331 ms. Trace:
I20260709 12:14:42.427002  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:42.427366  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:42.426307  3267 rpcz_store.cc:276] 0709 12:14:40.993612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.320418 (+1326806us) service_pool.cc:224] Handling call
0709 12:14:42.320822 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.321076 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.321115 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.321171 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:42.321225 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.321297 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.321423 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:42.427273  3261 rpcz_store.cc:276] 0709 12:14:40.993886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.324383 (+1330497us) service_pool.cc:224] Handling call
0709 12:14:42.324723 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.324903 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.324930 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.324973 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:42.325009 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.325061 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.325180 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:42.426347  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:42.428712  3337 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:42.428865  3267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2266) took 1432 ms. Trace:
I20260709 12:14:42.429164  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2267) took 1432 ms. Trace:
W20260709 12:14:42.311483  6746 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.797s	user 0.010s	sys 0.017s
I20260709 12:14:42.332835  3265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2248) took 2256 ms. Trace:
I20260709 12:14:42.230857  6980 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:42.089284  6913 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:42.084906  6910 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:42.347332  3193 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 5.
I20260709 12:14:42.433434  3265 rpcz_store.cc:276] 0709 12:14:40.076701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.076864 (+   163us) service_pool.cc:224] Handling call
0709 12:14:40.137612 (+ 60748us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:40.596198 (+458586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.596276 (+    78us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:40.597457 (+  1181us) log.cc:844] Serialized 26 byte log entry
0709 12:14:41.273398 (+675941us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:42.332133 (+1058735us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.332499 (+   366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.332578 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.332619 (+    41us) raft_consensus.cc:1685] finished
0709 12:14:42.332636 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.332776 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":62545,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":43569,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":36420,"thread_start_us":2113247,"threads_started":3,"wal-append.queue_time_us":994007}
I20260709 12:14:42.328517  6865 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.321606  6996 raft_consensus.cc:697] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:42.492751  3187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:42.349763  6669 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:42.525707  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 71286.2us
I20260709 12:14:42.096129  6818 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:42.362618  6917 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.363852  6481 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:42.365949  7003 log.cc:927] Time spent T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:14:42.366266  6999 raft_consensus.cc:2804] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:42.375468  3268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2249) took 2298 ms. Trace:
I20260709 12:14:42.378726  6871 raft_consensus.cc:3055] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:42.383126  6735 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:42.394254  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2262) took 1399 ms. Trace:
I20260709 12:14:42.550814  3260 rpcz_store.cc:276] 0709 12:14:40.994425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.393256 (+1398831us) service_pool.cc:224] Handling call
0709 12:14:42.393631 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.393855 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.393892 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.393950 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:42.394006 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.394073 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.394189 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:42.121402  6859 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:42.539561  6710 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.557677  6710 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:42.558773  6859 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:42.312060  3930 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:42.559674  6710 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:42.335673  3088 catalog_manager.cc:5697] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 4 to 6, now has a pending config: VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65), VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66), VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67), VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 6 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:42.411232  3185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:42.562959  3088 catalog_manager.cc:5697] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.412093  3188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:42.413807  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3"
I20260709 12:14:42.565403  3184 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:42.565007  3088 catalog_manager.cc:5697] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 8 to 9, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 9 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.412937  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:42.567976  7009 log.cc:927] Time spent T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:14:42.427511  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:42.429801  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:42.569309  3341 raft_consensus.cc:2410] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:42.570446  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:42.429509  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:42.429641  3261 rpcz_store.cc:276] 0709 12:14:40.997156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.428435 (+1431279us) service_pool.cc:224] Handling call
0709 12:14:42.428697 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.428870 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.428893 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.428931 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:42.428962 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.429008 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.429116 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:42.429293  3267 rpcz_store.cc:276] 0709 12:14:40.996263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.428127 (+1431864us) service_pool.cc:224] Handling call
0709 12:14:42.428408 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.428570 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.428594 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.428633 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:42.428661 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.428716 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.428815 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:42.430286  3339 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:14:42.432541  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:42.572392  3261 raft_consensus.cc:1275] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:14:42.443397  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.328889  6872 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:42.432646  6749 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:42.463675  3333 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.004s	sys 0.012s
I20260709 12:14:42.491961  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:42.356995  3338 rpcz_store.cc:276] 0709 12:14:41.163485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.470971 (+307486us) service_pool.cc:224] Handling call
0709 12:14:41.477031 (+  6060us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.992630 (+515599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.992662 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:41.992707 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:41.992745 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.246430 (+253685us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b540036cc54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:42.246489 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.246678 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185258752}
I20260709 12:14:42.529146  6912 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:42.224267  6930 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:42.528054  3896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.011s	sys 0.000s
I20260709 12:14:42.399420  6993 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:42.393035  6995 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:42.458835  6984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.001s	sys 0.004s
I20260709 12:14:42.536062  3305 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:42.541015  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 378688us
I20260709 12:14:42.545017  3259 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
I20260709 12:14:42.540838  3268 rpcz_store.cc:276] 0709 12:14:40.077205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.077335 (+   130us) service_pool.cc:224] Handling call
0709 12:14:40.155933 (+ 78598us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:41.092752 (+936819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.092826 (+    74us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:41.094299 (+  1473us) log.cc:844] Serialized 52 byte log entry
0709 12:14:41.150568 (+ 56269us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b480018c258. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af34f6aa1 00007f1af34edb37 00007f1af34ed9ca 00007f1af35e526f 00007f1af35e4f37 00007f1af35f955c 00007f1af35f9508 00007f1af35f9488 00007f1af35f9443 00007f1af35f86ec 00007f1af2522a96
0709 12:14:42.214724 (+1064156us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:42.214787 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.214881 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.375026 (+160145us) raft_consensus.cc:1685] finished
0709 12:14:42.375055 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.375369 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4657,"raft.queue_time_us":36669,"raft.run_cpu_time_us":13197,"raft.run_wall_time_us":957682,"spinlock_wait_cycles":61511936,"thread_start_us":1976830,"threads_started":2,"wal-append.queue_time_us":1227849}
I20260709 12:14:42.548696  3265 raft_consensus.cc:1275] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:42.492300  6973 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.538239  6917 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:42.545516  6871 raft_consensus.cc:740] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:42.571724  3337 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:42.525269  6974 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:42.527230  3335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.001s	sys 0.009s
I20260709 12:14:42.453158  6986 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:42.573133  3189 raft_consensus.cc:2410] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:14:42.964308  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:42.964962  3333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.603s	user 0.015s	sys 0.035s
I20260709 12:14:42.965161  3339 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
W20260709 12:14:42.839732  3897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.007s	sys 0.023s
W20260709 12:14:42.965844  3897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.010s	sys 0.024s
I20260709 12:14:42.966066  3265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2268) took 1968 ms. Trace:
W20260709 12:14:42.832192  3340 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.007s	sys 0.017s
I20260709 12:14:42.966507  3265 rpcz_store.cc:276] 0709 12:14:40.997435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.525365 (+1527930us) service_pool.cc:224] Handling call
0709 12:14:42.541068 (+ 15703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.965828 (+424760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.966010 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:42.967301  3340 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.010s	sys 0.019s
I20260709 12:14:42.669627  3184 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 11.
I20260709 12:14:42.968516  3340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 2284) took 1820 ms. Trace:
I20260709 12:14:42.680450  6900 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:42.969431  3335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.009s	sys 0.010s
I20260709 12:14:42.614277  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:42.971194  6984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.424s	user 0.006s	sys 0.013s
W20260709 12:14:42.654650  3157 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.032s	sys 0.082s
I20260709 12:14:42.538790  6860 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:42.973898  6860 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:42.972014  3157 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.032s	sys 0.090s
W20260709 12:14:42.988315  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 962709us
W20260709 12:14:42.860314  3895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.011s	sys 0.015s
W20260709 12:14:42.989678  3895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.011s	sys 0.019s
W20260709 12:14:42.990056  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 674753us
W20260709 12:14:42.972398  3896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.013s	sys 0.018s
I20260709 12:14:42.972259  6872 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:42.856885  6815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.007s	sys 0.016s
I20260709 12:14:42.677752  6899 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:42.973102  6930 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:42.685122  6965 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:42.964825  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 741) took 1939 ms. Trace:
I20260709 12:14:43.031785  3261 rpcz_store.cc:276] 0709 12:14:41.025816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.571789 (+1545973us) service_pool.cc:224] Handling call
0709 12:14:42.572082 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.964431 (+392349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.964743 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:42.571126  3341 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:14:42.682611  7011 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:42.654860  6999 raft_consensus.cc:697] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:42.595028  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:42.540645  6720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.008s	sys 0.003s
W20260709 12:14:43.034664  6720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.366s	user 0.010s	sys 0.021s
I20260709 12:14:42.970571  6912 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:42.530545  6865 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:42.566864  3088 catalog_manager.cc:5697] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:43.046754  3088 catalog_manager.cc:5697] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 4 to 5, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 5 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
W20260709 12:14:43.054479  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 65247.7us
I20260709 12:14:43.055213  3930 raft_consensus.cc:1275] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:42.872617  6996 consensus_queue.cc:237] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:42.969019  3340 rpcz_store.cc:276] 0709 12:14:41.147776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.151279 (+  3503us) service_pool.cc:224] Handling call
0709 12:14:41.151643 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.151936 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.151962 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:41.152409 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.185579 (+1033170us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:42.967818 (+782239us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.968131 (+   313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.968226 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.968280 (+    54us) raft_consensus.cc:1685] finished
0709 12:14:42.968297 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.968449 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129434,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":12684,"thread_start_us":1765049,"threads_started":2,"wal-append.queue_time_us":1184017}
I20260709 12:14:42.542140  6799 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:43.074254  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:43.074514  3336 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.026s	sys 0.018s
W20260709 12:14:43.074941  3336 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.026s	sys 0.018s
W20260709 12:14:43.023470  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 487486us
W20260709 12:14:43.028334  6815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.010s	sys 0.019s
W20260709 12:14:43.080144  3232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.030s	sys 0.050s
I20260709 12:14:43.079977  3088 catalog_manager.cc:5697] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 6 to 7, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 7 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:43.084889  3305 leader_election.cc:400] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Vote denied by peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889) with higher term. Message: Invalid argument: T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8.
W20260709 12:14:43.092298  3232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.030s	sys 0.050s
W20260709 12:14:43.095120  3231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.009s	sys 0.039s
W20260709 12:14:43.095679  3231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.009s	sys 0.039s
W20260709 12:14:43.096012  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 1.11841e+06us
I20260709 12:14:43.100595  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:43.031044  6900 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:43.024221  6977 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:43.025827  6995 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.023247  6973 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:43.107848  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.107205  3088 catalog_manager.cc:5697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 4 to 7, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 7 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:43.033761  7011 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.124641  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:43.076126  6669 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:43.086107  6735 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:43.099301  7013 log.cc:927] Time spent T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:43.025655  6974 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:43.085958  3307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.006s	sys 0.037s
I20260709 12:14:43.144635  3088 catalog_manager.cc:5697] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 1 to 2, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 2 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:14:43.145656  3307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.006s	sys 0.037s
I20260709 12:14:43.094671  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:43.146229  3088 catalog_manager.cc:5697] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 5 to 8, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 8 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:43.112587  6930 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.112813  6984 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:43.036692  6899 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.158228  3232 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:43.005277  6871 consensus_queue.cc:260] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:43.097803  6481 consensus_queue.cc:1048] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:14:43.126765  6917 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.149914  6986 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:43.169938  3232 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:43.034101  6999 consensus_queue.cc:237] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.193547  3306 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:43.194514  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:43.151031  6735 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.147452  6912 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:43.201818  3232 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:43.198992  3342 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
I20260709 12:14:43.168870  6910 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:43.203964  6871 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:43.172356  7001 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:43.163978  3088 catalog_manager.cc:5697] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 4 to 6, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 6 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:43.206382  3088 catalog_manager.cc:5697] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 3 to 4, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 4 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:43.223353  3232 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:43.161191  6913 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.173494  6965 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.118664  6900 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.201891  6866 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:43.245875  6965 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:43.230014  6986 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:43.211496  6917 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:43.205983  7020 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:43.123502  6995 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.166253  6930 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.221892  6865 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.235809  7027 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.242518  6910 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:43.230386  6815 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:43.294660  6872 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:43.168567  6984 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:43.277841  6664 consensus_meta.cc:287] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 1.272s	user 0.011s	sys 0.000s
I20260709 12:14:43.278949  6735 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.279531  6860 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:43.262445  6866 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.284292  6873 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:43.286834  6987 consensus_meta.cc:287] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.901s	user 0.006s	sys 0.004s
I20260709 12:14:43.293059  6965 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:43.256956  7001 raft_consensus.cc:2804] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:43.268939  6986 raft_consensus.cc:697] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 11 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:14:43.296797  6978 consensus_meta.cc:287] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 1.308s	user 0.008s	sys 0.004s
I20260709 12:14:43.337617  6910 raft_consensus.cc:697] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:43.266330  6917 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.350922  7001 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:43.295763  7027 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:43.349666  6987 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.363538  7001 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:43.342180  6664 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:43.456283  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 400180us
W20260709 12:14:43.460109  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 236674us
W20260709 12:14:43.461611  3156 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.661s (SENT) [suppressed 5 similar messages]
W20260709 12:14:43.463454  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:43.464494  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:43.465688  3262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.029s	sys 0.038s
W20260709 12:14:43.466264  3263 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.035s
I20260709 12:14:43.412961  6900 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.389290  6910 consensus_queue.cc:237] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:43.414803  6917 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.409063  6930 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.375676  6974 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.365331  6978 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:43.376891  6986 consensus_queue.cc:237] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:43.393829  6995 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:43.418378  7000 consensus_meta.cc:287] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 1.018s	user 0.006s	sys 0.006s
I20260709 12:14:43.566386  7000 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.568130  3266 raft_consensus.cc:2393] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:43.568959  3261 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:43.569159  7000 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.369407  7011 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.414180  7027 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:43.523887  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.573256  3232 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:43.574440  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.525463  6873 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:43.575486  6965 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:43.576315  6965 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:43.578789  6965 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:43.528769  3896 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:43.583762  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 55402.8us
I20260709 12:14:43.583940  3157 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:43.539685  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:43.584592  6993 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:43.585158  6993 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:43.585673  6993 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:43.551344  3262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.029s	sys 0.038s
I20260709 12:14:43.588491  3264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2261) took 2594 ms. Trace:
I20260709 12:14:43.589455  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 737) took 2717 ms. Trace:
I20260709 12:14:43.589614  7042 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:43.551096  3263 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.000s	sys 0.035s
I20260709 12:14:43.590566  7042 raft_consensus.cc:697] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:43.592454  7020 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:43.593302  7020 raft_consensus.cc:697] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:43.546160  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:43.406481  6866 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.596055  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2269) took 2598 ms. Trace:
I20260709 12:14:43.596550  3260 rpcz_store.cc:276] 0709 12:14:40.997741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.551963 (+1554222us) service_pool.cc:224] Handling call
0709 12:14:42.552320 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.576435 (+ 24115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.576479 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.576537 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:42.576591 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.595488 (+1018897us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b54003a89d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:43.595555 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.595839 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54883584}
I20260709 12:14:43.589003  3264 rpcz_store.cc:276] 0709 12:14:40.994161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.072803 (+1078642us) service_pool.cc:224] Handling call
0709 12:14:43.588003 (+1515200us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54003d40d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:43.588267 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511432448}
I20260709 12:14:43.598233  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:43.599784  3341 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:43.559262  3931 raft_consensus.cc:1240] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:43.601095  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:43.572429  6664 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:43.544106  6872 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:43.602983  3335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 2285) took 2448 ms. Trace:
I20260709 12:14:43.603217  6872 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.603933  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:43.607537  7004 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:43.608496  7004 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.610747  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:43.610996  6872 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.563419  6978 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:43.598536  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.613097  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.614897  3268 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
W20260709 12:14:43.635301  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 462563us
I20260709 12:14:43.639592  7000 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:43.639914  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:43.640875  3930 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 4.
I20260709 12:14:43.640641  7000 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:43.642027  7024 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.642841  7024 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:43.647778  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 73124.3us
W20260709 12:14:43.649451  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 187989us
I20260709 12:14:43.645004  6873 consensus_queue.cc:1059] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 12:14:43.655361  3193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47276 (request call id 560) took 2203 ms (client timeout 1536 ms). Trace:
I20260709 12:14:43.656056  6965 raft_consensus.cc:3055] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:14:43.655958  3193 rpcz_store.cc:269] 0709 12:14:41.444922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.467636 (+ 22714us) service_pool.cc:224] Handling call
0709 12:14:43.583402 (+2115766us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54002431d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:43.648182 (+ 64780us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":817090304}
I20260709 12:14:43.656720  6965 raft_consensus.cc:740] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:43.595177  7020 consensus_queue.cc:237] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.658094  6965 consensus_queue.cc:260] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.659672  6965 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:43.663080  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.663771  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:43.664528  3334 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.005s	sys 0.015s
I20260709 12:14:43.664655  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.667922  6977 consensus_queue.cc:1059] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:14:43.643592  7000 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:43.651156  3260 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
W20260709 12:14:43.682603  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 553364us
W20260709 12:14:43.680249  3334 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.006s	sys 0.015s
I20260709 12:14:43.692070  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:43.692274  6977 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:43.693259  6983 raft_consensus.cc:3055] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:43.693360  7024 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:43.693809  6983 raft_consensus.cc:740] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:43.694707  7042 consensus_queue.cc:237] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:43.695851  3306 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:43.696563  3264 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:43.697424  6872 raft_consensus.cc:2804] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:43.697829  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.693019  6977 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.696108  3338 raft_consensus.cc:1240] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:14:43.690662  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:43.684060  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:43.698558  3264 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:43.617054  3335 rpcz_store.cc:276] 0709 12:14:41.154629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.450033 (+295404us) service_pool.cc:224] Handling call
0709 12:14:41.474657 (+ 24624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.914393 (+439736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.914437 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:41.944422 (+ 29985us) log.cc:844] Serialized 26 byte log entry
0709 12:14:43.601298 (+1656876us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b54002619a0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee537090 00007f1aee5446b8 00007f1aee5cd92b 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c
0709 12:14:43.601403 (+   105us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:43.601930 (+   527us) log.cc:844] Serialized 14 byte log entry
0709 12:14:43.602254 (+   324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.602418 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:43.602478 (+    60us) raft_consensus.cc:1685] finished
0709 12:14:43.602560 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.602773 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38736,"prepare.queue_time_us":6793,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":497322,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":20011,"spinlock_wait_cycles":192404864,"thread_start_us":975034,"threads_started":1,"wal-append.queue_time_us":710678}
I20260709 12:14:43.589964  3262 rpcz_store.cc:276] 0709 12:14:40.871844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.166417 (+1294573us) service_pool.cc:224] Handling call
0709 12:14:42.166775 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.166991 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:42.544208 (+377217us) log.cc:844] Serialized 14 byte log entry
0709 12:14:43.588464 (+1044256us) log.cc:844] Serialized 14 byte log entry
0709 12:14:43.588840 (+   376us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:43.588917 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:43.589009 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.589140 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.589366 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":942522,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":14452,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":374,"spinlock_wait_cycles":2001536,"thread_start_us":1420242,"threads_started":2,"wal-append.queue_time_us":842365}
I20260709 12:14:43.707702  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:43.711865  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:43.697849  6872 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:43.713227  3334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 2289) took 2551 ms. Trace:
I20260709 12:14:43.713814  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:43.715993  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:43.718997  3337 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:43.720705  3340 raft_consensus.cc:1240] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:14:43.723620  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.708921  6979 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:14:43.724692  3267 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:43.726207  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.726478  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:43.727272  3267 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:43.728889  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.732779  3232 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:43.734954  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.736958  7024 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:43.737464  3232 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:43.716459  6872 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:43.728228  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.747287  7022 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.748064  3231 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:43.747991  7022 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.749859  7000 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:43.750388  6977 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:43.750559  7022 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:43.751098  7000 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:43.751636  6818 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:43.752497  3260 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:43.765048  7001 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.695182  6983 consensus_queue.cc:260] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.767174  6983 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:43.771919  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:43.772852  7028 log.cc:927] Time spent T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.576s	user 0.000s	sys 0.001s
I20260709 12:14:43.773713  3336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58568 (request call id 2288) took 2612 ms. Trace:
I20260709 12:14:43.774595  3268 raft_consensus.cc:2410] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:43.774361  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.765676  6984 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:43.777860  3267 raft_consensus.cc:2410] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:14:43.773746  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:43.779096  3340 raft_consensus.cc:2393] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 9: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:43.714660  3334 rpcz_store.cc:276] 0709 12:14:41.162202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.466484 (+304282us) service_pool.cc:224] Handling call
0709 12:14:41.466854 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.478941 (+ 12087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.478976 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:41.479513 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.408031 (+928518us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:42.610238 (+202207us) log.cc:844] Serialized 14 byte log entry
0709 12:14:43.712784 (+1102546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.712898 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:43.712970 (+    72us) raft_consensus.cc:1685] finished
0709 12:14:43.712981 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.713169 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9012,"prepare.queue_time_us":782815,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":714836,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":42996,"thread_start_us":2120431,"threads_started":3,"wal-append.queue_time_us":1199872,"wal-append.run_cpu_time_us":2002,"wal-append.run_wall_time_us":1002028}
I20260709 12:14:43.790812  3337 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:43.793522  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:43.795754  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:43.800505  7018 log.cc:927] Time spent T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.714s	user 0.000s	sys 0.004s
I20260709 12:14:43.802668  3333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2298) took 3028 ms. Trace:
I20260709 12:14:43.803046  3333 rpcz_store.cc:276] 0709 12:14:40.774512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.775073 (+   561us) service_pool.cc:224] Handling call
0709 12:14:40.785393 (+ 10320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:40.785807 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.785847 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:41.360997 (+575150us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b2c000e61b8. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aecec6a11 00007f1aeced6372 00007f1aee608a01 00007f1aee5cd43a 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2
0709 12:14:41.361431 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.965627 (+1604196us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:42.965677 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.965738 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:43.771339 (+805601us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:43.802263 (+ 30924us) raft_consensus.cc:1685] finished
0709 12:14:43.802290 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.802459 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143227,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":59249,"spinlock_wait_cycles":25334400,"thread_start_us":1603820,"threads_started":1,"wal-append.queue_time_us":1477457}
I20260709 12:14:43.806432  3262 raft_consensus.cc:1240] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:14:43.811865  3266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2270) took 1835 ms (client timeout 1784 ms). Trace:
W20260709 12:14:43.812301  3266 rpcz_store.cc:269] 0709 12:14:41.976247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.004850 (+ 28603us) service_pool.cc:224] Handling call
0709 12:14:43.811611 (+1806761us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000fe454. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:43.811781 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3170902912}
I20260709 12:14:43.812750  6993 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:43.814394  3924 raft_consensus.cc:2393] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 9: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:43.815783  7001 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.816896  3342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58568 (request call id 2299) took 1363 ms. Trace:
I20260709 12:14:43.817313  3342 rpcz_store.cc:276] 0709 12:14:42.453790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.594750 (+140960us) service_pool.cc:224] Handling call
0709 12:14:43.816574 (+1221824us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400020654. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:43.816725 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271931648}
I20260709 12:14:43.819887  7004 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:43.774135  3336 rpcz_store.cc:276] 0709 12:14:41.161556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.455580 (+294024us) service_pool.cc:224] Handling call
0709 12:14:41.943874 (+488294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.987875 (+ 44001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.987908 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:42.021569 (+ 33661us) log.cc:844] Serialized 26 byte log entry
0709 12:14:43.075399 (+1053830us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:43.684354 (+608955us) log.cc:844] Serialized 14 byte log entry
0709 12:14:43.744306 (+ 59952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.773224 (+ 28918us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:43.773327 (+   103us) raft_consensus.cc:1685] finished
0709 12:14:43.773342 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.773505 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43597,"prepare.queue_time_us":115634,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":59656,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":22107,"thread_start_us":1426023,"threads_started":2,"wal-append.queue_time_us":1155371}
I20260709 12:14:43.821714  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:43.824103  7001 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:43.824975  7001 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:43.841907  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:43.864480  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:43.869939  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:43.871946  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 84370.4us
I20260709 12:14:43.868393  3262 raft_consensus.cc:1240] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:14:43.872375  3924 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:43.839836  6993 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:43.886129  3336 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:43.858950  7001 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:43.891593  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:43.893541  3306 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:43.910770  7054 log.cc:927] Time spent T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:14:43.921463  6899 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:43.925133  3263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2257) took 2932 ms. Trace:
I20260709 12:14:43.925544  3263 rpcz_store.cc:276] 0709 12:14:40.993034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.185714 (+1192680us) service_pool.cc:224] Handling call
0709 12:14:42.186165 (+   451us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:42.396810 (+210645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.396855 (+    45us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:42.397670 (+   815us) log.cc:844] Serialized 78 byte log entry
0709 12:14:42.672121 (+274451us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:43.591018 (+918897us) log.cc:844] Serialized 14 byte log entry
0709 12:14:43.591470 (+   452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.924736 (+333266us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54001a2054. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:43.924780 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:43.924845 (+    65us) raft_consensus.cc:1685] finished
0709 12:14:43.924926 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.925079 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":470631,"prepare.run_cpu_time_us":1503,"prepare.run_wall_time_us":4042,"raft.queue_time_us":14939,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":216,"spinlock_wait_cycles":480467840,"thread_start_us":900601,"threads_started":2,"wal-append.queue_time_us":950704}
I20260709 12:14:43.932251  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:43.935693  7004 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:43.936239  7004 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:43.936687  7004 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:43.937450  6749 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:43.945120  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 50659.6us
I20260709 12:14:43.947571  6987 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:43.948364  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.957412  6987 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.958139  6987 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:43.960239  3259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56754 (request call id 1744) took 3022 ms (client timeout 2129 ms). Trace:
W20260709 12:14:43.960723  3259 rpcz_store.cc:269] 0709 12:14:40.937676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.466530 (+528854us) service_pool.cc:224] Handling call
0709 12:14:43.959813 (+2493283us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b5400262354. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:43.959983 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214801792}
W20260709 12:14:43.967820  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 71818.1us
W20260709 12:14:43.969615  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 159825us
I20260709 12:14:43.973016  3260 raft_consensus.cc:2410] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:43.984843  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.001664  3931 raft_consensus.cc:2393] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:44.003268  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:44.026592  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.007535  6872 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.066188  3931 raft_consensus.cc:1240] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:44.083783  7017 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:44.083786  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.097661  7017 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.099812  7040 consensus_queue.cc:1048] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:44.100333  7017 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:44.101534  3335 raft_consensus.cc:2393] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:44.097723  3924 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
W20260709 12:14:44.102646  7063 log.cc:927] Time spent T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:14:44.108055  6973 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:44.108466  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.109256  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.110076  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.111701  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:44.112317  3924 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:44.114444  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:44.114868  6984 consensus_queue.cc:1048] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:14:44.115564  7049 log.cc:927] Time spent T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:14:44.116001  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.121486  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:44.122476  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:43.996053  6481 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.141810  6481 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.144855  6481 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:44.132838  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 180203us
I20260709 12:14:44.136924  6917 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:44.137697  3157 connection.cc:256] RPC call timeout handler was delayed by -1.7241356369997902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 12:14:44.154196  3157 connection.cc:256] RPC call timeout handler was delayed by -1.5729356369997731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
I20260709 12:14:44.137792  6871 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:44.155704  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.138327  7017 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.163542  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:44.169586  3339 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.173267  3157 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:44.178403  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:44.180757  3157 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:44.183318  6919 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:44.183727  6919 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:44.184115  7077 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:44.182837  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:44.186740  3157 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:44.179191  3335 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.187886  6872 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:44.178591  3265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 744) took 1069 ms. Trace:
I20260709 12:14:44.168027  6987 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:14:44.191624  3265 rpcz_store.cc:276] 0709 12:14:43.108646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.109193 (+   547us) service_pool.cc:224] Handling call
0709 12:14:43.123075 (+ 13882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:43.127512 (+  4437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:43.127542 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:43.147469 (+ 19927us) log.cc:844] Serialized 26 byte log entry
0709 12:14:43.652742 (+505273us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:43.659867 (+  7125us) log.cc:844] Serialized 14 byte log entry
0709 12:14:43.660154 (+   287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.660225 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:43.940320 (+280095us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b180043ea00. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
0709 12:14:44.178038 (+237718us) raft_consensus.cc:1685] finished
0709 12:14:44.178162 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.178357 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10713,"prepare.queue_time_us":7547,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":5626,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":17042,"spinlock_wait_cycles":157037440,"thread_start_us":357782,"threads_started":1,"wal-append.queue_time_us":399684}
I20260709 12:14:44.187451  6735 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:44.198645  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 190228us
I20260709 12:14:44.176311  3193 raft_consensus.cc:1275] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:44.202589  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:44.205816  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:44.184118  6919 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.198493  7020 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.213013  3186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
W20260709 12:14:44.222445  7064 log.cc:927] Time spent T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:14:44.222573  3333 raft_consensus.cc:1240] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:44.224840  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:44.225479  3925 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.207664  6735 raft_consensus.cc:2804] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:44.217917  3186 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:44.239960  2017 tablet_server.cc:179] TabletServer@127.1.248.65:0 shutting down...
I20260709 12:14:44.242477  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.243803  3189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:44.247738  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:44.247982  3333 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:44.222579  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.252405  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:44.253558  3335 raft_consensus.cc:2468] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:44.256292  3157 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:44.255280  3190 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:44.259045  3896 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:44.263686  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.230203  6735 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.266175  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.205894  6871 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.266446  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.214072  6987 consensus_queue.cc:1048] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:14:44.267217  3926 raft_consensus.cc:2393] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 9: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:44.263324  6993 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:14:44.269076  6979 raft_consensus.cc:2804] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:44.208093  7017 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.264397  3928 raft_consensus.cc:2468] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:44.207855  6917 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.278674  3924 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:44.289067  3930 raft_consensus.cc:1240] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:44.293190  7070 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:44.241561  7066 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:14:44.274737  6735 raft_consensus.cc:3060] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.288859  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ac63b674f204bc4805ab989f8c965d3" is_pre_election: true
I20260709 12:14:44.259707  7020 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:44.310180  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 58803.4us
I20260709 12:14:44.294003  6979 raft_consensus.cc:697] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:44.301627  7070 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:44.325654  3157 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:44.320075  7070 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.335286  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.337679  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.340857  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.349856  3268 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:44.348984  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.354897  3259 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:44.355931  6481 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:44.355970  7020 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:44.357843  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 45928.3us
I20260709 12:14:44.359062  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.360366  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:44.364930  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 55847.2us
I20260709 12:14:44.368005  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.368840  3264 raft_consensus.cc:2393] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:44.371389  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.371773  3260 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 12.
I20260709 12:14:44.372175  3264 raft_consensus.cc:2393] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:44.370678  3895 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:44.381747  6980 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:14:44.382000  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.376001  7001 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:44.384861  7001 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:44.389600  3925 raft_consensus.cc:2468] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:44.366101  7020 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:44.395071  6871 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:44.395999  6917 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:44.396129  6965 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:44.396953  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.398406  3157 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
W20260709 12:14:44.399904  7073 log.cc:927] Time spent T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:14:44.401479  7040 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:44.402254  7040 raft_consensus.cc:697] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:44.402987  7017 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:44.403163  7040 consensus_queue.cc:237] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:44.403770  6965 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:44.405784  6965 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:44.368326  6481 consensus_queue.cc:1059] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:14:44.346928  6979 consensus_queue.cc:237] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.415115  3339 raft_consensus.cc:2468] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:44.416385  3896 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:44.418778  7012 consensus_queue.cc:1059] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:44.373160  7004 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.423697  3306 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:44.428862  6749 raft_consensus.cc:2804] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:44.442183  3337 raft_consensus.cc:2393] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 9: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:44.438524  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.446029  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:44.446734  3928 raft_consensus.cc:2368] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8.
I20260709 12:14:44.449617  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:44.444635  7012 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.450325  3260 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.450518  7012 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.451545  6749 raft_consensus.cc:697] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:44.452523  6749 consensus_queue.cc:237] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.456863  7012 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:44.457223  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:44.462113  6735 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.468158  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.475567  7001 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:44.476264  6980 raft_consensus.cc:3055] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:44.485455  3260 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
I20260709 12:14:44.486436  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.502677  3925 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:14:44.434456  6973 raft_consensus.cc:2804] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:44.488794  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 47052us
W20260709 12:14:44.500171  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 54437.9us
I20260709 12:14:44.501384  3268 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:44.428938  6965 consensus_queue.cc:1059] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:14:44.504138  6980 raft_consensus.cc:740] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:44.513463  6980 consensus_queue.cc:260] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.514808  6980 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.516084  6973 raft_consensus.cc:697] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:44.517565  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.518203  3260 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
W20260709 12:14:44.525036  3305 connection.cc:256] RPC call timeout handler was delayed by -1.1646572980000656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
I20260709 12:14:44.525370  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.526677  6973 consensus_queue.cc:237] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.437232  7020 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:44.533843  7020 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:44.536952  7004 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:44.538275  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:44.547920  6965 raft_consensus.cc:3055] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:44.548607  6965 raft_consensus.cc:740] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:44.550472  6965 consensus_queue.cc:260] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.557032  6735 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:44.603698  3336 raft_consensus.cc:2468] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:44.605275  3896 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:44.567463  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 56296.8us
I20260709 12:14:44.582548  7020 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.585423  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:44.586437  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.586988  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.587397  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.587602  3259 raft_consensus.cc:1275] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:44.588395  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.589427  3261 raft_consensus.cc:1275] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:44.589758  6866 raft_consensus.cc:3055] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:44.595939  6919 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.597038  7070 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:44.600090  3087 catalog_manager.cc:5697] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 2 to 7, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 7 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:44.625768  3268 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:44.635265  7020 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:44.656863  6919 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:44.661316  7020 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:44.663414  7070 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:44.666489  3232 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:44.640307  6965 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:44.637236  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 111443us
I20260709 12:14:44.642863  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.670998  3261 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:44.641873  3087 catalog_manager.cc:5697] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 9, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 9 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:44.672942  3305 connection.cc:256] RPC call timeout handler was delayed by -1.0534441569998307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
I20260709 12:14:44.643008  3263 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:44.639453  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.634093  6866 raft_consensus.cc:740] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:44.674346  3262 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
I20260709 12:14:44.676028  3305 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:44.684065  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 45437.5us
I20260709 12:14:44.687327  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:44.636173  6749 raft_consensus.cc:2804] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:44.691133  3232 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:44.695847  3088 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48764 (request call id 297) took 19169 ms (client timeout 15000 ms). Trace:
I20260709 12:14:44.683804  3087 catalog_manager.cc:5697] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 reported cstate change: leader changed from <none> to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 7 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:44.686367  7020 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.699844  3268 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 6.
I20260709 12:14:44.690735  7004 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:44.700713  6749 raft_consensus.cc:697] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:44.716078  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:44.718708  3087 catalog_manager.cc:5697] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 8, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 8 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:44.707403  7001 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:44.791479  7001 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.723840  7017 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.723721  7041 consensus_queue.cc:1059] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:14:44.714536  6866 consensus_queue.cc:260] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:44.767889  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:44.790180  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 67514.1us
I20260709 12:14:44.794894  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:44.809078  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:44.809737  3342 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.811682  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:44.813871  3335 raft_consensus.cc:1240] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:14:44.815392  6984 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:44.816624  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:44.791949  7001 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:44.821530  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 115378us
I20260709 12:14:44.823190  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:44.824088  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.790985  7004 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:44.800711  7066 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.827934  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.825897  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:44.826048  3087 catalog_manager.cc:5697] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 4, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 4 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:44.833614  3087 catalog_manager.cc:5697] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:44.791962  6749 consensus_queue.cc:237] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:44.836120  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 97084.5us
I20260709 12:14:44.836874  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:44.837920  7066 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.838928  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:44.840169  7066 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:44.840808  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:44.841128  3342 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:44.833243  7070 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:44.842192  3232 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:44.842624  7070 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:44.843595  7020 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:44.843997  7020 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:44.838280  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:44.826594  6965 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:44.843152  3232 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:44.822391  6866 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.848094  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:44.828579  7004 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.848812  3925 raft_consensus.cc:2393] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:44.808154  7017 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:44.847417  6984 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.847693  6965 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:44.852991  6965 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.853581  7017 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:44.860802  7042 raft_consensus.cc:3055] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:44.861272  7042 raft_consensus.cc:740] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:44.862134  7042 consensus_queue.cc:260] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:44.862836  3232 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:44.863929  7084 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:44.864367  7084 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:44.864718  7084 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.849575  3087 catalog_manager.cc:5697] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 6 to 7, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 7 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:14:44.872153  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 54613.9us
I20260709 12:14:44.844380  7020 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.874364  3087 catalog_manager.cc:5697] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 5 to 8, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 8 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:44.867097  3895 leader_election.cc:336] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.863276  7042 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.896389  3895 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:44.902908  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:44.718708  3088 rpcz_store.cc:269] 0709 12:14:25.598353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.620832 (+ 22479us) service_pool.cc:224] Handling call
0709 12:14:44.695572 (+19074740us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:43.634647 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:43.635634 (+   987us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:43.635709 (+    75us) write_op.cc:435] Acquired schema lock
0709 12:14:43.635746 (+    37us) tablet.cc:662] Decoding operations
0709 12:14:43.638123 (+  2377us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:43.638230 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:43.638270 (+    40us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:14:43.665282 (+ 27012us) tablet.cc:701] Row locks acquired
0709 12:14:43.665344 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:14:43.665530 (+   186us) write_op.cc:270] Start()
0709 12:14:43.665704 (+   174us) write_op.cc:276] Timestamp: P: 1783599283665458 usec, L: 0
0709 12:14:43.665749 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 12:14:43.666660 (+   911us) log.cc:844] Serialized 6612 byte log entry
0709 12:14:44.085268 (+418608us) op_driver.cc:464] REPLICATION: finished
0709 12:14:44.281700 (+196432us) write_op.cc:301] APPLY: starting
0709 12:14:44.281805 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:44.282138 (+   333us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:44.282283 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:44.356462 (+ 74179us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:44.357024 (+   562us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:14:44.357094 (+    70us) write_op.cc:312] APPLY: finished
0709 12:14:44.357753 (+   659us) log.cc:844] Serialized 113 byte log entry
0709 12:14:44.358882 (+  1129us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:44.359099 (+   217us) write_op.cc:454] Released schema lock
0709 12:14:44.359201 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:44.359733 (+   532us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:44.359762 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2094735,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":184191,"apply.run_cpu_time_us":6516,"apply.run_wall_time_us":77983,"num_ops":16,"prepare.queue_time_us":152220,"prepare.run_cpu_time_us":16798,"prepare.run_wall_time_us":78215,"raft.queue_time_us":285523,"raft.run_cpu_time_us":44837,"raft.run_wall_time_us":117332,"replication_time_us":419342,"thread_start_us":361796,"threads_started":4,"wal-append.queue_time_us":129013}]]}
I20260709 12:14:44.911031  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:44.874296  6973 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:44.872859  7017 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:44.915405  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 56009.9us
I20260709 12:14:44.920739  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:44.929873  3895 leader_election.cc:336] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.930289  3342 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:44.923802  6765 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:44.923939  6749 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:44.926342  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 63592.1us
W20260709 12:14:44.921518  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 83359.9us
I20260709 12:14:44.909850  6984 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:44.935632  3231 leader_election.cc:336] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.936146  3231 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:44.939857  3895 leader_election.cc:336] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.941108  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:44.926966  6973 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:44.941002  3895 leader_election.cc:336] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.944680  3232 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:44.933403  7041 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:44.948776  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:44.960937  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:44.962297  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:44.937400  6984 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:44.950804  7004 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:44.964211  6984 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.964272  6872 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:44.965116  6872 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:44.965448  6872 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:44.965677  7004 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:44.965824  6872 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.952719  3924 raft_consensus.cc:1275] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:44.949960  3087 catalog_manager.cc:5697] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 4 to 5, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 5 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:44.954591  7070 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:44.968338  7004 consensus_queue.cc:1048] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:44.963749  6865 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:44.945643  6973 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.968087  3087 catalog_manager.cc:5697] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:44.931967  6765 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:44.971951  3896 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:44.946614  3895 leader_election.cc:336] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.973577  3895 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:44.970222  3087 catalog_manager.cc:5697] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:14:44.980525  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 44301.5us
I20260709 12:14:44.979705  3087 catalog_manager.cc:5697] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:44.930280  7040 consensus_queue.cc:1059] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:14:44.977828  6765 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:44.992585  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 46572.1us
I20260709 12:14:44.993326  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:44.994418  3157 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:44.995175  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:45.002295  3342 raft_consensus.cc:1275] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:14:45.004235  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 68630.1us
W20260709 12:14:45.004948  3231 leader_election.cc:336] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.005412  3231 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:45.006217  7079 raft_consensus.cc:2804] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:45.006680  7079 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.007018  7079 raft_consensus.cc:3060] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:44.992177  7100 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:45.011658  7100 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:44.986169  7066 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:44.997213  7012 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:45.005507  7106 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:45.016494  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:45.017310  3338 raft_consensus.cc:1240] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:44.982226  6866 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:45.027092  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.031080  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.999719  6481 raft_consensus.cc:3060] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:45.034214  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:45.035584  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:45.024197  3087 catalog_manager.cc:5697] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 5, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 5 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.029569  7106 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:45.042240  7106 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.029821  7004 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.043006  7004 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.045604  7004 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:45.033774  3895 leader_election.cc:336] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.046458  3895 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:45.047557  6871 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.049173  3335 raft_consensus.cc:1240] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:45.049139  6871 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.051865  6919 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:45.052438  6919 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.054617  6919 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:45.017524  7012 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.055713  7012 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.056175  3157 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:45.057070  3157 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:45.058583  7077 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:45.059108  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.059224  7077 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:45.059922  7017 raft_consensus.cc:3055] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:45.060174  6871 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:45.060340  7017 raft_consensus.cc:740] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:45.061153  6899 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:14:45.061584  3895 leader_election.cc:336] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.061262  7017 consensus_queue.cc:260] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.062049  3895 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:45.062373  7017 raft_consensus.cc:3060] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:45.062832  6899 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:45.063278  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.048331  3925 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:45.065042  3339 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 12.
I20260709 12:14:45.023767  7070 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:45.063946  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.072264  3895 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.072585  6980 consensus_queue.cc:1048] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:14:45.082413  3087 catalog_manager.cc:5697] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:45.089017  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 126824us
W20260709 12:14:45.086081  3895 leader_election.cc:336] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.089937  3087 catalog_manager.cc:5697] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.092036  7001 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.034617  6965 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.094230  7084 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.097970  7020 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.083595  7070 raft_consensus.cc:697] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:45.106279  6984 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.120723  3895 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:45.134292  3087 catalog_manager.cc:5697] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 5, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 5 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:45.134574  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 129461us
I20260709 12:14:45.135648  3341 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:14:45.138729  3232 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:45.145677  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 59636us
W20260709 12:14:45.146255  3231 leader_election.cc:336] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:45.146893  3895 leader_election.cc:336] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:45.152364  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 95354.6us
I20260709 12:14:45.154044  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:45.159742  3305 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:45.160820  7105 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:45.161427  7105 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:45.161934  7105 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.168727  6984 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:45.170269  7106 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.171937  6866 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:45.172478  7106 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:45.161017  3305 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:45.159125  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.181327  3231 leader_election.cc:336] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.179157  3087 catalog_manager.cc:5697] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 6, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 6 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:14:45.180902  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.150735  6980 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:45.184662  3895 leader_election.cc:336] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.189090  3895 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:45.186857  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:45.190402  3895 leader_election.cc:336] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.191116  6993 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:45.180215  6899 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:14:45.174695  7100 raft_consensus.cc:2764] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 12:14:45.204372  3895 leader_election.cc:336] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.145219  6973 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.182235  7004 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:45.210005  3305 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:45.207080  3231 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:45.206070  3895 leader_election.cc:336] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:45.207966  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 53993.1us
I20260709 12:14:45.212128  3157 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:45.156152  6765 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:45.220242  3231 leader_election.cc:336] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.222448  3925 raft_consensus.cc:1240] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:45.224892  6872 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.229029  6872 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:45.206436  3087 catalog_manager.cc:5697] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:45.239789  3336 raft_consensus.cc:1240] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:45.241547  3087 catalog_manager.cc:5697] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:14:45.240206  3231 leader_election.cc:336] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.243072  3231 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:45.217514  7108 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:45.248973  7108 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.249923  7001 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:45.251097  7070 consensus_queue.cc:237] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.258483  3895 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:45.235517  6866 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:45.265254  6481 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:45.242681  6865 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:45.284235  6899 consensus_queue.cc:1048] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:45.286147  7079 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.289319  7109 consensus_queue.cc:1059] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:14:45.290428  6765 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:45.291778  7084 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:45.281301  6980 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:45.282891  6865 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:45.292805  6866 raft_consensus.cc:697] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:45.337872  7020 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:45.331631  6865 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:45.338263  6866 consensus_queue.cc:237] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.303900  7079 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:45.296440  7012 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.293313  7066 consensus_queue.cc:1048] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:14:45.342693  7012 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:45.330327  6965 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:45.360574  7108 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:45.365324  6973 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:45.355588  6865 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.372074  7105 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.371289  6980 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:45.374986  6865 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:45.375051  7105 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:45.581147  3338 raft_consensus.cc:1240] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:45.585575  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 381984us
I20260709 12:14:45.586334  3305 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:45.587054  7105 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:45.587565  7105 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:45.588030  7105 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.588143  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:45.588963  6865 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:45.589427  3305 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:45.590212  6865 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:45.590576  6865 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:45.590620  3305 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:45.591027  6865 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:45.592135  6973 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:45.596268  3305 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:45.608819  6973 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:45.603559  6865 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.605293  3087 catalog_manager.cc:5697] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:45.610312  3087 catalog_manager.cc:5697] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 9, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 9 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.612249  3087 catalog_manager.cc:5697] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:45.613855  3087 catalog_manager.cc:5697] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:45.615828  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 338105us
I20260709 12:14:45.616479  7105 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.617534  3895 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:45.618319  6980 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:45.618685  6980 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:45.619103  6980 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:45.620226  6865 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:45.608834  3305 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:45.622139  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:45.619124  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:45.627959  7066 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:45.631264  7066 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.631743  7066 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.640872  7066 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:45.628319  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.627403  6980 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.642385  6973 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:45.642664  7012 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.647782  7012 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.650043  7012 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:45.642863  6865 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:45.644028  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:45.652923  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:45.656419  6973 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:14:45.654304  7066 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:14:45.655638  6980 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:45.653522  6865 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:45.658716  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:45.659600  6965 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:45.659981  6965 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:45.660356  6965 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:45.629503  3895 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:45.670433  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:45.675318  7110 raft_consensus.cc:3055] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:45.675905  7110 raft_consensus.cc:740] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:45.677076  7110 consensus_queue.cc:260] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:45.685693  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 56243.3us
I20260709 12:14:45.687282  3895 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:45.688339  7121 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:45.688818  7121 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:45.689260  7121 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:45.699995  7121 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.705523  7121 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:45.706913  3305 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:45.711743  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:45.710390  6973 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:45.715138  6973 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:45.715678  6973 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:45.718012  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 464612us
I20260709 12:14:45.719363  3157 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:45.720742  7121 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.721326  7121 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.721990  3339 raft_consensus.cc:1240] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:45.724886  3339 raft_consensus.cc:1275] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:45.730455  3338 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:45.731722  3335 raft_consensus.cc:1240] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:45.732425  3341 raft_consensus.cc:1240] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:45.732940  3334 raft_consensus.cc:1240] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:45.735492  7077 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:45.735949  7077 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.736402  7077 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:14:45.727921  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.732077  6973 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.738768  3305 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:45.738792  3157 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:45.742126  7109 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:45.742039  3157 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:45.740139  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:45.739202  7113 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:45.744760  3305 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:45.745044  7113 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:45.745427  7113 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:45.745685  7113 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:45.745694  3305 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:45.747177  3305 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:45.747772  6899 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:45.748200  6899 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.748564  6899 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:45.752930  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.761263  7109 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:45.762169  7109 raft_consensus.cc:697] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:45.763240  7109 consensus_queue.cc:237] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.764885  7040 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.765465  7040 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.765584  7121 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:45.769025  6973 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:45.770799  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:45.775300  3895 leader_election.cc:336] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.782085  3341 raft_consensus.cc:1240] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:45.776141  3895 leader_election.cc:336] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.789059  7077 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.791404  7077 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:45.791869  7111 consensus_queue.cc:1059] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:45.793558  7111 raft_consensus.cc:3055] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:45.793934  7111 raft_consensus.cc:740] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:45.771399  7113 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.796074  3342 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:45.797155  7113 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:45.797757  7113 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:45.798339  7113 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:45.798735  7113 raft_consensus.cc:697] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:45.800850  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:45.799978  3895 leader_election.cc:336] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.810127  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:45.811266  3895 leader_election.cc:336] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.765208  6899 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.821923  6919 consensus_queue.cc:1059] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:45.817111  7042 consensus_queue.cc:1059] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:14:45.808157  7079 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:14:45.816938  7113 consensus_queue.cc:237] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.825240  7079 raft_consensus.cc:3055] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:45.630724  7105 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:45.825739  7079 raft_consensus.cc:740] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:45.826133  7105 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:45.770569  6973 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:45.832983  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:45.834511  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 87434.2us
I20260709 12:14:45.822024  6865 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:45.833000  7105 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.808332  7070 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:14:45.809248  7077 consensus_queue.cc:1059] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:14:45.826881  7079 consensus_queue.cc:260] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.851719  7105 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:45.813339  7111 consensus_queue.cc:260] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:45.862030  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 621801us
W20260709 12:14:45.863175  3231 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.864269  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:45.845046  7109 raft_consensus.cc:3055] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:45.865780  7109 raft_consensus.cc:740] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:45.867985  7128 consensus_queue.cc:1059] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:45.869319  7128 raft_consensus.cc:3055] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:45.869604  7128 raft_consensus.cc:740] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:45.869849  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:45.870141  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:45.870481  3264 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:45.871449  7111 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.871675  3336 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:45.844440  6865 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:45.882948  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:45.875072  3265 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:45.885147  6899 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:45.886520  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:45.887094  3336 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:45.889117  7077 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.889658  7077 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.858872  7040 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:45.891834  7077 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:45.895800  3895 leader_election.cc:336] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.906165  3336 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 13.
I20260709 12:14:45.909425  3334 raft_consensus.cc:1240] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:45.912675  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:45.913838  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:45.909489  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:45.915412  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:45.915719  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:45.916148  3265 raft_consensus.cc:2376] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11. Re-sending same reply.
I20260709 12:14:45.916445  3930 raft_consensus.cc:2393] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:45.918485  3157 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:45.919488  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:45.919929  3333 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
I20260709 12:14:45.920071  3335 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.920907  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:45.929297  3334 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:45.933758  3929 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:45.935290  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:45.910331  6865 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:45.924386  7079 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:45.927580  7017 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:45.949797  7020 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:45.924752  7041 consensus_queue.cc:1059] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:14:45.952939  7041 raft_consensus.cc:3055] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:45.953321  7041 raft_consensus.cc:740] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:45.954134  7041 consensus_queue.cc:260] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.956923  7066 consensus_queue.cc:1059] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:45.957858  6899 consensus_queue.cc:1059] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:45.958343  6919 raft_consensus.cc:3055] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:45.958720  6919 raft_consensus.cc:740] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:45.958917  6899 raft_consensus.cc:3055] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:45.959286  6899 raft_consensus.cc:740] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:45.959582  6919 consensus_queue.cc:260] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.960048  6899 consensus_queue.cc:260] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.960801  6919 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:45.961254  6899 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.962343  6980 raft_consensus.cc:3055] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:45.962754  6980 raft_consensus.cc:740] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:45.963562  6980 consensus_queue.cc:260] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:45.964695  6980 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:45.970319  3926 raft_consensus.cc:1240] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:45.970700  6973 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:45.921613  7128 consensus_queue.cc:260] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.972218  7128 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.974447  3932 raft_consensus.cc:1240] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:45.983603  7017 raft_consensus.cc:697] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 13 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:45.984606  7017 consensus_queue.cc:237] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:45.987835  3336 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:45.990139  3335 raft_consensus.cc:2468] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
I20260709 12:14:45.955360  7041 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:46.011709  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.016109  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.018429  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 45710.8us
I20260709 12:14:46.031644  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:45.940639  7109 consensus_queue.cc:260] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:46.041700  3305 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:46.082075  3264 raft_consensus.cc:1240] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:46.067063  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.032979  7111 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:46.089829  7111 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.052171  6765 consensus_queue.cc:1048] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:14:46.093713  6865 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:46.104673  7109 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:46.106292  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.119727  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.119804  7105 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:46.121016  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 79445us
I20260709 12:14:46.120721  6973 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:46.125218  6973 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:46.125612  6973 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:46.088768  7113 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.120257  6965 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:46.133986  3342 raft_consensus.cc:1240] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:46.134456  3305 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:46.135280  3264 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:14:46.140594  3340 raft_consensus.cc:1240] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:46.143784  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.139816  6765 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:46.140185  7017 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.134284  7113 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.143877  6865 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:46.150086  3268 raft_consensus.cc:1240] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:46.147322  6765 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.157431  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.158254  3268 raft_consensus.cc:2468] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 4.
I20260709 12:14:46.148382  7105 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:46.153160  7004 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.160614  6965 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:46.162431  7110 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:46.163116  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.164871  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.165746  3266 raft_consensus.cc:1240] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:46.156721  6765 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:46.168098  3264 raft_consensus.cc:1240] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:46.172523  3232 leader_election.cc:400] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8.
I20260709 12:14:46.177461  3232 leader_election.cc:403] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:14:46.175808  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 229531us
W20260709 12:14:46.177976  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.167785  7113 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:46.179651  3896 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:46.183943  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:46.184846  3932 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:46.187071  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.148566  7017 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:46.198132  3261 raft_consensus.cc:1275] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:46.193482  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.199075  3262 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:46.199533  6980 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:46.199920  6980 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.200285  6980 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:46.200582  3306 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:46.196676  3260 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:46.196775  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.194180  3263 raft_consensus.cc:2393] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 9: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:46.201411  7113 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:46.208510  3896 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:46.209358  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.210196  3267 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:46.202394  3268 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
W20260709 12:14:46.217401  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 73650.9us
I20260709 12:14:46.215304  7121 raft_consensus.cc:2804] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:46.176734  7004 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.204885  7113 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.223999  3932 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:46.224114  7113 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:46.223743  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.229143  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.231474  3896 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:46.230017  3268 raft_consensus.cc:2468] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
W20260709 12:14:46.236197  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.236433  3338 raft_consensus.cc:1275] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:46.237752  6749 raft_consensus.cc:2804] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:46.240057  6749 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.239912  7042 consensus_queue.cc:1059] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:46.240540  6749 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:46.240845  7017 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:46.240979  7042 raft_consensus.cc:3055] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:46.241423  7042 raft_consensus.cc:740] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:46.241618  3157 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:46.242201  7042 consensus_queue.cc:260] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.242561  6919 consensus_queue.cc:1059] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:46.242690  6871 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:46.243162  7077 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:46.243688  7077 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.243444  7040 consensus_queue.cc:1059] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:46.244088  7077 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:46.244558  7079 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:46.244809  6871 raft_consensus.cc:3055] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:46.245265  6871 raft_consensus.cc:740] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:46.245632  7041 raft_consensus.cc:3055] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:46.246024  7041 raft_consensus.cc:740] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:46.246330  6871 consensus_queue.cc:260] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.241653  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:46.201745  7142 consensus_queue.cc:1059] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:14:46.256060  7142 raft_consensus.cc:3055] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:46.256479  7142 raft_consensus.cc:740] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:46.250463  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.258127  3338 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:46.237923  3339 raft_consensus.cc:1275] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:46.251082  3267 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:46.246801  7041 consensus_queue.cc:260] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:46.228027  7121 raft_consensus.cc:697] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:46.269990  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.253473  6871 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:46.277122  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.284168  7121 consensus_queue.cc:237] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:46.286906  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 114568us
I20260709 12:14:46.288403  3232 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:46.293732  6973 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.294601  7041 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:46.294936  3335 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:46.295042  7077 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:46.297209  7077 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:46.275965  3260 raft_consensus.cc:1240] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:46.282661  3337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 936) took 1082 ms. Trace:
W20260709 12:14:46.298080  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.299499  6973 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:46.301867  7020 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:46.270026  3157 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:46.302603  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:46.306819  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.309347  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.309998  6980 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.310773  7104 consensus_queue.cc:1059] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:14:46.311734  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.313993  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.324889  3264 raft_consensus.cc:2468] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:46.326027  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.326835  3264 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:46.305713  3337 rpcz_store.cc:276] 0709 12:14:45.199815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.200028 (+   213us) service_pool.cc:224] Handling call
0709 12:14:45.209075 (+  9047us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.243778 (+ 34703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.243808 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.257847 (+ 14039us) log.cc:844] Serialized 26 byte log entry
0709 12:14:46.031778 (+773931us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:46.031818 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:46.282235 (+250417us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b540036d154. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:46.282288 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:46.282339 (+    51us) raft_consensus.cc:1685] finished
0709 12:14:46.282354 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:46.282568 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":860,"raft.queue_time_us":3829,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":11916,"spinlock_wait_cycles":76940672,"thread_start_us":101721,"threads_started":1,"wal-append.queue_time_us":831165}
W20260709 12:14:46.315156  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 46304.1us
W20260709 12:14:46.337414  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 67451.6us
I20260709 12:14:46.337786  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.337848  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.338578  3261 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:14:46.302589  7129 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:46.343736  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.343472  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.347401  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.269173  7111 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:46.348430  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.349144  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.345553  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.325315  7042 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:46.364445  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.365495  7111 consensus_queue.cc:1059] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:46.366586  7111 raft_consensus.cc:3055] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:46.366961  7111 raft_consensus.cc:740] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:46.367549  3266 raft_consensus.cc:3055] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:46.367911  7111 consensus_queue.cc:260] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:46.345218  7141 consensus_queue.cc:1059] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:14:46.369180  7111 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:46.370015  7141 raft_consensus.cc:3055] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:46.370404  7141 raft_consensus.cc:740] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:46.371635  7020 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 7. Current term is 8.
W20260709 12:14:46.375634  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.376186  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.376739  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.378731  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:46.379519  3335 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:46.367911  3266 raft_consensus.cc:740] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:14:46.400856  7143 log.cc:927] Time spent T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:14:46.400738  3266 consensus_queue.cc:260] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:46.257345  7142 consensus_queue.cc:260] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.401818  3266 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:46.402128  7142 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:46.403615  3261 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 13.
I20260709 12:14:46.404785  3261 raft_consensus.cc:1240] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:46.404844  6980 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:46.353094  6735 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:46.406629  6735 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.406953  6735 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:46.407582  7118 log.cc:927] Time spent T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:46.343845  7066 consensus_queue.cc:1048] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:14:46.409428  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:46.413038  3335 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:46.346921  7129 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.411123  3263 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:46.423676  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.424423  3259 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:46.427699  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.437253  3266 raft_consensus.cc:1275] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:46.430078  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.440186  3157 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:46.447531  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:46.448689  3342 raft_consensus.cc:2368] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:46.409924  6749 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.463682  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:46.465004  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 164156us
W20260709 12:14:46.471859  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 56074.7us
I20260709 12:14:46.429621  7129 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:46.477918  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.434234  7041 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
W20260709 12:14:46.469974  7136 log.cc:927] Time spent T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:14:46.444128  7109 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.501144  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.504179  3263 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:46.436991  7110 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:46.484171  3086 catalog_manager.cc:5697] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:46.414230  7077 consensus_queue.cc:1059] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:14:46.462592  7128 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.444353  7104 consensus_queue.cc:1243] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer 6f0cdd57c5934921829c205d32b2b8a5 log is divergent from this leader: its last log entry 9.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:14:46.495822  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.500849  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:46.488402  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.468897  7040 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:46.463137  7004 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:46.429257  6765 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.422391  7113 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.517043  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:46.522863  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.371289  7141 consensus_queue.cc:260] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.534817  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:46.539921  3336 raft_consensus.cc:1240] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:46.542301  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.544726  3341 raft_consensus.cc:2393] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 11: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:46.543068  3340 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:14:46.512995  7110 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.502451  7041 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:46.549886  3926 raft_consensus.cc:1240] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:46.529074  7077 raft_consensus.cc:3055] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:46.521667  7040 raft_consensus.cc:697] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:46.551822  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.510993  7109 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:46.559072  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.568874  3156 leader_election.cc:336] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.605s (SENT)
W20260709 12:14:46.568933  3232 connection.cc:256] RPC call timeout handler was delayed by -1.008773132999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 12:14:46.516894  7128 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.567992  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.569340  3156 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:46.581115  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 44226.7us
I20260709 12:14:46.609036  7079 consensus_queue.cc:1059] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:46.609876  3260 raft_consensus.cc:3055] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:46.610253  7041 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:46.610777  7159 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:46.611132  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.611773  3266 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:46.610255  3260 raft_consensus.cc:740] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:46.612771  3260 consensus_queue.cc:260] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.613878  3260 raft_consensus.cc:3060] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:46.581686  7153 log.cc:927] Time spent T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:14:46.587759  7109 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:46.599951  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:46.618037  3338 raft_consensus.cc:2410] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:14:46.608901  3340 raft_consensus.cc:2368] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 12. Current term is 13.
W20260709 12:14:46.591799  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.578346  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:46.621943  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.623534  3266 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:46.624080  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:46.628418  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.628705  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.630642  3335 raft_consensus.cc:2468] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:46.626303  3925 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
I20260709 12:14:46.627229  3339 raft_consensus.cc:2393] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:46.550714  7070 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:46.637461  3342 raft_consensus.cc:1240] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:46.638543  3232 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:46.639827  3341 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:14:46.641557  3263 raft_consensus.cc:2468] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 7.
I20260709 12:14:46.618551  7159 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:46.643783  3157 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:46.556465  7077 raft_consensus.cc:740] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:46.646085  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:46.643846  3341 raft_consensus.cc:1240] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:46.651384  3895 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:46.655306  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 86457.7us
W20260709 12:14:46.669121  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.670135  6919 raft_consensus.cc:2804] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:46.670644  6919 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:46.671046  6919 raft_consensus.cc:3060] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:46.675082  3260 raft_consensus.cc:1275] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 12:14:46.680994  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.681888  3156 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 1.661s (SENT)
I20260709 12:14:46.676955  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:46.682384  3156 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:46.680835  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4480 after lost signal to thread 2020
I20260709 12:14:46.687234  3338 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:46.645783  7041 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:46.687966  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.687547  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08002a5920 after lost signal to thread 3125
W20260709 12:14:46.689357  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5cc0 after lost signal to thread 3184
W20260709 12:14:46.689697  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5e20 after lost signal to thread 3185
W20260709 12:14:46.689922  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2080 after lost signal to thread 3188
W20260709 12:14:46.690727  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6420 after lost signal to thread 3189
W20260709 12:14:46.690999  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08002c62a0 after lost signal to thread 3191
W20260709 12:14:46.691198  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5f80 after lost signal to thread 3192
W20260709 12:14:46.691543  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5c00 after lost signal to thread 3193
W20260709 12:14:46.691807  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5ea0 after lost signal to thread 3217
W20260709 12:14:46.692627  3953 debug-util.cc:398] Leaking SignalData structure 0x7b0800173300 after lost signal to thread 3292
W20260709 12:14:46.692862  3953 debug-util.cc:398] Leaking SignalData structure 0x7b0800229d60 after lost signal to thread 3293
W20260709 12:14:46.693723  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08003917e0 after lost signal to thread 3366
W20260709 12:14:46.693948  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08003918e0 after lost signal to thread 3367
I20260709 12:14:46.696288  3932 raft_consensus.cc:1240] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEADER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:46.704608  3953 debug-util.cc:398] Leaking SignalData structure 0x7b080035ab60 after lost signal to thread 3956
W20260709 12:14:46.705786  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08003c69e0 after lost signal to thread 3957
W20260709 12:14:46.706422  3953 debug-util.cc:398] Leaking SignalData structure 0x7b0800204980 after lost signal to thread 7032
I20260709 12:14:46.684710  6749 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:46.689913  7042 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:46.647750  7070 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:46.717268  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 65935.1us
I20260709 12:14:46.736351  3895 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:46.716495  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.683871  7109 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:14:46.687999  7079 consensus_queue.cc:1059] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 12:14:46.743161  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 57175.3us
I20260709 12:14:46.747198  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.747535  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.753476  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.754522  3338 raft_consensus.cc:2393] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 13: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:46.750931  7042 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:46.757426  7166 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:46.759763  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.760529  3333 raft_consensus.cc:2393] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 6: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:46.760591  3341 pending_rounds.cc:85] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 9
I20260709 12:14:46.761046  3341 pending_rounds.cc:107] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:14:46.761410  3341 raft_consensus.cc:2889] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:46.761528  3333 raft_consensus.cc:1240] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:46.762534  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.763228  3333 raft_consensus.cc:2393] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:46.763692  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:46.763703  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:46.765352  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:46.766062  3340 raft_consensus.cc:2393] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 9: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:46.766479  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:46.767032  3335 raft_consensus.cc:2393] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:46.700757  7041 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.774570  3342 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:46.777702  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:46.782441  3337 raft_consensus.cc:2393] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:46.783105  3335 raft_consensus.cc:1240] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:46.780045  3895 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:46.743878  7113 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:46.787868  7162 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:46.702466  7040 consensus_queue.cc:237] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:46.791127  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.791726  3338 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 6.
W20260709 12:14:46.791852  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 110003us
W20260709 12:14:46.793550  7164 log.cc:927] Time spent T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:14:46.794421  7157 log.cc:927] Time spent T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 12:14:46.810423  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.787285  6871 consensus_meta.cc:287] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.503s	user 0.013s	sys 0.000s
I20260709 12:14:46.812567  3156 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:46.740669  7077 consensus_queue.cc:260] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:46.824535  7154 log.cc:927] Time spent T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:14:46.825086  3076 connection.cc:573] client connection to 127.1.248.67:35301 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 12:14:46.826551  3333 raft_consensus.cc:1240] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:46.819139  6899 raft_consensus.cc:2804] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:46.831766  6899 raft_consensus.cc:697] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:46.832731  6899 consensus_queue.cc:237] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.840353  7070 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:46.840898  6919 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:46.822819  7141 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:46.839183  7156 log.cc:927] Time spent T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:14:46.840847  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:46.873255  3156 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:46.851871  7111 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:46.855506  7109 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:46.852281  7129 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.891316  7109 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:46.892939  7042 raft_consensus.cc:3055] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:46.894284  7077 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:46.887408  3076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 61830.4us
I20260709 12:14:46.915526  7128 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:46.917552  7129 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:46.920346  3262 raft_consensus.cc:2393] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 10: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:46.929301  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.927947  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:46.930723  3260 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:46.931041  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:46.918597  7108 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:14:46.895655  6735 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:46.906168  7042 raft_consensus.cc:740] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:46.943154  3338 raft_consensus.cc:1240] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:46.943225  3156 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:46.944062  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.941995  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.945045  3263 raft_consensus.cc:2393] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 9: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:46.920816  7109 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:46.948036  3156 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:46.933601  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 295035us
I20260709 12:14:46.948324  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.949574  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.950304  3265 raft_consensus.cc:2393] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 9: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:46.937600  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:46.896749  7040 raft_consensus.cc:2804] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:46.951566  7040 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.951983  7040 raft_consensus.cc:3060] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:46.955044  7041 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:46.919925  6919 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:46.942289  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.941627  7017 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:14:46.946025  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.946192  7070 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:46.907172  7159 consensus_queue.cc:1059] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:14:46.934340  7084 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:46.935731  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:46.946030  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:47.001914  3261 raft_consensus.cc:2393] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 13: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:46.934751  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.935949  3264 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 11: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
I20260709 12:14:46.951166  3336 raft_consensus.cc:2393] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 9: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:47.002669  3268 raft_consensus.cc:2393] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:46.941313  7110 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:46.960436  7115 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:46.964763  6481 raft_consensus.cc:3055] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:46.966418  3895 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:46.966881  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.969487  3267 raft_consensus.cc:1240] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:46.951128  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.971534  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:47.014493  3928 raft_consensus.cc:2393] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:46.967367  3260 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:14:47.015702  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:46.994735  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:46.996457  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:47.016943  3339 raft_consensus.cc:3060] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:47.018774  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 52426us
I20260709 12:14:47.019965  3086 catalog_manager.cc:5697] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:47.003502  3156 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:47.006664  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:47.011130  3305 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:47.026168  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:47.026855  3260 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:47.017491  3931 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:46.996587  7160 raft_consensus.cc:2804] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:47.051987  7160 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:47.052452  7160 raft_consensus.cc:3060] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:47.055485  7042 consensus_queue.cc:260] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.056972  7042 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:47.016465  7159 consensus_queue.cc:1243] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer eb49d92feeb14382b3baa49d696b6141 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:47.012756  6481 raft_consensus.cc:740] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:14:47.062224  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 58886.8us
I20260709 12:14:47.065166  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:47.065732  3156 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:47.069487  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:47.070114  3260 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:47.071210  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:47.072986  3260 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 10: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:47.034332  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:47.073493  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 43747.3us
I20260709 12:14:46.995463  7070 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.029606  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.036845  6919 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:47.038475  7113 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:47.038779  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:47.040082  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:47.042258  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.042845  7162 consensus_queue.cc:1048] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:14:47.043597  6899 raft_consensus.cc:2804] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:47.044096  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.088798  3156 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.045819  6735 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:47.012843  7084 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.049872  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:47.015460  7115 raft_consensus.cc:697] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:47.081586  7070 raft_consensus.cc:3060] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:47.034744  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 83956.3us
I20260709 12:14:47.032493  3086 catalog_manager.cc:5697] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 2 to 6, term changed from 6 to 7, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65), VOTER 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66), VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67), VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 7 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:47.078513  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:47.004101  7040 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:47.082644  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 53218.4us
I20260709 12:14:47.059508  6481 consensus_queue.cc:260] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.127390  7160 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.075874  7017 raft_consensus.cc:2804] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:47.093230  7111 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:47.072582  3339 raft_consensus.cc:2468] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:47.106359  7115 consensus_queue.cc:237] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.135316  7017 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:47.097200  6919 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:47.088476  7041 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.072578  7159 consensus_queue.cc:1059] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:14:47.117786  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.097920  7172 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.128183  6481 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:47.107900  6899 raft_consensus.cc:697] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:47.086804  3260 raft_consensus.cc:1275] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:47.141760  3157 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.134086  7040 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:47.179499  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:47.183485  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.138393  7017 raft_consensus.cc:3060] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:47.190320  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:47.187022  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:47.212492  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.188374  6899 consensus_queue.cc:237] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.189741  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.140128  7109 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:47.145871  7172 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.195777  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:47.196249  7182 log.cc:927] Time spent T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:14:47.197156  7077 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:47.198251  7041 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.165025  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:47.155467  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:47.206076  7070 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.207839  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:47.209167  3261 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:14:47.138608  6919 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:47.215701  3231 leader_election.cc:336] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.229736  3339 raft_consensus.cc:1240] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:14:47.234555  3263 raft_consensus.cc:2368] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10.
I20260709 12:14:47.229275  3260 raft_consensus.cc:2376] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9. Re-sending same reply.
I20260709 12:14:47.233489  3232 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.239210  3231 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:47.240531  3231 leader_election.cc:336] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.240805  6984 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:47.241241  3232 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.241480  7130 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.241593  6984 consensus_queue.cc:1059] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:47.242398  7116 consensus_queue.cc:1059] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:47.242661  6984 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:47.243038  3231 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.243261  7116 raft_consensus.cc:3055] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:47.237085  3267 raft_consensus.cc:3055] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:47.243877  3267 raft_consensus.cc:740] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:47.244803  3267 consensus_queue.cc:260] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:47.245111  3231 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.245653  3267 raft_consensus.cc:3060] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:47.245729  3231 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.246827  7106 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.243777  7116 raft_consensus.cc:740] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:14:47.247303  3231 leader_election.cc:336] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.248000  7116 consensus_queue.cc:260] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.237825  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:47.249365  3338 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:47.248155  3231 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.252872  3232 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:47.251544  3231 leader_election.cc:336] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.273173  3231 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:47.254148  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:47.275256  7130 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:47.275732  7130 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.276075  7130 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:47.219726  7109 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:47.250658  6919 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:47.231693  7159 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.231343  7079 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.211043  7084 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:47.286628  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:47.287771  3339 raft_consensus.cc:2368] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
W20260709 12:14:47.280246  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 104345us
I20260709 12:14:47.228351  7171 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:47.284868  3231 consensus_peers.cc:597] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.273876  7077 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.296305  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:47.297798  3231 leader_election.cc:336] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.298390  3231 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.290122  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.298151  3333 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:14:47.302755  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.303875  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.304032  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:47.305011  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.305016  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.305791  3339 raft_consensus.cc:2393] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:47.305876  3335 raft_consensus.cc:2393] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 13: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:47.306579  3265 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:47.281240  7116 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:47.281126  7109 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:47.308701  3927 raft_consensus.cc:1240] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:47.268359  7106 consensus_queue.cc:1059] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:14:47.310478  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:47.310760  3231 leader_election.cc:336] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.312202  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.312140  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.312849  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.306783  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.313802  3232 leader_election.cc:400] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:47.319334  3232 leader_election.cc:403] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:14:47.311317  7077 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.322041  7077 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:47.318563  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:47.323771  3929 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
I20260709 12:14:47.284396  7108 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:47.294936  7159 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.316425  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.328796  3338 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:47.332891  3340 raft_consensus.cc:2393] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:14:47.327550  3231 leader_election.cc:336] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.326776  7159 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:47.338466  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 63690.7us
I20260709 12:14:47.341171  7040 consensus_queue.cc:1059] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:47.341900  7040 consensus_queue.cc:1243] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer eb49d92feeb14382b3baa49d696b6141 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:47.343142  3157 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:47.345510  3231 leader_election.cc:336] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.314590  7084 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:47.313753  7166 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.346346  3231 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.288913  7079 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.317173  7171 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:47.369870  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.370659  7193 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:47.371387  7193 raft_consensus.cc:697] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:47.372242  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:47.372543  7193 consensus_queue.cc:237] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.375010  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:47.365763  3231 leader_election.cc:336] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:47.380493  3231 leader_election.cc:336] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.342983  6980 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:47.342768  7041 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:47.391523  7079 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:47.391295  7041 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.392203  7160 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:47.380990  3231 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.389490  7070 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:47.395852  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.397066  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:47.397774  3231 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:47.403753  3231 consensus_peers.cc:597] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.404628  3305 leader_election.cc:336] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.405613  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:47.402238  3340 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:47.407914  3157 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:47.408056  7110 raft_consensus.cc:3055] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:47.408494  7110 raft_consensus.cc:740] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:47.408835  7159 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:47.409355  7159 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.409705  7159 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:47.409586  7110 consensus_queue.cc:260] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.413107  3305 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:47.418419  7113 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:47.420111  3305 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.384186  7108 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:47.426090  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.436794  7042 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.437323  3340 raft_consensus.cc:2368] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 10. Current term is 11.
I20260709 12:14:47.437325  7042 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.428289  3267 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 11. (term mismatch)
I20260709 12:14:47.439291  3267 pending_rounds.cc:85] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 10
I20260709 12:14:47.439409  3157 leader_election.cc:400] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 10. Current term is 11.
I20260709 12:14:47.439653  3267 pending_rounds.cc:107] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 12:14:47.440114  3267 raft_consensus.cc:2889] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:47.439761  3157 leader_election.cc:403] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:47.441159  7108 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:47.441438  3340 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:14:47.441751  7108 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.444867  7070 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:14:47.445779  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 132949us
I20260709 12:14:47.446512  3232 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.411396  7110 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:47.447252  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.431054  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:47.447046  7160 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:47.379112  7166 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.458487  3232 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:47.460044  3232 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.384687  7171 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:47.448068  6984 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 12:14:47.464015  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 43960.8us
W20260709 12:14:47.478857  3305 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.479158  3232 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.479532  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.480139  3340 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:47.479352  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:47.482307  3157 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:47.487061  3305 leader_election.cc:336] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.488255  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:47.489319  3232 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.467772  7115 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:47.477807  7172 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:47.483124  7041 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:47.463781  7196 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:47.482362  7124 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.482672  7084 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:47.495973  3232 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.495395  3923 raft_consensus.cc:2368] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 10. Current term is 11.
W20260709 12:14:47.495946  3305 leader_election.cc:336] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.502856  7166 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:47.502511  6919 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.503636  7042 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:47.493847  7115 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:47.506981  2017 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 3218)
I20260709 12:14:47.488554  7077 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:47.509183  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.522217  3340 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:47.533187  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:47.549732  3157 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:47.552479  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 60821.6us
W20260709 12:14:47.553289  3305 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.553908  3305 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:47.555727  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:47.580925  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 264256us
I20260709 12:14:47.581554  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:47.521849  7186 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:47.516950  7115 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:47.583743  3305 leader_election.cc:336] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:47.586915  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.587554  3305 leader_election.cc:336] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:47.588389  3305 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.516623  6919 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:47.519727  7077 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.516033  7171 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:47.588891  3305 leader_election.cc:336] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.521842  7084 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.515071  7196 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:47.581516  7172 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:47.522698  7108 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:47.514493  7200 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.596690  3305 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:47.554906  7041 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:47.581748  7160 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.597632  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 103934us
W20260709 12:14:47.599794  3895 leader_election.cc:336] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.606675  3895 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.596163  7077 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:47.610255  3305 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.612154  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:47.613034  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.615245  7017 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.607640  7041 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.598862  6899 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.622514  3305 leader_election.cc:336] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:47.627169  3305 leader_election.cc:336] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.620904  7171 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.630913  3305 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:47.606927  7198 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.628595  7042 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.611009  7166 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:47.611143  7113 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:47.634426  3305 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.644203  3305 leader_election.cc:336] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:47.644946  3305 leader_election.cc:336] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.625692  7041 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:47.645918  3305 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.637988  3232 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.639204  6965 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:47.649978  7181 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.606s	user 0.005s	sys 0.000s
I20260709 12:14:47.630544  6899 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.652741  7017 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:47.653704  6899 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:47.655344  6866 raft_consensus.cc:3055] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:47.655762  6866 raft_consensus.cc:740] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:47.656566  6866 consensus_queue.cc:260] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.657824  6866 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:47.658586  7129 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:47.661134  3335 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:14:47.661312  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 256687us
W20260709 12:14:47.662005  3231 leader_election.cc:336] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.662420  3231 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.663622  3157 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.665333  3157 leader_election.cc:400] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 10. Current term is 11.
I20260709 12:14:47.666128  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:47.666923  6765 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:47.668160  7104 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:47.639165  7198 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.639209  7042 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.642784  7077 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.647396  7124 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:47.671113  3231 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.691586  3231 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.691841  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:47.646483  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:47.606451  7172 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.611114  7160 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.632635  7207 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:47.689615  7142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.017s	sys 0.012s
I20260709 12:14:47.690275  7166 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:47.674716  3923 raft_consensus.cc:2393] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 11: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:47.675791  3927 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:14:47.696943  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 51035.6us
I20260709 12:14:47.676517  6919 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:47.669178  7017 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.709522  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.710377  3335 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
W20260709 12:14:47.706391  3305 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:47.706939  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.701498  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:47.716058  3305 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.716395  3930 raft_consensus.cc:2393] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 11: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
W20260709 12:14:47.707334  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 43886.7us
W20260709 12:14:47.705375  7142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.017s	sys 0.013s
I20260709 12:14:47.635926  7171 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.720643  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.691241  7193 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.721426  3305 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.711310  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:47.724450  3231 leader_election.cc:336] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.727386  3341 raft_consensus.cc:1275] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:14:47.729755  3264 raft_consensus.cc:1275] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:14:47.730100  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 56679.2us
I20260709 12:14:47.705683  7196 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:47.730156  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:47.731665  3305 leader_election.cc:336] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.733445  3305 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:47.734262  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:47.735836  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:47.736429  3268 raft_consensus.cc:2468] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:47.722286  7017 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.739045  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:47.740147  7017 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:47.741832  7198 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:47.734594  7108 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:14:47.743665  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:47.745522  7160 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:47.730940  7084 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:47.747025  7042 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:47.750530  3263 raft_consensus.cc:1240] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:47.753471  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.754674  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:47.733659  7203 log.cc:927] Time spent T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:14:47.755364  3336 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:47.732728  7128 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:47.765779  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.761900  3157 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:47.766631  3341 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
W20260709 12:14:47.765722  3305 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.747058  7084 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:47.768237  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:47.767148  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:47.769084  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.723884  7129 consensus_queue.cc:1059] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:14:47.774394  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:47.775027  3268 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:47.776105  3267 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:14:47.778136  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:47.778327  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:47.730808  7193 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.779542  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:47.780103  3259 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
W20260709 12:14:47.780192  3305 leader_election.cc:336] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.778967  3267 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:47.781526  3263 raft_consensus.cc:2393] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:47.781190  3232 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:47.782054  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:47.782817  3267 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:47.772061  7084 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:47.768318  7205 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:47.774580  6965 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:47.787389  3305 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.775262  7113 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:14:47.792637  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.791838  7041 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.794066  7077 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:47.794768  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:47.795399  6965 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.812505  7041 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:47.812785  7130 consensus_meta.cc:287] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 12:14:47.813227  7130 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.798141  7159 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.799214  7194 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:47.799590  7202 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.799839  7116 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.802284  3267 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 12.
I20260709 12:14:47.748205  7196 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.804515  7186 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:47.809432  7171 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:47.810554  7208 log.cc:927] Time spent T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:14:47.796044  7200 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:47.814808  7172 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:47.819049  7104 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:47.821434  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:47.820815  3305 leader_election.cc:336] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.823057  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:47.824105  7193 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:47.824282  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:47.777477  7108 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:47.827419  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:47.845012  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:47.921341  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 100853us
W20260709 12:14:47.893939  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 255731us
I20260709 12:14:47.920887  3265 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:47.922953  3264 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:47.921197  3263 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:47.826447  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:47.861032  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.867115  3157 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:47.849112  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:47.927678  3341 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:47.848284  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:47.928664  3338 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:47.848706  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.847851  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.932267  3336 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:47.899207  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:47.933785  3333 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:47.933723  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:47.926074  3340 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
W20260709 12:14:47.935913  3305 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:47.939736  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.924825  3268 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:47.876425  3086 catalog_manager.cc:5697] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:47.954136  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:47.954962  3268 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:47.956858  3896 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:47.958129  3305 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:47.959622  3305 leader_election.cc:336] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.957669  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:47.812939  7109 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.964319  3896 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:47.964973  7109 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:47.839772  7212 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:47.965975  7162 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:47.966418  7162 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.966769  7162 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:47.807047  7205 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.968405  7121 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:47.969550  7205 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:47.970746  7121 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:47.971220  7110 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.971810  7110 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.974159  7110 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:47.955931  7042 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.975868  7042 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:47.977797  7042 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:47.934707  7100 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:47.959414  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:47.980261  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 113259us
I20260709 12:14:47.980829  3266 raft_consensus.cc:2393] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 7: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:47.958405  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:47.982728  3305 leader_election.cc:336] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.984103  3305 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:47.958889  3338 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:47.862591  3339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45092
I20260709 12:14:47.991169  3339 raft_consensus.cc:606] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Received request to transfer leadership
I20260709 12:14:47.982823  3259 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
W20260709 12:14:47.991385  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 254960us
I20260709 12:14:47.891780  7111 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.971139  7121 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:47.951512  7070 consensus_meta.cc:287] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.005s
I20260709 12:14:48.025970  3086 catalog_manager.cc:5697] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:48.034619  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 53772.3us
I20260709 12:14:47.979274  7100 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:47.921727  7194 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:48.009238  3305 leader_election.cc:336] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Timed out: RequestConsensusVote RPC to 127.1.248.66:38853 timed out after 2.129s (SENT)
I20260709 12:14:48.012928  3156 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:48.005307  6866 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:48.014710  7186 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:48.015360  7001 raft_consensus.cc:3055] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:48.016682  7124 raft_consensus.cc:993] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141: : Instructing follower 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:14:48.018683  7198 consensus_queue.cc:1048] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:48.035317  3157 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:47.948638  7116 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.022538  7121 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.072726  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:48.073407  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.027683  3086 catalog_manager.cc:5697] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 6 to 7, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 7 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:48.057983  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 45156.3us
I20260709 12:14:48.060298  3263 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:48.056314  3895 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:48.049281  7070 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301) with higher term. Message: Invalid argument: T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 10. Current term is 11.
I20260709 12:14:48.082814  3333 raft_consensus.cc:1275] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:48.066977  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:48.068789  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:48.069017  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:48.075824  3156 leader_election.cc:400] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Vote denied by peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853) with higher term. Message: Invalid argument: T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10.
I20260709 12:14:48.066165  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:47.953262  7108 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:48.073475  3340 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 13.
I20260709 12:14:48.078428  3086 catalog_manager.cc:5697] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 5 to 7, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 7 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:48.034304  6984 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:48.093111  3156 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:48.093374  3340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45092
W20260709 12:14:48.081754  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 72536.1us
I20260709 12:14:48.085040  3338 raft_consensus.cc:2393] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 9: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:48.006953  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:48.056016  7194 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.089382  3086 catalog_manager.cc:5697] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.091204  3157 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:48.057358  6866 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.084474  3927 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:48.030601  7111 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.106797  3086 catalog_manager.cc:5697] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 7 to 10, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 10 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.115368  3157 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:48.069676  7079 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:48.058851  7001 raft_consensus.cc:740] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
W20260709 12:14:48.105026  3087 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48786 (request call id 305) took 13258 ms (client timeout 15000 ms). Trace:
I20260709 12:14:48.088860  7166 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:48.048573  7138 consensus_queue.cc:1048] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:14:48.072530  7160 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.072309  7171 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:48.100358  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.088521  7193 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:14:48.139439  3156 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:48.141578  3156 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:48.109133  3086 catalog_manager.cc:5697] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:48.099499  7042 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:48.102782  7186 raft_consensus.cc:1081] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Signalling peer 6f0cdd57c5934921829c205d32b2b8a5 to start an election
I20260709 12:14:48.135179  3157 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:48.105885  6866 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:48.143469  3086 catalog_manager.cc:5697] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 9 to 13, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 13 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:48.127064  7070 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:48.126720  7166 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.099828  6984 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:48.123551  3087 rpcz_store.cc:269] 0709 12:14:34.846429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.846621 (+   192us) service_pool.cc:224] Handling call
0709 12:14:48.104929 (+13258308us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:45.635691 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:45.636376 (+   685us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:45.636414 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:14:45.636431 (+    17us) tablet.cc:662] Decoding operations
0709 12:14:45.638645 (+  2214us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:45.638730 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:45.638755 (+    25us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:14:45.640627 (+  1872us) tablet.cc:701] Row locks acquired
0709 12:14:45.640648 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:14:45.640803 (+   155us) write_op.cc:270] Start()
0709 12:14:45.640925 (+   122us) write_op.cc:276] Timestamp: P: 1783599285640754 usec, L: 0
0709 12:14:45.640947 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:14:45.641751 (+   804us) log.cc:844] Serialized 9002 byte log entry
0709 12:14:45.916157 (+274406us) op_driver.cc:464] REPLICATION: finished
0709 12:14:46.141239 (+225082us) write_op.cc:301] APPLY: starting
0709 12:14:46.142351 (+  1112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:46.169668 (+ 27317us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:46.174743 (+  5075us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:46.223520 (+ 48777us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:46.224058 (+   538us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 12:14:46.224113 (+    55us) write_op.cc:312] APPLY: finished
0709 12:14:46.224491 (+   378us) log.cc:844] Serialized 158 byte log entry
0709 12:14:46.231964 (+  7473us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:46.258743 (+ 26779us) write_op.cc:454] Released schema lock
0709 12:14:46.306673 (+ 47930us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:46.349737 (+ 43064us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:46.358527 (+  8790us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":257057,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":221464,"apply.run_cpu_time_us":6206,"apply.run_wall_time_us":194268,"num_ops":23,"prepare.queue_time_us":8180,"prepare.run_cpu_time_us":65588,"prepare.run_wall_time_us":74675,"raft.queue_time_us":86385,"raft.run_cpu_time_us":50127,"raft.run_wall_time_us":237865,"replication_time_us":220765,"thread_start_us":263826,"threads_started":4,"wal-append.queue_time_us":77843,"wal-append.run_cpu_time_us":5965,"wal-append.run_wall_time_us":1522192}]]}
I20260709 12:14:48.168581  3086 catalog_manager.cc:5697] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 4 to 7, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 7 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:14:48.144565  7115 consensus_meta.cc:287] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.000s
I20260709 12:14:48.170830  3086 catalog_manager.cc:5697] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:48.137043  7171 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.174516  3086 catalog_manager.cc:5697] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.175172  3156 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:48.124243  7110 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:48.181206  7108 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:48.180635  3086 catalog_manager.cc:5697] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.182307  3086 catalog_manager.cc:5697] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:48.182741  7116 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.183507  7196 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.184303  7159 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.149390  6735 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:48.183982  7001 consensus_queue.cc:260] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:48.184013  3086 catalog_manager.cc:5697] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.185809  7100 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:48.186101  7193 consensus_queue.cc:1048] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:48.185722  3086 catalog_manager.cc:5697] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 4 to 7, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 7 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:48.184963  6735 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.187168  3086 catalog_manager.cc:5697] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.188076  6735 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:48.189148  7162 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:48.192723  6481 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:48.193487  3340 raft_consensus.cc:606] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Received request to transfer leadership
I20260709 12:14:48.140406  7160 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:48.165295  7166 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:48.203687  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 108004us
I20260709 12:14:48.207213  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:48.126614  7214 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:14:48.209792  3923 raft_consensus.cc:2393] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:48.174264  7191 raft_consensus.cc:2804] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:48.205370  7110 raft_consensus.cc:697] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:48.196554  7171 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.176656  7041 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:48.196803  7172 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:48.209982  3305 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:48.184952  7159 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:14:48.220722  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:48.225968  7110 consensus_queue.cc:237] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.230304  3305 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:48.179632  3264 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
W20260709 12:14:48.233160  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 100659us
I20260709 12:14:48.235105  3924 raft_consensus.cc:2368] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:48.242992  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.243973  3268 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.219074  3930 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:48.210623  3931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea"
dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
 from {username='slave'} at 127.0.0.1:37962
I20260709 12:14:48.246805  3931 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:48.247315  3931 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.215045  7191 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.177037  7115 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.257874  7194 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.261868  7172 raft_consensus.cc:697] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:48.263316  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:48.288504  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 109409us
I20260709 12:14:48.264474  3261 raft_consensus.cc:1275] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:48.268514  3931 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:48.227815  7070 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.294068  3157 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:48.276840  7212 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:48.277469  7130 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.234422  7159 consensus_queue.cc:1243] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:48.296895  3305 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:48.297477  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 118546us
I20260709 12:14:48.314395  3156 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:48.234659  7186 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:48.285590  7191 raft_consensus.cc:3060] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:48.316497  3156 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:48.322703  3157 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:48.323180  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:48.283880  6899 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:48.323907  3334 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:48.328306  3156 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:48.336091  3232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.298580  7017 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:14:48.368165  3931 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.368860  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:48.313078  6765 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:48.316008  7217 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:48.376881  3341 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:48.381788  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:48.317762  7128 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:48.383596  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.385200  3260 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.383913  3338 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:48.389216  3157 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:48.299068  7070 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.375149  7212 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:48.369202  7017 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.381177  7111 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.385131  7109 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:48.421746  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 124922us
I20260709 12:14:48.422572  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:48.426321  3305 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:48.365653  6899 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:48.432647  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 104416us
I20260709 12:14:48.411525  7110 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:48.409909  7017 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:48.388952  7217 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:48.420677  7041 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:48.443552  3260 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
W20260709 12:14:48.433377  7222 log.cc:927] Time spent T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:14:48.420426  7109 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.451504  7109 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.451762  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:48.452585  3342 raft_consensus.cc:2393] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:48.454862  3305 leader_election.cc:336] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:48.455312  3305 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:48.425375  7079 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:48.421211  7212 raft_consensus.cc:697] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:48.446254  3341 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:14:48.459736  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 70628.2us
I20260709 12:14:48.447345  7160 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:48.447523  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:48.399617  7172 consensus_queue.cc:237] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.464443  3340 raft_consensus.cc:2393] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:48.447562  7113 consensus_queue.cc:1048] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:48.448504  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:48.465780  3335 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 11.
I20260709 12:14:48.449150  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:48.449568  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.449764  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:48.443099  6765 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:48.458391  3259 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 13.
I20260709 12:14:48.435181  7124 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:48.432842  6984 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:48.444082  7084 consensus_meta.cc:287] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.003s
I20260709 12:14:48.467679  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.468729  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:48.468217  3337 raft_consensus.cc:2393] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:48.486565  7084 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:48.488119  3929 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:48.437472  7229 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:48.497722  7079 raft_consensus.cc:697] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:48.498807  7115 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.500568  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:48.511119  3231 leader_election.cc:336] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:48.511327  3259 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.511562  3231 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:48.512535  3231 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 150 similar messages]
I20260709 12:14:48.502140  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.502988  3268 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
W20260709 12:14:48.503909  3076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 276739us
I20260709 12:14:48.464093  7186 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:48.517648  2017 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 3218)
I20260709 12:14:48.517858  3268 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 12:14:48.481746  7041 raft_consensus.cc:697] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 12 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:48.517131  7124 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:48.528486  3259 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
I20260709 12:14:48.534570  3265 raft_consensus.cc:2393] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 10: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:48.535244  3232 leader_election.cc:400] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:48.499869  7227 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.535597  3232 leader_election.cc:403] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:14:48.543210  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:48.543783  3231 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:48.521117  6984 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:48.560353  3231 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:48.539740  7124 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:48.562999  3231 leader_election.cc:336] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:48.542145  7221 log.cc:927] Time spent T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:14:48.563560  3231 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:48.543071  7202 consensus_meta.cc:287] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.003s
I20260709 12:14:48.547385  3157 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:48.564203  6984 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:48.566452  7100 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:14:48.566655  7232 log.cc:927] Time spent T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:14:48.566011  3231 leader_election.cc:336] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:48.567091  7084 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:48.570294  3231 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:48.542853  7227 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:48.570444  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 57464.5us
W20260709 12:14:48.595655  3231 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:48.555339  7116 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 9.
I20260709 12:14:48.573099  7217 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:48.579327  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:48.579630  7041 consensus_queue.cc:237] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.598623  3333 raft_consensus.cc:3055] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:48.596618  3231 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:48.599014  3333 raft_consensus.cc:740] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:14:48.582698  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:48.599674  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 138963us
W20260709 12:14:48.600225  3305 leader_election.cc:336] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:48.600600  3305 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:48.582316  7079 consensus_queue.cc:237] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:48.584250  6899 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.590653  3157 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:48.591795  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:48.544365  7229 raft_consensus.cc:697] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:48.611196  3338 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:48.612679  3305 leader_election.cc:336] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:48.521003  6735 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.603405  3334 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:48.607434  7202 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:48.610086  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:48.622083  3231 leader_election.cc:336] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:48.622584  3231 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:48.613096  3305 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:48.610634  7194 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.612227  3333 consensus_queue.cc:260] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:48.615355  7001 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.613719  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:48.616052  7227 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:48.628784  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:48.629616  3931 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:48.630637  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:48.619626  3338 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:48.578738  7121 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:48.604012  7100 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:48.627342  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:48.627660  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:48.627877  3340 raft_consensus.cc:2393] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 9: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:48.652308  3259 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 13.
I20260709 12:14:48.632797  3268 raft_consensus.cc:1275] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:48.617136  7159 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:48.591325  7128 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:48.639582  3157 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:48.631217  3266 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:48.544659  7212 consensus_queue.cc:237] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.672672  3263 pending_rounds.cc:85] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 6
I20260709 12:14:48.673010  3263 pending_rounds.cc:107] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:14:48.673323  3263 raft_consensus.cc:2889] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:48.610845  7070 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.650559  3267 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 6.
I20260709 12:14:48.632601  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.675655  7196 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:48.653545  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.613772  7217 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:48.655369  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:48.676849  3268 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.677220  3335 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:48.679730  7239 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:14:48.680306  7171 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.654663  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:48.682300  3265 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:48.683283  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:48.654682  7159 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.660153  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:48.656112  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:48.660808  6919 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:48.661095  7162 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.661356  7234 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.654665  7213 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:48.659849  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:48.625844  7084 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.668888  3896 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:48.670835  7121 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.708714  3157 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:48.659369  3305 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:48.671754  3927 raft_consensus.cc:1240] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 10. Ops: []
I20260709 12:14:48.676088  3232 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:48.680982  7124 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:48.629432  7116 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:48.688685  3259 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:48.660279  7128 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.693930  3339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea"
dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45092
I20260709 12:14:48.690887  7159 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:48.715392  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.701954  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.710579  3268 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:48.694998  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:48.720014  3264 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.720152  3337 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.711597  3335 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:48.689291  7171 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.713733  3156 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:48.716241  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 56925.4us
I20260709 12:14:48.725737  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:48.718197  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:48.727313  3342 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.721866  3157 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:48.671626  6866 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.683401  7194 consensus_queue.cc:1048] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.037s
W20260709 12:14:48.739674  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 130207us
I20260709 12:14:48.744489  3305 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:48.749019  3233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.701795  6919 raft_consensus.cc:697] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:48.750206  3266 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:48.755107  3264 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:48.758955  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:48.715628  7207 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:48.718263  7193 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:48.762267  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:48.723613  7124 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:14:48.781175  3895 leader_election.cc:336] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:48.771306  6919 consensus_queue.cc:237] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.762317  7171 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.727193  7224 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:48.716794  7128 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.756008  7113 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:48.708186  7234 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.791944  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.794464  7017 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.749373  7236 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:48.782008  7193 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.810096  3342 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
I20260709 12:14:48.811834  3337 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:48.783977  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:48.779138  6481 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:48.775100  7207 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.776003  7223 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:14:48.850752  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 137153us
I20260709 12:14:48.852185  3157 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:48.802181  6765 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:48.852553  3896 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:48.860656  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.861202  3267 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:48.843007  7227 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.718634  7229 consensus_queue.cc:237] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.787842  7186 consensus_queue.cc:1059] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:14:48.854238  7193 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:48.847719  7224 raft_consensus.cc:697] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:48.878575  7226 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:48.854744  6481 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.858476  7207 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:48.892014  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 100097us
I20260709 12:14:48.813364  7171 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:48.854939  7236 raft_consensus.cc:697] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:48.899170  3267 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:48.899446  3264 raft_consensus.cc:3060] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.907739  3929 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
W20260709 12:14:48.870163  7200 consensus_meta.cc:287] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9: Time spent flushing consensus metadata: real 0.884s	user 0.006s	sys 0.006s
I20260709 12:14:48.910763  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:48.845814  6979 consensus_queue.cc:1048] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:14:48.922492  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:48.879935  7079 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.933971  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.934724  3267 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:48.913897  6481 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.896136  7198 raft_consensus.cc:2804] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:48.922951  7223 raft_consensus.cc:3055] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:48.934636  7200 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:48.912300  6735 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.952400  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:48.953182  3265 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:48.931932  3264 raft_consensus.cc:2468] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
W20260709 12:14:48.943817  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 159935us
W20260709 12:14:48.937618  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 85157.5us
I20260709 12:14:48.922763  7217 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:48.945786  3267 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 14.
I20260709 12:14:48.939133  7079 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:48.880211  7227 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.945621  7223 raft_consensus.cc:740] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:48.986801  7223 consensus_queue.cc:260] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.987527  7079 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:48.988272  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:48.988926  3259 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:48.989478  3262 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
W20260709 12:14:48.990123  7109 consensus_meta.cc:287] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.001s
I20260709 12:14:48.990605  7109 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:48.992796  7227 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.992828  7109 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:48.995839  6866 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:48.996614  3342 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:48.997635  7171 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:48.998448  7224 consensus_queue.cc:237] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:49.003360  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:48.983857  7236 consensus_queue.cc:237] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:48.976492  3305 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:49.039578  7217 raft_consensus.cc:697] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:48.988309  7223 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:49.044248  3342 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:48.942699  7001 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:14:48.980983  7254 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:49.046425  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:49.046898  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 70582.5us
I20260709 12:14:49.049134  3262 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:14:49.049578  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:49.053252  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:49.053915  3268 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:48.980154  7234 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:49.026919  7198 raft_consensus.cc:697] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
W20260709 12:14:49.047911  7191 consensus_meta.cc:287] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.688s	user 0.002s	sys 0.009s
I20260709 12:14:49.056198  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:49.070423  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:49.067260  7166 consensus_meta.cc:287] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.844s	user 0.005s	sys 0.004s
I20260709 12:14:49.051417  7001 raft_consensus.cc:697] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:49.059553  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:49.073099  3927 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:49.060738  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:49.049913  7124 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.061756  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:49.075948  3340 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:49.076113  3337 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:49.062736  3338 raft_consensus.cc:1275] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:49.062748  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:49.043159  7128 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.078343  3335 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:49.063027  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:49.063407  7217 consensus_queue.cc:237] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.051630  7159 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:49.068571  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:49.058701  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.072503  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:49.083328  3929 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 8.
I20260709 12:14:49.083129  3157 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:49.050562  7226 raft_consensus.cc:697] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:49.069388  7042 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.087321  7001 consensus_queue.cc:237] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:49.088568  7128 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:49.089820  6735 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:49.078461  7191 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.109014  7191 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:49.108708  6481 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.091995  7261 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:14:49.112782  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:49.113478  3260 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:49.095764  3157 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:49.097193  3265 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:49.098878  3336 raft_consensus.cc:1240] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 8. Current term is 10. Ops: []
I20260709 12:14:49.099499  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:49.114450  3927 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:49.098924  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:49.101511  7042 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.104712  7084 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.080086  7113 raft_consensus.cc:697] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 13 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:49.105098  6735 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.111549  3262 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:49.114638  3338 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:49.129729  3305 leader_election.cc:336] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:49.100155  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:49.145634  3340 raft_consensus.cc:2393] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:49.145505  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:49.116657  3337 raft_consensus.cc:2393] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:49.124411  7042 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:49.127871  7017 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 14 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:49.127966  3261 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:49.128429  3260 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:49.081274  7166 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:49.135496  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:49.135797  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:49.136122  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:49.137619  7226 consensus_queue.cc:237] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.163002  3268 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:49.163218  3267 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:49.151563  3338 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
I20260709 12:14:49.164750  3232 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:49.120941  7191 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:49.153623  6965 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.144503  6735 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:49.180287  7191 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.180817  7191 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:49.100833  7193 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:49.131981  7128 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 12:14:49.192922  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 51275.8us
I20260709 12:14:49.194032  3156 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:49.196645  3931 raft_consensus.cc:2393] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 9: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:49.122023  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:49.200522  3268 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:49.201469  3261 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
W20260709 12:14:49.204808  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 345990us
I20260709 12:14:49.216429  3156 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:49.218541  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 96595.4us
I20260709 12:14:49.221807  3157 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:49.189709  7084 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:49.187201  6481 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:49.224849  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:49.225865  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:49.206427  7100 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:49.227124  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:49.231936  3156 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:49.236235  3156 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:49.234402  3340 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:49.227075  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:49.237766  3335 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:49.217743  7041 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:49.230902  7017 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:49.223176  7194 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:49.242223  3156 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:49.248234  3157 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:49.231251  6965 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:49.233386  6866 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:14:49.250306  3156 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:49.246536  7042 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:49.245942  7109 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:49.246275  7017 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.240212  7113 consensus_queue.cc:237] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.255784  7159 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:49.256865  7110 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:49.240166  7171 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:49.262651  3335 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:49.268733  3266 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:49.282356  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:49.242116  7084 raft_consensus.cc:697] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:49.172744  7198 consensus_queue.cc:237] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:49.302683  7084 consensus_queue.cc:237] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.283025  3266 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:49.273841  6866 raft_consensus.cc:697] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 14 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:49.309486  6735 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.310638  6866 consensus_queue.cc:237] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.311834  7110 raft_consensus.cc:697] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:14:49.288905  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.264485  6965 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.281064  7171 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.275012  7017 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:49.281646  7109 raft_consensus.cc:697] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:49.282997  7193 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:49.322026  7207 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.273213  7079 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:49.240545  7100 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:49.331184  3266 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:49.250104  7041 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:49.337246  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:49.431115  3265 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:14:49.280185  7042 raft_consensus.cc:697] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:49.434957  3259 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 12: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:49.313169  7110 consensus_queue.cc:237] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.427853  7263 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.329515  7171 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:49.283232  7070 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:49.450919  3265 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 12.
I20260709 12:14:49.422410  7194 raft_consensus.cc:697] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:14:49.518100  2017 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 3218)
I20260709 12:14:49.446121  7070 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.452378  7263 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:49.594503  7213 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:49.599803  7070 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:49.646555  7273 log.cc:927] Time spent T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:14:49.592437  7109 consensus_queue.cc:237] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.840168  7041 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:49.640095  7042 consensus_queue.cc:237] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:49.893779  6965 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:49.894332  7275 log.cc:927] Time spent T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.458s	user 0.001s	sys 0.000s
I20260709 12:14:49.898967  7100 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:49.900763  7263 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:49.828574  7202 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:49.905788  7202 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:49.909674  7207 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:49.663292  7213 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:49.912634  7213 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:49.667774  7194 consensus_queue.cc:237] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:49.981614  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.990790  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:49.991748  3337 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 11.
I20260709 12:14:49.970980  6979 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.994685  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56758 (request call id 2354) took 1366 ms. Trace:
I20260709 12:14:49.996255  6979 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:49.998791  6979 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:49.995360  3261 rpcz_store.cc:276] 0709 12:14:48.628283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.628472 (+   189us) service_pool.cc:224] Handling call
0709 12:14:49.994420 (+1365948us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54001a1154. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:49.994601 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038524672}
I20260709 12:14:50.024734  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:50.027375  7191 consensus_meta.cc:287] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.846s	user 0.012s	sys 0.000s
I20260709 12:14:50.018477  6965 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.036486  3896 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:50.043592  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:50.047145  3260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.014s	sys 0.001s
W20260709 12:14:50.047770  3260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.015s	sys 0.001s
I20260709 12:14:50.056850  7202 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.042409  7191 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.059501  7191 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.041850  6965 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.063596  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:50.066113  6965 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.067306  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:50.068002  3927 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:50.068094  3261 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 13. Current term is 14. Ops: []
I20260709 12:14:50.069476  3306 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:50.070355  6965 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:50.070807  6965 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.071229  6965 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.079741  3268 raft_consensus.cc:1240] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:50.067178  3308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.086297  3157 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.010s	sys 0.009s
W20260709 12:14:50.086746  3157 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.010s	sys 0.009s
W20260709 12:14:50.087137  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 838939us
I20260709 12:14:50.047992  7001 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:50.051537  7224 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:50.092568  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:50.096983  3927 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:50.097868  3264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.010s	sys 0.022s
W20260709 12:14:50.098340  3264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.010s	sys 0.022s
W20260709 12:14:50.109578  3156 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.008s	sys 0.011s
I20260709 12:14:50.108156  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:50.113461  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:50.113973  3924 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:50.114215  3262 raft_consensus.cc:3060] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:50.112800  3156 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.009s	sys 0.011s
I20260709 12:14:50.111783  3338 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:14:50.115159  3338 pending_rounds.cc:85] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 7
I20260709 12:14:50.115402  3338 pending_rounds.cc:107] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:14:50.115674  3338 raft_consensus.cc:2889] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:50.100468  3336 raft_consensus.cc:1240] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 12:14:50.108619  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:50.100214  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:50.118314  3929 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:50.128394  3262 raft_consensus.cc:2468] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:50.097632  7166 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:50.097517  7224 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.138191  3929 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:50.139883  3927 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 12.
I20260709 12:14:50.141435  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:50.145869  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:50.147364  3334 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:50.153869  3262 raft_consensus.cc:1240] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:50.156718  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:50.157287  3259 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:14:50.161454  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:50.162091  3267 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 12: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:14:50.164244  3231 leader_election.cc:336] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:50.165105  3231 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:50.167794  3262 raft_consensus.cc:1275] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:14:50.166520  3231 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:50.172988  3231 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:50.098902  7001 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.178504  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:50.180954  3335 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:50.084718  7234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.046s	sys 0.072s
I20260709 12:14:50.092427  6965 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.140692  7110 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.149859  7224 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:50.194571  3259 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:50.175444  7268 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.140622  7084 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 12:14:50.190132  7234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.047s	sys 0.072s
I20260709 12:14:50.179855  7227 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.208833  3337 raft_consensus.cc:2393] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 10: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:50.196041  7100 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:50.214294  3335 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 12.
W20260709 12:14:50.215785  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 169091us
I20260709 12:14:50.202215  7202 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:50.244313  7202 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:50.245333  7202 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.245854  7202 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.246814  6965 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:50.250066  7017 consensus_meta.cc:287] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.911s	user 0.011s	sys 0.000s
I20260709 12:14:50.256480  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:50.257310  3930 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.202032  7292 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:50.250710  7017 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.267076  3157 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:50.197865  7110 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.280805  3157 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
W20260709 12:14:50.282272  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 115774us
I20260709 12:14:50.278276  3333 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:50.282980  3231 leader_election.cc:336] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:50.285020  3930 raft_consensus.cc:2468] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
W20260709 12:14:50.289058  3305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.293556  3335 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:50.294885  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:50.290983  3306 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:50.207808  7268 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.283398  3231 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:50.267023  7041 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:50.301611  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:50.273141  6979 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:50.304692  3335 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 12: Already voted for candidate 7ac63b674f204bc4805ab989f8c965d3 in this term.
W20260709 12:14:50.303550  3231 leader_election.cc:336] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:50.213238  7227 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.308418  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:50.314975  3335 raft_consensus.cc:1275] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:50.298393  6866 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:50.289935  7294 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:50.263485  7100 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.322049  7113 consensus_queue.cc:1059] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:14:50.300168  7270 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.306659  7290 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:50.306928  7288 raft_consensus.cc:2804] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:50.329910  7202 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.333966  3231 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:50.326926  7070 consensus_meta.cc:287] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.002s
I20260709 12:14:50.306712  7109 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:14:50.274412  7292 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:50.333563  7171 consensus_meta.cc:287] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.877s	user 0.012s	sys 0.000s
I20260709 12:14:50.334633  6866 raft_consensus.cc:697] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:50.315687  6979 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.319347  7124 consensus_queue.cc:1059] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:14:50.342519  7042 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.379863  7042 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.380259  7017 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.381989  7042 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.341634  7070 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.383206  7227 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.384214  6979 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.384533  7070 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.336064  7270 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.386409  7292 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.387415  7307 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:50.343459  7288 raft_consensus.cc:697] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:50.313145  7041 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.389433  7288 consensus_queue.cc:237] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.389987  3264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 823) took 1169 ms. Trace:
I20260709 12:14:50.390343  3264 rpcz_store.cc:276] 0709 12:14:49.220745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.221492 (+   747us) service_pool.cc:224] Handling call
0709 12:14:49.221919 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:49.222367 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:49.234696 (+ 12329us) log.cc:844] Serialized 14 byte log entry
0709 12:14:49.311255 (+ 76559us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b180020de80. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb45ac0a 00007f1af4b9a219 00007f1af24a158f 00007f1aeb4e0571 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd
0709 12:14:50.098845 (+787590us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:50.099493 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 12:14:50.100086 (+   593us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:50.100120 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.100192 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:50.389703 (+289511us) raft_consensus.cc:1685] finished
0709 12:14:50.389804 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.389930 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1578,"prepare.queue_time_us":14666,"raft.queue_time_us":9534,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":14485,"spinlock_wait_cycles":16239744,"thread_start_us":841208,"threads_started":1,"wal-append.queue_time_us":1074793}
I20260709 12:14:50.392098  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:50.368098  7289 log.cc:927] Time spent T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:14:50.392536  7041 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.393337  7202 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:50.394030  7202 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:50.394492  7202 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.394955  3260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2381) took 1127 ms. Trace:
I20260709 12:14:50.368922  7171 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:50.396202  7301 log.cc:927] Time spent T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:14:50.387967  6965 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.387964  7307 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.342756  7298 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:50.384564  3342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58564 (request call id 2448) took 1474 ms (client timeout 1923 ms). Trace:
W20260709 12:14:50.399078  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 95417.1us
W20260709 12:14:50.417806  3342 rpcz_store.cc:269] 0709 12:14:48.910290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.910463 (+   173us) service_pool.cc:224] Handling call
0709 12:14:50.384340 (+1473877us) spinlock_profiling.cc:243] Waited 68.5 ms on lock 0x7b540038bdd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:50.384490 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157482368}
I20260709 12:14:50.340754  7290 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:50.408689  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 144036us
I20260709 12:14:50.395365  3260 rpcz_store.cc:276] 0709 12:14:49.267198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.268660 (+  1462us) service_pool.cc:224] Handling call
0709 12:14:49.269073 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:49.322743 (+ 53670us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:49.324446 (+  1703us) log.cc:844] Serialized 14 byte log entry
0709 12:14:50.197948 (+873502us) log.cc:844] Serialized 14 byte log entry
0709 12:14:50.199152 (+  1204us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:50.201565 (+  2413us) log.cc:844] Serialized 26 byte log entry
0709 12:14:50.201758 (+   193us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:50.201942 (+   184us) log.cc:844] Serialized 14 byte log entry
0709 12:14:50.207719 (+  5777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.207881 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:50.394742 (+186861us) raft_consensus.cc:1685] finished
0709 12:14:50.394764 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.394897 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56541,"prepare.queue_time_us":358245,"prepare.run_cpu_time_us":194,"prepare.run_wall_time_us":5401,"raft.queue_time_us":142404,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":3348,"thread_start_us":859088,"threads_started":2,"wal-append.queue_time_us":837743}
W20260709 12:14:50.418207  3231 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:50.400573  3333 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:50.324895  7191 consensus_queue.cc:1059] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 12:14:50.425025  3333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52822 (request call id 989) took 1846 ms (client timeout 1884 ms). Trace:
W20260709 12:14:50.436084  3333 rpcz_store.cc:269] 0709 12:14:48.578896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.579011 (+   115us) service_pool.cc:224] Handling call
0709 12:14:50.267343 (+1688332us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b58006359d0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5290aa 00007f1aee5ab447 00007f1aee5c3fe7 00007f1aee5c57de 00007f1aee5d127c 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c
0709 12:14:50.424964 (+157621us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128708480}
I20260709 12:14:50.425347  3339 raft_consensus.cc:606] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Received request to transfer leadership
I20260709 12:14:50.437291  3339 raft_consensus.cc:614] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:14:50.425696  3231 leader_election.cc:336] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:50.439042  3231 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:50.427131  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:50.387262  7270 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:50.445923  3231 leader_election.cc:336] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:50.396780  7202 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.451325  3231 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:50.449636  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 142494us
I20260709 12:14:50.449260  7191 raft_consensus.cc:3055] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:50.452911  7296 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:50.460637  7191 raft_consensus.cc:740] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:50.461632  7191 consensus_queue.cc:260] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.462909  7191 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.463824  7307 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.464447  7307 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:50.465741  7171 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.441674  7217 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.442688  7294 raft_consensus.cc:697] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 12 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:50.422806  6965 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.458122  7270 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:50.460638  7110 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.462926  7268 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.436512  7298 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:50.487253  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 48394.4us
I20260709 12:14:50.495692  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:50.496892  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:50.487140  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 186540us
I20260709 12:14:50.504230  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:50.524698  2017 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 3218)
I20260709 12:14:50.547336  3157 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:50.451960  6866 consensus_queue.cc:237] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.482477  7100 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.442238  7290 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.569260  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:50.570528  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:50.546895  7109 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.572371  3923 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.571956  3333 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.572921  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:50.577198  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:50.577303  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:50.577934  3335 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.475770  7217 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.578900  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:50.574770  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:50.549017  7041 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:50.594527  3333 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
W20260709 12:14:50.581624  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 135737us
W20260709 12:14:50.601682  3231 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:50.602236  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 142686us
I20260709 12:14:50.602952  3895 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:50.582229  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:50.484670  7270 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.605123  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:50.608400  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 303138us
I20260709 12:14:50.613464  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:50.571388  7314 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:50.551915  7110 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:14:50.619740  3342 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:50.618517  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:50.622287  3335 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:50.625175  3335 raft_consensus.cc:1275] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:50.584312  7109 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.632550  7298 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.632915  7109 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.634795  7286 raft_consensus.cc:2804] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:50.604837  7202 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.580695  7320 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:50.636443  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:50.618005  7041 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:50.652591  7310 log.cc:927] Time spent T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:14:50.652733  6965 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:50.636046  7314 raft_consensus.cc:697] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:50.653991  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55438 (request call id 953) took 1585 ms. Trace:
I20260709 12:14:50.654460  3931 rpcz_store.cc:276] 0709 12:14:49.068572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.068716 (+   144us) service_pool.cc:224] Handling call
0709 12:14:50.653740 (+1585024us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54006063d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:50.653901 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264840064}
I20260709 12:14:50.654404  7314 consensus_queue.cc:237] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:50.659168  7287 log.cc:927] Time spent T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.508s	user 0.005s	sys 0.000s
I20260709 12:14:50.581285  7294 consensus_queue.cc:237] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.670040  7327 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.670651  7327 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.643719  7202 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.678108  7202 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.678570  7128 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.679144  7128 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.680822  7290 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.655145  7270 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:50.681561  7128 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.682799  7109 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.651230  7041 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.686316  7041 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.678890  3923 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:50.714094  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:50.714982  3923 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:50.725762  3232 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:50.728485  3232 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:50.688908  7217 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.688555  7224 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.689486  7266 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:50.672946  7327 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:50.709715  7290 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:50.739863  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 161432us
W20260709 12:14:50.752561  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 132254us
W20260709 12:14:50.738165  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 135300us
I20260709 12:14:50.683341  7109 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.770279  7316 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.770958  7316 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.772560  3157 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:50.773593  7110 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:50.774151  7110 raft_consensus.cc:697] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:50.774734  3157 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:50.775672  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:50.731364  7202 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:50.778621  3157 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:50.780272  7341 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:50.645133  7320 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:50.758136  7198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.453s	user 0.019s	sys 0.016s
I20260709 12:14:50.759720  7266 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.783301  7322 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:50.783469  7100 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:50.783139  7341 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.784137  7322 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.784238  7100 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:50.784615  7322 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.784849  7100 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.785552  7341 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.756271  7290 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.737519  7286 raft_consensus.cc:697] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:50.775628  7334 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:50.773288  7316 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.796319  7224 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:50.790132  7198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.485s	user 0.020s	sys 0.016s
I20260709 12:14:50.775190  7110 consensus_queue.cc:237] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.802296  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:50.803179  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:50.805261  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:50.807723  3335 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:50.789415  7292 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:50.787667  7326 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:50.789935  7290 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.820210  7332 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:50.820065  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:50.821216  7323 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:50.833089  7292 raft_consensus.cc:697] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:50.834270  7292 consensus_queue.cc:237] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.787365  7322 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.793380  7100 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.782368  7202 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.838615  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:50.844305  3263 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:50.790643  7070 consensus_queue.cc:1048] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:14:50.788165  7321 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 12:14:50.850994  7202 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.851986  7284 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.853183  7320 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.852802  7284 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.854308  3080 maintenance_manager.cc:419] P a718949aeb634dbb80222dbb0804b0c4: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033396
I20260709 12:14:50.831844  7323 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.855468  7286 consensus_queue.cc:237] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.856987  7323 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.859169  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:50.843739  7322 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:50.860052  7322 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.832162  7326 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.846532  7100 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:50.887130  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:50.887993  3342 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
I20260709 12:14:50.889569  3896 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:50.890620  7335 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:14:50.893152  3305 leader_election.cc:336] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:50.893649  3305 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:50.894682  3305 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:50.895501  3338 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:50.895020  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:50.871475  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 143038us
I20260709 12:14:50.902117  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:50.902748  3268 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:50.904527  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:50.866057  7186 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:50.922941  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:50.923081  3268 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 13.
I20260709 12:14:50.923825  3260 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 11.
W20260709 12:14:50.924026  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 142194us
I20260709 12:14:50.924485  3263 raft_consensus.cc:1240] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:14:50.891064  7335 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.928763  3335 raft_consensus.cc:2468] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 12.
I20260709 12:14:50.934728  3305 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:50.935633  7327 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:50.936020  7327 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.936379  7327 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.928989  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:50.916795  7288 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:50.929616  7348 raft_consensus.cc:493] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:50.928038  7202 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:50.939371  7266 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.939334  7202 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.941741  7202 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.942062  7326 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:50.942245  7344 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.942723  7344 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.931907  7212 raft_consensus.cc:3055] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:14:50.944103  7212 raft_consensus.cc:740] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:50.944860  7344 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:50.944936  7212 consensus_queue.cc:260] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.946105  7212 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:50.945950  7348 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.947290  3268 raft_consensus.cc:1240] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:50.947309  7077 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.945007  3156 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:50.937397  3260 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
W20260709 12:14:50.950778  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:50.937450  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:50.892814  7284 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:50.952346  3305 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:50.881451  7322 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:50.954994  3895 leader_election.cc:336] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:50.956575  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:50.937081  7335 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:50.892429  7100 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.950366  7344 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.955600  3895 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:50.917651  7323 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 12:14:50.964684  3895 leader_election.cc:336] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:50.965149  3895 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:50.965373  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:50.947418  7017 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:50.972292  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:50.972927  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:50.948077  7077 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.971220  3156 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:50.958261  7288 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:50.960347  7070 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:50.977994  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:50.983845  3259 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 8.
I20260709 12:14:50.960753  7109 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.978972  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:50.985283  3266 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 12.
I20260709 12:14:50.970647  7326 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:14:50.928325  7186 raft_consensus.cc:515] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:50.966336  7204 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:50.986280  7333 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:50.986475  3266 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:14:50.981069  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:50.993780  3265 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:50.983295  7110 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:50.976586  7332 consensus_queue.cc:1048] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:14:50.977445  7017 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:50.988195  3305 leader_election.cc:336] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:50.962937  7266 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:14:51.004299  7100 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:51.004745  7077 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.984812  7270 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:51.005383  7270 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.006780  7017 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.986792  7338 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:51.008293  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:51.009109  3265 raft_consensus.cc:2393] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 9: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:51.010468  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.011564  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.012238  3265 raft_consensus.cc:2393] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:51.012969  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.013262  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.013091  7335 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.014361  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:50.981817  7288 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.990031  7070 raft_consensus.cc:697] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:14:51.001870  7347 log.cc:927] Time spent T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:14:51.003054  7348 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.967348  7344 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:50.976713  7217 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:51.013502  3265 raft_consensus.cc:2468] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 7.
I20260709 12:14:50.993147  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
W20260709 12:14:50.997694  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.030424  3266 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:51.033255  7344 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:51.033607  3267 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:51.035597  7217 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.036054  7217 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:51.039768  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:51.040979  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:51.041975  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:51.043629  3342 raft_consensus.cc:1275] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:51.045256  3262 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:51.046595  3262 raft_consensus.cc:1275] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:50.992014  7326 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:51.044984  3267 raft_consensus.cc:1275] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:51.049072  3266 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:51.061787  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:51.062956  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.015254  7335 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:51.064100  3263 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:51.065057  3265 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:14:51.067239  7270 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:50.999579  7110 raft_consensus.cc:697] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:51.068615  7110 consensus_queue.cc:237] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.061548  3262 raft_consensus.cc:1275] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:14:51.027347  7288 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:51.080026  3231 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:51.080636  3231 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:51.080681  7217 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.081640  7348 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:51.082255  3340 raft_consensus.cc:1240] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:14:51.083662  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.084437  3927 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 13.
I20260709 12:14:51.044955  7100 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.088009  7100 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.090458  7100 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:51.092392  3306 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:51.095531  3231 consensus_peers.cc:597] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.097591  3262 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:51.075615  7326 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:14:51.105785  7297 log.cc:927] Time spent T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.868s	user 0.001s	sys 0.013s
I20260709 12:14:51.108263  7186 leader_election.cc:290] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:51.112833  7001 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:51.044536  7070 consensus_queue.cc:237] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.129406  3923 raft_consensus.cc:1240] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:14:51.131999  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.133997  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.137053  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.138859  3895 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:51.045270  7327 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.144690  3895 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:51.097981  7212 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:14:51.156037  3895 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:51.146600  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.159622  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.147735  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.145895  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.161577  3927 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:51.146720  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.164371  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.166014  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.169523  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.168635  7345 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:14:51.175022  7317 raft_consensus.cc:493] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:51.175638  7317 raft_consensus.cc:515] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.176153  7320 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:14:51.180634  7317 leader_election.cc:290] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:51.181595  7280 log.cc:927] Time spent T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 1.245s	user 0.007s	sys 0.000s
I20260709 12:14:51.183216  7197 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:51.189908  7327 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:51.191738  6735 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:51.194433  3156 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:51.195050  6735 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:51.183462  7001 consensus_queue.cc:1059] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:14:51.199896  7001 raft_consensus.cc:3055] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:51.156204  7212 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:51.197432  7217 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:51.200281  7001 raft_consensus.cc:740] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:51.204422  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:51.207520  3262 raft_consensus.cc:1275] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:51.208561  3340 raft_consensus.cc:2393] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 8: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:51.206135  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:51.173254  7284 raft_consensus.cc:2804] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:51.205459  7212 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:51.201610  7306 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:51.209573  3156 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:51.209939  3338 raft_consensus.cc:2393] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 12: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:51.221421  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:51.222867  3156 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:51.167681  7124 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.000s	sys 0.014s
I20260709 12:14:51.210570  7284 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.219720  7109 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.232244  7334 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:51.232156  7109 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:51.224828  7229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.986s	user 0.012s	sys 0.025s
W20260709 12:14:51.234262  7229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.999s	user 0.012s	sys 0.025s
I20260709 12:14:51.234443  7109 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:51.232167  7017 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 12:14:51.227907  7124 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.000s	sys 0.014s
I20260709 12:14:51.224195  7227 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:51.225329  7332 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:51.248766  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:51.235904  7284 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:51.264389  3157 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:51.257045  7070 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:51.259505  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:51.247694  6919 consensus_queue.cc:1048] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:14:51.262382  7326 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.267230  3333 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:51.264667  7128 consensus_queue.cc:1059] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:14:51.241348  7229 consensus_queue.cc:1048] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:14:51.274084  7017 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:51.288031  7227 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:14:51.239513  7314 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:14:51.265323  7294 consensus_queue.cc:1059] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:14:51.317776  3333 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:51.248253  7001 consensus_queue.cc:260] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.288206  7109 consensus_queue.cc:1048] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:14:51.283281  7288 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.352484  3333 raft_consensus.cc:1275] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:51.354882  3335 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:14:51.355370  3335 pending_rounds.cc:85] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 8
I20260709 12:14:51.355736  3335 pending_rounds.cc:107] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:14:51.356001  3335 raft_consensus.cc:2889] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:51.358196  3341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58564 (request call id 2450) took 2300 ms (client timeout 2217 ms). Trace:
I20260709 12:14:51.326964  7128 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:51.358668  3341 rpcz_store.cc:269] 0709 12:14:49.055780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.055983 (+   203us) service_pool.cc:224] Handling call
0709 12:14:51.354154 (+2298171us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54001d6fd4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5d12fa 00007f1af3592b17 00007f1aecb0d6d4 00007f1aecb0d662 00007f1aecb0d591 00007f1aecb0d50c 00007f1aecb0c7c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:51.355723 (+  1569us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1717927808}
I20260709 12:14:51.332351  7366 raft_consensus.cc:3055] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:14:51.344743  7361 log.cc:927] Time spent T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:14:51.362011  3337 raft_consensus.cc:1240] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:51.332943  7001 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:51.290761  7234 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:14:51.356158  7294 consensus_queue.cc:1243] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer eb49d92feeb14382b3baa49d696b6141 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:14:51.369160  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40120 (request call id 829) took 1270 ms. Trace:
I20260709 12:14:51.375201  3261 rpcz_store.cc:276] 0709 12:14:50.098982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.099088 (+   106us) service_pool.cc:224] Handling call
0709 12:14:50.117438 (+ 18350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.193917 (+ 76479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:50.193964 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:50.194023 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:50.194075 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.368916 (+1174841us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b54003d36d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:51.368967 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.369096 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175279488}
W20260709 12:14:51.366040  7299 log.cc:927] Time spent T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 1.049s	user 0.004s	sys 0.000s
W20260709 12:14:51.379169  7359 log.cc:927] Time spent T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:14:51.363618  7128 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.363114  7366 raft_consensus.cc:740] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:14:51.389678  7354 log.cc:927] Time spent T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:14:51.388538  7288 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:51.395095  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.396870  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:51.414337  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 148832us
I20260709 12:14:51.417126  3334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 1021) took 1237 ms. Trace:
I20260709 12:14:51.417452  3334 rpcz_store.cc:276] 0709 12:14:50.180209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.180500 (+   291us) service_pool.cc:224] Handling call
0709 12:14:50.180811 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:50.181042 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:50.181079 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:51.041448 (+860369us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b2c000e61b8. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aecec6a11 00007f1aeced6372 00007f1aee608a01 00007f1aee5cd43a 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2
0709 12:14:51.041873 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:14:51.166142 (+124269us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:51.166181 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.166267 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:51.414543 (+248276us) raft_consensus.cc:1685] finished
0709 12:14:51.414562 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.417056 (+  2494us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12246784,"thread_start_us":123923,"threads_started":1,"wal-append.queue_time_us":185661}
I20260709 12:14:51.411381  7326 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:51.428246  7128 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:51.414589  7366 consensus_queue.cc:260] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.429893  7366 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:51.440763  7266 consensus_queue.cc:1048] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:14:51.459403  7110 consensus_queue.cc:1059] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:51.460902  7110 raft_consensus.cc:3055] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:51.461405  7110 raft_consensus.cc:740] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:51.462497  7110 consensus_queue.cc:260] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:51.463515  7365 log.cc:927] Time spent T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:14:51.465425  7110 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:51.472193  7368 log.cc:927] Time spent T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:51.476888  7212 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.463147  7284 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.482522  7284 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:51.491614  7017 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:51.495759  7212 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:51.561951  7295 log.cc:927] Time spent T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 1.118s	user 0.000s	sys 0.005s
W20260709 12:14:51.562892  2017 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 3218)
I20260709 12:14:51.612016  7207 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:51.612233  3231 leader_election.cc:336] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:51.612625  7207 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:51.614039  3231 leader_election.cc:336] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:51.614663  3231 leader_election.cc:336] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:51.615226  3231 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:51.616004  3231 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:51.616536  3231 leader_election.cc:336] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:51.614684  7207 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:51.616914  3231 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:51.619592  7207 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:51.619741  3231 leader_election.cc:336] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:51.620357  3231 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:51.621150  7207 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:51.621313  3305 consensus_peers.cc:597] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.621516  3231 leader_election.cc:336] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:51.621727  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 594998us
W20260709 12:14:51.622217  3231 leader_election.cc:336] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:51.622402  3305 leader_election.cc:336] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:51.622658  3231 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:51.623420  7207 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:51.623551  3231 leader_election.cc:336] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:51.624436  3231 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:51.625031  3231 leader_election.cc:336] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:51.626403  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 457156us
W20260709 12:14:51.628644  3895 leader_election.cc:336] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:51.629745  3895 leader_election.cc:336] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:51.630605  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.634622  7306 raft_consensus.cc:3055] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:51.635039  7306 raft_consensus.cc:740] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
W20260709 12:14:51.630590  3895 leader_election.cc:336] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:51.635952  3895 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:51.635849  7306 consensus_queue.cc:260] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.638972  7268 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:51.656606  7296 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.658875  7084 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.658512  7296 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.659476  7084 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.661821  7084 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:51.665627  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.661959  7296 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:51.672825  3259 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:51.688019  7296 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:51.688786  7296 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.691150  7296 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:51.696979  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.722152  3339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45092 (request call id 2) took 3028 ms. Trace:
I20260709 12:14:51.727864  3339 rpcz_store.cc:276] 0709 12:14:48.693592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.693787 (+   195us) service_pool.cc:224] Handling call
0709 12:14:51.721943 (+3028156us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b540035f2d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5c7853 00007f1af359560a 00007f1aecb1b7d4 00007f1aecb1b762 00007f1aecb1b691 00007f1aecb1b60c 00007f1aecb1a8c2 00007f1aec90848c 00007f1aec9078c6 00007f1aec90726f
0709 12:14:51.722067 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3942482176}
I20260709 12:14:51.723389  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:51.730592  3266 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:51.426977  3157 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:51.735642  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 308709us
I20260709 12:14:51.737131  6866 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:51.738700  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:51.739882  7268 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.740449  7268 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.740068  7263 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.741747  3342 raft_consensus.cc:3055] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:51.742112  3342 raft_consensus.cc:740] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:51.742619  7268 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:51.744351  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:51.744905  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.745659  3923 raft_consensus.cc:2393] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 in current term 12: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:51.745709  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.746611  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.747310  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.742784  3342 consensus_queue.cc:260] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.748119  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.748601  3931 raft_consensus.cc:2368] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9.
I20260709 12:14:51.748624  3342 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:51.754043  3927 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:51.753259  7111 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:51.733222  7001 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:51.756062  7001 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.741781  7263 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.759603  3896 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:51.759932  7263 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:51.753538  7194 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:51.760396  6899 raft_consensus.cc:2804] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:51.760946  6899 raft_consensus.cc:697] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:51.761508  3929 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:14:51.761819  6899 consensus_queue.cc:237] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.762548  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.764119  3930 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:51.766620  6866 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.767112  6866 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.769356  3342 raft_consensus.cc:1275] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:14:51.769730  3342 pending_rounds.cc:85] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 7
I20260709 12:14:51.769950  3342 pending_rounds.cc:107] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:14:51.773694  3342 raft_consensus.cc:2889] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:51.774947  3930 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:14:51.776767  7325 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 12:14:51.779520  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.780702  7001 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:51.781970  3157 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:51.784970  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:51.787304  3335 raft_consensus.cc:1240] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:51.788486  7270 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:51.789047  7270 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.790792  7212 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.792341  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.791290  7113 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:51.796005  7113 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.798209  7113 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:51.801113  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.807928  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.810254  3157 leader_election.cc:400] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599) with higher term. Message: Invalid argument: T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9.
I20260709 12:14:51.811676  3157 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:51.812870  3266 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:51.814690  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.815469  3266 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 12.
W20260709 12:14:51.816597  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 193226us
I20260709 12:14:51.817211  3895 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:51.820209  3157 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:51.823597  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.791306  7212 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.791030  7270 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:51.831123  7263 consensus_queue.cc:1059] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:51.832175  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:51.839877  3339 raft_consensus.cc:3060] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:51.839465  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:51.838338  3266 raft_consensus.cc:1275] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:51.818953  7194 raft_consensus.cc:3060] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:51.822559  7253 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.822449  7109 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:51.863212  3339 raft_consensus.cc:2468] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 9.
I20260709 12:14:51.864707  3896 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:51.853195  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.839246  7371 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:51.840269  7335 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:51.869184  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:51.853612  7292 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:51.871218  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:51.864523  7315 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.861480  7113 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.875346  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:51.877132  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.876986  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:51.879228  3266 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:51.876978  7124 consensus_queue.cc:1059] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:14:51.875542  7268 raft_consensus.cc:3055] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:51.882201  7268 raft_consensus.cc:740] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:51.883268  7268 consensus_queue.cc:260] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.853672  7042 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:14:51.864748  7264 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:14:51.887861  7270 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:51.888263  7270 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:51.888600  7270 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:51.888885  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:51.889118  3930 raft_consensus.cc:1275] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:51.889326  3266 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 14.
I20260709 12:14:51.889432  3336 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:51.874462  7288 raft_consensus.cc:2764] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:14:51.870110  7326 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:51.893075  7326 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.862363  7193 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:14:51.895030  7326 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:51.868541  6965 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:51.870208  7224 raft_consensus.cc:2804] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:51.896404  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.872718  7335 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.856526  7332 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:14:51.884618  7268 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:51.866228  7253 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.877957  6866 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:51.905821  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:51.868908  7362 consensus_queue.cc:1048] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:14:51.908111  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.902830  7224 raft_consensus.cc:697] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:51.903086  7335 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:51.914826  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:51.915521  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.915995  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:51.916684  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.917166  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.910564  7213 consensus_queue.cc:1048] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:14:51.904791  6965 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.931699  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:51.932837  6965 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:51.895896  7315 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.937520  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.938136  3264 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 11.
I20260709 12:14:51.896389  7113 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.942454  7113 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:51.912451  7212 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:51.913599  7253 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:51.916002  7224 consensus_queue.cc:237] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:51.910336  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.949263  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:51.902825  3336 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 11.
I20260709 12:14:51.955005  3896 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:51.970737  3335 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:14:51.973263  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:51.976564  3335 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:14:51.954890  7194 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:51.965922  7326 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.996474  7326 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:51.998709  7326 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:51.961720  6965 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:51.999714  6965 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:52.001834  6965 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:52.005609  3341 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:52.020885  3340 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:52.024394  3334 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:52.026185  3340 raft_consensus.cc:1275] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:14:52.031039  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 155794us
I20260709 12:14:52.033095  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:52.155857  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:52.331665  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:52.563395  2017 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 3218)
W20260709 12:14:52.649592  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.634487  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:52.679652  3340 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
W20260709 12:14:52.685536  3335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.008s	sys 0.011s
W20260709 12:14:52.686022  3335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.008s	sys 0.011s
I20260709 12:14:52.703504  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2420) took 1031 ms. Trace:
I20260709 12:14:52.704119  3261 rpcz_store.cc:276] 0709 12:14:51.671776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.923688 (+251912us) service_pool.cc:224] Handling call
0709 12:14:51.924003 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.924332 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.924359 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:51.924793 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:14:52.022129 (+ 97336us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:52.022183 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.022273 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:52.703199 (+680926us) raft_consensus.cc:1685] finished
0709 12:14:52.703234 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.703402 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2018,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":96913,"threads_started":1,"wal-append.queue_time_us":776506}
W20260709 12:14:52.806792  3134 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.019s	sys 0.024s
W20260709 12:14:52.818589  3134 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.020s	sys 0.024s
I20260709 12:14:52.821209  7398 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:52.821847  7398 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:52.852002  3262 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:14:52.852807  3262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2421) took 1180 ms. Trace:
I20260709 12:14:52.853276  3262 rpcz_store.cc:276] 0709 12:14:51.672026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:52.851278 (+1179252us) service_pool.cc:224] Handling call
0709 12:14:52.851636 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:52.852514 (+   878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.852735 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:52.870858  3267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2424) took 1190 ms. Trace:
I20260709 12:14:52.874548  7397 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:52.871451  3267 rpcz_store.cc:276] 0709 12:14:51.680242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:52.838347 (+1158105us) service_pool.cc:224] Handling call
0709 12:14:52.838739 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:52.839085 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:52.839113 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:52.839630 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:14:52.870474 (+ 30844us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:52.870522 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.870599 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:52.870653 (+    54us) raft_consensus.cc:1685] finished
0709 12:14:52.870670 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.870797 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":30468,"threads_started":1,"wal-append.queue_time_us":27740}
I20260709 12:14:52.876649  7396 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:52.878793  3231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.886112  7398 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:52.892419  7398 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.893013  7398 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:52.889513  7396 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:52.889604  7397 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:52.901748  7397 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:52.902505  7397 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:52.902639  7398 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:52.903012  7397 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:52.903568  7398 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.904142  7398 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:52.906069  7396 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:52.903204  7268 consensus_meta.cc:287] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent flushing consensus metadata: real 0.997s	user 0.021s	sys 0.003s
I20260709 12:14:52.911171  7397 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:51.990103  7371 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:14:52.920521  7398 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:52.924412  7268 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:52.925103  7268 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:52.927306  7268 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:52.932930  3930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.019s	sys 0.007s
W20260709 12:14:52.933434  3930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.019s	sys 0.007s
I20260709 12:14:52.934209  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37962 (request call id 791) took 1011 ms. Trace:
I20260709 12:14:52.940109  3930 rpcz_store.cc:276] 0709 12:14:51.922352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.922509 (+   157us) service_pool.cc:224] Handling call
0709 12:14:51.922896 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.923245 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.923273 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:51.923758 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:14:52.933824 (+1010066us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:52.933870 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.933948 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:52.933996 (+    48us) raft_consensus.cc:1685] finished
0709 12:14:52.934009 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.934149 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1722,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":138,"thread_start_us":1009628,"threads_started":1,"wal-append.queue_time_us":823515}
W20260709 12:14:52.952257  3929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.015s	sys 0.008s
W20260709 12:14:52.952653  3929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.015s	sys 0.008s
I20260709 12:14:52.953397  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 977) took 1008 ms. Trace:
I20260709 12:14:52.953756  3929 rpcz_store.cc:276] 0709 12:14:51.944697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.946008 (+  1311us) service_pool.cc:224] Handling call
0709 12:14:51.957613 (+ 11605us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.967280 (+  9667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.967328 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:51.976290 (+  8962us) log.cc:844] Serialized 26 byte log entry
0709 12:14:52.953019 (+976729us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:52.953083 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.953158 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:52.953204 (+    46us) raft_consensus.cc:1685] finished
0709 12:14:52.953215 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.953340 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9519,"raft.queue_time_us":10221,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":11935,"thread_start_us":958007,"threads_started":1,"wal-append.queue_time_us":593442}
I20260709 12:14:51.965493  7335 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:52.971503  7335 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:51.988278  7198 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:52.977857  3341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2514) took 1003 ms. Trace:
I20260709 12:14:52.982074  3341 rpcz_store.cc:276] 0709 12:14:51.974593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.974752 (+   159us) service_pool.cc:224] Handling call
0709 12:14:51.975061 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:52.006058 (+ 30997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.977562 (+971504us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b54002a1554. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:52.977791 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69353216}
I20260709 12:14:52.980276  7198 raft_consensus.cc:697] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:52.984473  7198 consensus_queue.cc:237] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:52.994786  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 937860us
I20260709 12:14:53.002236  7292 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:53.004796  7332 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:53.005343  7292 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:53.005983  7292 consensus_queue.cc:1243] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer eb49d92feeb14382b3baa49d696b6141 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:53.006513  7332 consensus_queue.cc:1048] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:53.008510  7264 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.013089  7371 consensus_queue.cc:1059] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:53.009140  7264 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.017395  7264 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:53.018505  7264 raft_consensus.cc:3055] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:14:53.019061  7264 raft_consensus.cc:740] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:53.021718  7264 consensus_queue.cc:260] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.023147  7264 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:14:53.026773  3363 debug-util.cc:398] Leaking SignalData structure 0x7b080014ac20 after lost signal to thread 2020
I20260709 12:14:53.027763  7194 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:53.027995  3363 debug-util.cc:398] Leaking SignalData structure 0x7b0800112e20 after lost signal to thread 3125
W20260709 12:14:53.028604  3363 debug-util.cc:398] Leaking SignalData structure 0x7b080011daa0 after lost signal to thread 3217
I20260709 12:14:53.028334  7194 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:53.028892  3363 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0ee0 after lost signal to thread 3218
W20260709 12:14:53.029953  3363 debug-util.cc:398] Leaking SignalData structure 0x7b08003157e0 after lost signal to thread 3292
W20260709 12:14:53.030202  3363 debug-util.cc:398] Leaking SignalData structure 0x7b08003569e0 after lost signal to thread 3293
I20260709 12:14:51.976200  7294 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 1.055s
I20260709 12:14:53.030930  7194 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:53.032179  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 999119us
I20260709 12:14:53.032348  7294 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:53.033631  3305 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:53.034078  7332 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.034749  3305 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:53.036603  7213 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:14:53.034565  7332 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.037096  7213 raft_consensus.cc:697] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 14 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:53.038020  7386 raft_consensus.cc:2749] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:53.037943  7213 consensus_queue.cc:237] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.038681  7332 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:53.039748  7386 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.040184  7386 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.040524  7384 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.041179  7384 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.043898  3340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2526) took 1013 ms. Trace:
I20260709 12:14:53.044238  3340 rpcz_store.cc:276] 0709 12:14:52.030720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:52.708864 (+678144us) service_pool.cc:224] Handling call
0709 12:14:52.709200 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:52.709464 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:52.725538 (+ 16074us) log.cc:844] Serialized 14 byte log entry
0709 12:14:53.043578 (+318040us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:53.043626 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:53.043665 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.043743 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.043844 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317797,"prepare.queue_time_us":22300,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40}
I20260709 12:14:53.045812  7124 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:53.046324  7124 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:53.049690  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.048647  6965 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:53.051884  3157 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:53.053200  6735 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.053717  6735 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.055502  7386 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:53.055682  7267 raft_consensus.cc:2804] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:53.056026  6735 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:53.056151  7267 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.056697  7267 raft_consensus.cc:3060] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:53.056676  7294 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.060876  7294 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:53.061838  3338 raft_consensus.cc:3055] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:53.062233  3338 raft_consensus.cc:740] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:53.043322  7384 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:53.062978  3338 consensus_queue.cc:260] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.064525  3338 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.050606  3305 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:53.066453  6735 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:53.075119  3305 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:53.081178  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:53.066466  7124 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:53.084704  3339 pending_rounds.cc:85] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 6
I20260709 12:14:53.085052  3339 pending_rounds.cc:107] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:14:53.085340  3339 raft_consensus.cc:2889] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:53.087134  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.089737  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.090492  3335 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 12.
I20260709 12:14:53.091710  3157 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:53.091790  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.092671  3335 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:53.093973  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.093907  3157 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:53.097361  3156 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:53.098623  3156 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:53.083971  7385 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.083624  7384 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.102785  3305 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:53.105090  3337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52822 (request call id 1048) took 1274 ms. Trace:
I20260709 12:14:53.106120  3305 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:53.101070  7124 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:14:53.107899  3338 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:53.096402  7294 consensus_queue.cc:1048] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:14:53.106901  3337 rpcz_store.cc:276] 0709 12:14:51.829264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:52.847579 (+1018315us) service_pool.cc:224] Handling call
0709 12:14:52.847951 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:52.848166 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:52.848716 (+   550us) log.cc:844] Serialized 14 byte log entry
0709 12:14:53.103579 (+254863us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:53.103629 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:53.103670 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.103730 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.103832 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196581,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":202047,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":57992,"threads_started":1}
I20260709 12:14:53.133258  3342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2512) took 1160 ms. Trace:
I20260709 12:14:53.133920  3342 rpcz_store.cc:276] 0709 12:14:51.973078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.974363 (+  1285us) service_pool.cc:224] Handling call
0709 12:14:51.974763 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.975181 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.975220 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:51.976700 (+  1480us) log.cc:844] Serialized 26 byte log entry
0709 12:14:53.044339 (+1067639us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b1800247ea0. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4c2e07 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1aee16720b 00007f1aee16cd23 00007f1aee16d0d1 00007f1aee588a0f
0709 12:14:53.102885 (+ 58546us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:53.102927 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.103014 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:53.119559 (+ 16545us) raft_consensus.cc:1685] finished
0709 12:14:53.119589 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.133152 (+ 13563us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9519,"raft.queue_time_us":4747,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":3782,"spinlock_wait_cycles":3492608,"thread_start_us":58347,"threads_started":1,"wal-append.queue_time_us":1117914}
I20260709 12:14:53.136462  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.106861  7325 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:53.137383  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.139866  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.141670  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.142843  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.143992  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.145068  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.146167  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.146436  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.147140  3342 raft_consensus.cc:2393] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 12: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:53.115166  6735 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:53.147914  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.109558  7384 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:53.149549  3927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.191s	user 0.008s	sys 0.025s
W20260709 12:14:53.154759  3927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.197s	user 0.009s	sys 0.025s
I20260709 12:14:53.154899  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.153599  3342 raft_consensus.cc:2393] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:53.147161  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.157603  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 978) took 1210 ms. Trace:
I20260709 12:14:53.138862  7402 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:53.159307  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.160393  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.158041  3927 rpcz_store.cc:276] 0709 12:14:51.944973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.945453 (+   480us) service_pool.cc:224] Handling call
0709 12:14:51.945732 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.957287 (+ 11555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.957316 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:51.957850 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:14:53.155219 (+1197369us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:53.155258 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.155394 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:53.155459 (+    65us) raft_consensus.cc:1685] finished
0709 12:14:53.155471 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.155587 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14421,"raft.queue_time_us":12994,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":6823,"thread_start_us":1197041,"threads_started":1,"wal-append.queue_time_us":716064}
I20260709 12:14:53.153149  6735 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.161698  6735 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:53.163889  7159 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:53.164826  7159 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:53.166637  7159 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:53.167382  3340 raft_consensus.cc:2393] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:53.115358  7267 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.169915  6979 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:53.171341  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:53.173231  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 74639.4us
I20260709 12:14:53.173431  3342 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 11.
I20260709 12:14:53.175083  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.175729  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.176290  3340 raft_consensus.cc:2393] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 9: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:53.176846  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.177568  6979 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.179968  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.180132  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.186239  3342 raft_consensus.cc:1240] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:14:53.190812  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.192596  3340 raft_consensus.cc:1240] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Rejecting Update request from peer 1ef05c9d901046dca7fe0e638cc693b9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:14:53.197731  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:53.198514  3261 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:53.170680  7402 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.213464  3261 raft_consensus.cc:2468] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 13.
I20260709 12:14:53.203648  7207 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:53.232048  7207 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.235158  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:53.236311  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 48478.5us
I20260709 12:14:53.195917  7335 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:53.239398  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.205999  7402 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:53.246037  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:53.246605  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:53.246667  3267 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:53.247866  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:53.241698  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.248286  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:53.253631  3266 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 6.
I20260709 12:14:53.253652  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:53.255224  3268 raft_consensus.cc:2410] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:14:53.249115  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:53.256059  3264 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:14:53.249866  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.257665  3337 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 11.
I20260709 12:14:53.258015  3232 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:53.258515  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.259418  3232 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:53.247326  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:53.261032  3232 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:53.262667  3259 raft_consensus.cc:1240] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Rejecting Update request from peer eb49d92feeb14382b3baa49d696b6141 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:14:53.238230  7216 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:53.264094  3305 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:53.264998  3305 leader_election.cc:336] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:53.263242  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:53.265141  3232 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:53.265885  3305 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:53.266618  3305 leader_election.cc:336] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:53.267457  3305 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.265684  3263 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 12.
I20260709 12:14:53.270730  7001 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.270928  3232 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:53.271766  7396 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:53.272249  3232 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:53.273041  7396 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:53.278957  7001 raft_consensus.cc:2749] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.242151  6979 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:53.250975  7335 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.289964  7267 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:53.290688  7413 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:53.291050  7335 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:53.263090  7084 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.269728  7397 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:53.264911  7398 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:53.296713  7384 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:53.311010  7384 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.313362  7384 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:53.303922  7001 consensus_queue.cc:1059] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:14:53.314558  7213 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:53.315155  7213 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.316408  7001 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:53.317036  7001 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.317479  7213 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:53.283744  7216 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.319891  7325 raft_consensus.cc:493] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:53.320417  7325 raft_consensus.cc:515] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.321539  7216 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:53.322094  7306 raft_consensus.cc:3060] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.322544  7325 leader_election.cc:290] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:53.319744  7001 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:53.323112  7398 raft_consensus.cc:3055] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:14:53.323598  7398 raft_consensus.cc:740] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:53.324450  7398 consensus_queue.cc:260] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.325166  6735 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.300405  7207 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:53.358111  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 104992us
I20260709 12:14:53.362649  7084 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.309294  7397 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:53.325691  7398 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:53.355794  7325 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:53.372470  7325 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.373019  6735 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:53.374580  7325 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:53.377020  3895 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
W20260709 12:14:53.359164  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 90996.5us
I20260709 12:14:53.322088  7216 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:14:53.371766  3139 auto_rebalancer.cc:893] Removing replace marker failed: Replica eb49d92feeb14382b3baa49d696b6141 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:14:53.411386  3139 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:14:53.411499  3927 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:14:53.400058  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:53.414448  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 177472us
I20260709 12:14:53.367022  7397 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:53.406042  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.409376  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:53.410741  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:53.400979  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.415840  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:53.411921  3139 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 12:14:53.425334  3305 leader_election.cc:336] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:53.426381  3305 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:53.429786  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 52864.9us
I20260709 12:14:53.430056  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:53.433540  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.434216  3335 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:53.435927  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.413717  7362 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:53.437747  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.434476  3305 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:53.444089  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:53.437208  7263 raft_consensus.cc:2804] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:53.424377  7427 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.386742  7402 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.469964  7325 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:53.470618  7325 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.471350  7402 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:53.472909  7325 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:53.448170  7384 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:53.444209  7335 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:53.449119  7424 raft_consensus.cc:493] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:53.414731  7216 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.481912  7216 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:53.442173  7207 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.440248  7084 raft_consensus.cc:493] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:53.452782  7236 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.484405  7207 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.486282  7236 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.488143  7325 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:53.455935  7263 raft_consensus.cc:697] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
W20260709 12:14:53.454517  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 43966.2us
I20260709 12:14:53.489305  7263 consensus_queue.cc:237] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.441962  7362 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.492901  7362 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:53.467203  6965 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:53.466958  7427 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.496780  3930 raft_consensus.cc:1240] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:53.475461  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:53.477454  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:53.442829  3305 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:53.488214  7207 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:53.461154  7288 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:14:53.531510  7213 raft_consensus.cc:2804] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:53.532020  7213 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:53.532426  7213 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:53.535640  7124 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:53.536199  7124 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.538375  7124 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:53.504593  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.498850  7198 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:53.504267  7325 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.478744  7384 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:53.503050  3338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2523) took 1473 ms. Trace:
I20260709 12:14:53.504918  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:53.509487  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:53.499183  6965 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.524077  3334 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:14:53.524183  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 81409.2us
I20260709 12:14:53.437827  7423 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:14:53.564154  2017 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 3218)
I20260709 12:14:53.558270  7198 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.494372  7424 raft_consensus.cc:515] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.494107  7335 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.495654  7084 raft_consensus.cc:515] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.550132  3335 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:53.507381  7077 consensus_queue.cc:1059] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 12:14:53.595113  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 152783us
W20260709 12:14:53.548296  7270 consensus_meta.cc:287] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: Time spent flushing consensus metadata: real 1.659s	user 0.022s	sys 0.004s
W20260709 12:14:53.568414  3931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.579s	user 0.009s	sys 0.012s
W20260709 12:14:53.638621  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.739985  3342 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:53.741006  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:53.740648  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.741854  3340 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
I20260709 12:14:53.742022  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:53.743583  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 238761us
I20260709 12:14:53.744590  3157 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:53.748234  3896 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:53.567754  7427 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:53.757714  3268 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:14:53.764662  3931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.777s	user 0.009s	sys 0.026s
I20260709 12:14:53.765506  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55438 (request call id 979) took 1820 ms. Trace:
I20260709 12:14:53.740700  3338 rpcz_store.cc:276] 0709 12:14:52.029638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:52.029771 (+   133us) service_pool.cc:224] Handling call
0709 12:14:52.030101 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.108225 (+1078124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.502761 (+394536us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540038d1d4. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:53.502985 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2372438912}
I20260709 12:14:53.766057  3931 rpcz_store.cc:276] 0709 12:14:51.945232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.945341 (+   109us) service_pool.cc:224] Handling call
0709 12:14:51.946730 (+  1389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:51.953942 (+  7212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.953970 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:51.956187 (+  2217us) log.cc:844] Serialized 52 byte log entry
0709 12:14:53.765143 (+1808956us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:53.765192 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.765274 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:53.765312 (+    38us) raft_consensus.cc:1685] finished
0709 12:14:53.765327 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.765448 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6860,"raft.queue_time_us":10064,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":7674,"thread_start_us":1777030,"threads_started":1,"wal-append.queue_time_us":624734,"wal-append.run_cpu_time_us":8680,"wal-append.run_wall_time_us":1016560}
I20260709 12:14:53.770684  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:53.775684  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:53.776368  3260 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
I20260709 12:14:53.779016  7362 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:53.779695  7362 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.781673  7427 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:53.782174  7427 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:53.757576  7429 log.cc:927] Time spent T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:14:53.752424  7384 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.715015  7270 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.763741  7292 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:53.738811  7423 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.757324  7400 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:14:53.790011  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.756925  7288 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:53.658752  6866 raft_consensus.cc:493] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:53.796185  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.798137  3334 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 13.
I20260709 12:14:53.774107  7338 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:53.757705  7284 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:14:53.788561  7124 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:53.773348  7193 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:53.831933  3342 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:53.817088  3336 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:53.801163  7400 raft_consensus.cc:493] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:53.837076  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 95131.6us
I20260709 12:14:53.820459  7423 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:53.824359  7288 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:53.839035  7400 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:53.839665  7084 leader_election.cc:290] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:53.828425  6866 raft_consensus.cc:515] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.843984  7288 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.851528  7198 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:53.857333  7270 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:53.862589  7424 leader_election.cc:290] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:53.862807  7325 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:53.864394  7213 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.864902  6866 leader_election.cc:290] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:53.861222  7335 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:53.868623  7397 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.873376  7384 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:53.873797  7400 raft_consensus.cc:515] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:53.875092  7384 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:53.875733  7397 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:53.918923  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 91726.5us
I20260709 12:14:53.923286  3157 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:53.925595  3157 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:53.934624  3232 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:53.949169  3305 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 102 similar messages]
I20260709 12:14:53.954567  3338 raft_consensus.cc:1240] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:53.956811  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.960749  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:53.963227  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:53.986281  7213 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:53.991863  7084 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:53.992652  7084 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:53.993319  7084 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.875985  7400 leader_election.cc:290] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:53.999991  3337 raft_consensus.cc:1240] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:53.999409  7109 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:54.000955  7109 consensus_queue.cc:1243] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer eb49d92feeb14382b3baa49d696b6141 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:54.005092  3336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2506) took 2040 ms. Trace:
I20260709 12:14:54.005748  3336 rpcz_store.cc:276] 0709 12:14:51.964713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.965244 (+   531us) service_pool.cc:224] Handling call
0709 12:14:51.968187 (+  2943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.833726 (+1865539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.004393 (+170667us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54002a1054. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee536571 00007f1aee5cde01 00007f1aee5cc83e 00007f1af3591419 00007f1aecb08bd4 00007f1aecb08b62 00007f1aecb08a91 00007f1aecb08a0c 00007f1aecb07cc2 00007f1aec90848c 00007f1aec9078c6
0709 12:14:54.004819 (+   426us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4242490752}
I20260709 12:14:54.003368  7109 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:54.018415  7267 raft_consensus.cc:493] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.019266  7267 raft_consensus.cc:515] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.022177  7267 leader_election.cc:290] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:54.027467  7193 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:54.044519  7207 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:54.045895  7207 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:54.053030  7193 raft_consensus.cc:697] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:54.058527  7191 consensus_queue.cc:1059] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:54.067301  7191 raft_consensus.cc:3055] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:54.069082  7191 raft_consensus.cc:740] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:54.069716  6965 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:54.064132  7423 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.062574  3342 pending_rounds.cc:85] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141: Aborting all ops after (but not including) 5
I20260709 12:14:54.070787  7191 consensus_queue.cc:260] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:54.073012  7288 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:54.082916  3342 pending_rounds.cc:107] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:14:54.083884  3342 raft_consensus.cc:2889] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:54.085425  7288 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:54.088732  7296 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:54.089555  7296 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.054944  7193 consensus_queue.cc:237] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:54.096594  7338 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:54.096210  7296 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:54.097257  7338 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:54.100999  3336 raft_consensus.cc:1240] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:54.075027  7109 raft_consensus.cc:697] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 13 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:54.062053  7371 consensus_queue.cc:1059] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:54.093858  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:51.988674  7315 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
W20260709 12:14:54.105232  3234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.080722  7207 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:54.116442  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:54.101121  6965 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:54.125667  7191 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:54.123118  3305 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.142066  7423 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Requested vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:54.152417  7109 consensus_queue.cc:237] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:54.155869  7294 consensus_queue.cc:1059] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:54.157092  7294 raft_consensus.cc:3055] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:54.161716  7294 raft_consensus.cc:740] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:54.161923  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:54.163877  7111 raft_consensus.cc:3055] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:54.164407  7111 raft_consensus.cc:740] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:54.167055  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:54.169683  7084 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:54.170882  7236 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:54.171500  7371 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.165704  7111 consensus_queue.cc:260] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.138881  7338 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.180910  3260 raft_consensus.cc:1275] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:14:54.182974  6919 raft_consensus.cc:3055] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:54.183493  6919 raft_consensus.cc:740] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:54.185011  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:54.184799  6919 consensus_queue.cc:260] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:54.185286  7400 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:54.185863  3260 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:54.186388  6919 raft_consensus.cc:3060] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:54.186067  7400 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.188104  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:54.188910  3263 raft_consensus.cc:3060] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.190860  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:54.191579  3261 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
I20260709 12:14:54.197911  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.199615  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:54.199357  7371 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.200433  3333 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.201924  7362 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:54.202095  7371 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:54.203465  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:54.204946  3895 leader_election.cc:336] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.986s (SENT)
W20260709 12:14:54.208794  3363 debug-util.cc:398] Leaking SignalData structure 0x7b08000f3080 after lost signal to thread 3956
I20260709 12:14:54.208982  3259 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
W20260709 12:14:54.209345  3363 debug-util.cc:398] Leaking SignalData structure 0x7b08003e67a0 after lost signal to thread 3957
W20260709 12:14:54.210168  3363 debug-util.cc:398] Leaking SignalData structure 0x7b0800169c20 after lost signal to thread 7128
I20260709 12:14:54.211162  7111 raft_consensus.cc:3060] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:54.211971  7427 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:54.212864  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:54.211140  3363 debug-util.cc:398] Leaking SignalData structure 0x7b08000d37e0 after lost signal to thread 7266
I20260709 12:14:54.217005  3334 raft_consensus.cc:1275] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:14:54.217978  3363 debug-util.cc:398] Leaking SignalData structure 0x7b080035e220 after lost signal to thread 7366
W20260709 12:14:54.219616  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 53323.7us
I20260709 12:14:54.220880  7041 consensus_queue.cc:1059] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:54.221998  6866 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:14:54.222292  7292 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.222369  7416 raft_consensus.cc:3055] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:54.223012  7416 raft_consensus.cc:740] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:54.223070  7292 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.223981  6866 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.224380  7416 consensus_queue.cc:260] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:54.225597  7416 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:54.225636  7292 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:54.226444  6866 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:54.163122  7294 consensus_queue.cc:260] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:54.232748  7294 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:54.232887  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.234809  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.236537  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:54.237427  3268 raft_consensus.cc:3060] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:54.237628  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 154407us
I20260709 12:14:54.232920  3333 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 11.
I20260709 12:14:54.241568  7386 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:54.242980  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.243980  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.248826  3931 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:14:54.245751  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53307990662b42ecae5100eb9bdb80b6" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.247242  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:54.239347  3305 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:54.255409  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 50689.4us
I20260709 12:14:54.255280  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.258831  3263 raft_consensus.cc:2468] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:14:54.256628  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:54.266078  3268 raft_consensus.cc:2468] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:14:54.264249  3336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.274598  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:54.236582  3231 leader_election.cc:336] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.284875  3260 raft_consensus.cc:2468] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 13.
I20260709 12:14:54.289388  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:54.291028  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 51775.2us
W20260709 12:14:54.299886  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.302846  3231 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:54.308233  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.308421  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.308992  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.309856  3929 raft_consensus.cc:1240] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:54.312844  3088 catalog_manager.cc:5697] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 6 to 7, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 7 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.313915  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.309876  3924 raft_consensus.cc:2410] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ac63b674f204bc4805ab989f8c965d3 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:14:54.315754  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.316152  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.288380  6965 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:54.317770  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:54.318882  3305 leader_election.cc:336] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.319180  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:54.320380  3305 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.320525  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.321045  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.322173  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.315780  3333 raft_consensus.cc:1275] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:54.288332  3079 maintenance_manager.cc:643] P a718949aeb634dbb80222dbb0804b0c4: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 3.430s	user 0.176s	sys 0.060s Metrics: {"bytes_written":29175,"cfile_init":1,"dirs.queue_time_us":107274,"dirs.run_cpu_time_us":593,"dirs.run_wall_time_us":17921,"drs_written":1,"lbm_read_time_us":431,"lbm_reads_lt_1ms":4,"lbm_write_time_us":138299,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":1,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":63,"spinlock_wait_cycles":39296,"thread_start_us":112001,"threads_started":2,"wal-append.queue_time_us":12537}
I20260709 12:14:54.309873  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.320847  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:54.341678  7396 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:54.341882  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 105592us
I20260709 12:14:54.344621  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f904cee1d1e04a36bc93a9dcf405d9a8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.312878  7400 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:54.351735  7338 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:14:54.350800  3086 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34704 (request call id 183) took 10150 ms. Trace:
W20260709 12:14:54.354530  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.355821  3895 leader_election.cc:336] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.352890  3232 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:14:54.353502  3086 rpcz_store.cc:276] 0709 12:14:44.192326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.195663 (+  3337us) service_pool.cc:224] Handling call
0709 12:14:54.325030 (+10129367us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:48.416553 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:48.537570 (+121017us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:48.540639 (+  3069us) write_op.cc:435] Acquired schema lock
0709 12:14:48.543794 (+  3155us) tablet.cc:662] Decoding operations
0709 12:14:48.586222 (+ 42428us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:48.586285 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:48.586314 (+    29us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:14:48.688484 (+102170us) tablet.cc:701] Row locks acquired
0709 12:14:48.688504 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:14:48.706690 (+ 18186us) write_op.cc:270] Start()
0709 12:14:48.711392 (+  4702us) write_op.cc:276] Timestamp: P: 1783599288700620 usec, L: 0
0709 12:14:48.711451 (+    59us) op_driver.cc:348] REPLICATION: starting
0709 12:14:48.849202 (+137751us) log.cc:844] Serialized 7436 byte log entry
0709 12:14:49.653719 (+804517us) op_driver.cc:464] REPLICATION: finished
0709 12:14:50.249171 (+595452us) write_op.cc:301] APPLY: starting
0709 12:14:50.249264 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:50.249655 (+   391us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:50.249773 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:50.299894 (+ 50121us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:50.345070 (+ 45176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 12:14:50.345120 (+    50us) write_op.cc:312] APPLY: finished
0709 12:14:50.397357 (+ 52237us) log.cc:844] Serialized 132 byte log entry
0709 12:14:50.546989 (+149632us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:50.571868 (+ 24879us) write_op.cc:454] Released schema lock
0709 12:14:50.581438 (+  9570us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:50.635986 (+ 54548us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:50.638937 (+  2951us) write_op.cc:454] Released schema lock
0709 12:14:51.108253 (+469316us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b180026bd80. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4e03f3 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd 0000000000388634 0000000000388479 00007f1aeb4c383a
Metrics: {"mutex_wait_us":2298359,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":580649,"apply.run_cpu_time_us":20579,"apply.run_wall_time_us":369824,"num_ops":19,"prepare.queue_time_us":173311,"prepare.run_cpu_time_us":15879,"prepare.run_wall_time_us":681396,"raft.queue_time_us":331752,"raft.run_cpu_time_us":30371,"raft.run_wall_time_us":542423,"replication_time_us":890814,"spinlock_wait_cycles":14689152,"thread_start_us":759801,"threads_started":5,"wal-append.queue_time_us":504537,"wal-append.run_cpu_time_us":55250,"wal-append.run_wall_time_us":3949052}]]}
W20260709 12:14:54.362798  3231 leader_election.cc:336] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.377311  7309 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:54.377801  7309 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:54.378160  7309 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.384698  3231 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:54.387130  3930 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 LEADER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:14:54.375931  3232 leader_election.cc:304] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:54.370751  6965 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.396356  7396 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.401611  3080 maintenance_manager.cc:419] P a718949aeb634dbb80222dbb0804b0c4: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10579 bytes on disk
I20260709 12:14:54.405067  3079 maintenance_manager.cc:643] P a718949aeb634dbb80222dbb0804b0c4: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":589,"lbm_reads_lt_1ms":4}
I20260709 12:14:54.407929  7198 consensus_queue.cc:1048] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:14:54.408339  3896 leader_election.cc:304] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:54.409745  7451 log.cc:927] Time spent T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.057s	user 0.001s	sys 0.001s
I20260709 12:14:54.410791  7198 raft_consensus.cc:2804] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:54.412156  7084 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:54.413982  3339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58564 (request call id 2530) took 1329 ms. Trace:
I20260709 12:14:54.414379  3339 rpcz_store.cc:276] 0709 12:14:53.084095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.084222 (+   127us) service_pool.cc:224] Handling call
0709 12:14:53.084521 (+   299us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:53.085915 (+  1394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:53.085943 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:53.086369 (+   426us) log.cc:844] Serialized 52 byte log entry
0709 12:14:53.488143 (+401774us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b4800201558. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af34f6aa1 00007f1af34edb37 00007f1af34ed9ca 00007f1af35e526f 00007f1af35e4f37 00007f1af35f955c 00007f1af35f9508 00007f1af35f9488 00007f1af35f9443 00007f1af35f86ec 00007f1af2522a96
0709 12:14:54.149489 (+661346us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b1800308f80. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb4c2e07 00007f1af431d9a9 00007f1aeb4df69b 00007f1aeb4dd93f 00007f1aeb4dfc02 00007f1aee16720b 00007f1aee16cd23 00007f1aee16d0d1 00007f1aee588a0f
0709 12:14:54.297303 (+147814us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:54.297681 (+   378us) log.cc:844] Serialized 14 byte log entry
0709 12:14:54.297979 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.298164 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:54.408986 (+110822us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b4400022b4c. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aeb368db1 00007f1aeb406c85 00007f1aeb4076a2 00007f1aee1791db 00007f1aee174aaf 00007f1aee16886e 00007f1aee167bb6 00007f1aee1677d8 00007f1aee171221 00007f1aee1711d9 00007f1aee171169
0709 12:14:54.413664 (+  4678us) raft_consensus.cc:1685] finished
0709 12:14:54.413684 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:54.413817 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":766,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":1001,"raft.run_cpu_time_us":2292,"raft.run_wall_time_us":399538,"spinlock_wait_cycles":32841472,"thread_start_us":102272,"threads_started":1,"wal-append.queue_time_us":1260138}
W20260709 12:14:54.418380  7454 log.cc:927] Time spent T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:14:54.420437  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 71603.8us
I20260709 12:14:54.430480  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.420466  7198 raft_consensus.cc:697] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:54.438648  7309 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.432740  3088 catalog_manager.cc:5697] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 7 to 8, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 8 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.444767  3088 catalog_manager.cc:5697] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 8 to 9, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 9 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
W20260709 12:14:54.435653  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 115316us
W20260709 12:14:54.436335  7450 log.cc:927] Time spent T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:14:54.446930  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 89937.5us
I20260709 12:14:54.439544  7198 consensus_queue.cc:237] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:54.433823  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 58019.1us
I20260709 12:14:54.440737  7268 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:54.435079  7084 raft_consensus.cc:2749] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.445533  6919 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.458215  7371 consensus_queue.cc:1059] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:54.459180  7371 raft_consensus.cc:3055] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:54.459360  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.460402  3339 raft_consensus.cc:2393] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 14: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:54.459640  7371 raft_consensus.cc:740] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:54.463380  7371 consensus_queue.cc:260] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.464732  7371 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:54.469056  7309 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:54.474324  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:54.475731  7191 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.475625  6919 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:54.477952  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:54.478416  6919 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:54.481246  3157 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:54.456645  3088 catalog_manager.cc:5697] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 6 to 8, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 8 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:54.479051  7191 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:54.484207  3305 leader_election.cc:336] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.484546  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.484748  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:54.485608  6965 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.485738  6919 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:54.486217  3305 leader_election.cc:336] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:54.487367  3305 leader_election.cc:336] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.515888  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
W20260709 12:14:54.522416  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.529760  3088 catalog_manager.cc:5697] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 5 to 7, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 7 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.553061  3339 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:14:54.531633  7371 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.560786  3088 catalog_manager.cc:5697] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 5 to 9, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 9 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:54.578564  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.593515  3259 raft_consensus.cc:1240] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:14:54.593715  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 106388us
I20260709 12:14:54.574355  7264 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:14:54.588672  3088 catalog_manager.cc:5697] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 8 to 9, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 9 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:54.579021  7371 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:54.612355  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.618610  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.624593  7288 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.625128  7288 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:54.622974  3305 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.630363  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:54.634474  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.629550  3088 catalog_manager.cc:5697] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 10 to 12, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 12 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:54.642689  3305 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.627377  7288 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:54.643218  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:54.646795  3305 leader_election.cc:336] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:54.647948  3305 leader_election.cc:336] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.648437  3305 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:54.655953  7212 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:14:54.656406  3305 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:54.657172  3305 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.644069  6965 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.680747  3259 raft_consensus.cc:1240] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:54.667241  3088 catalog_manager.cc:5697] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:54.669114  3895 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:54.690371  7124 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:54.691180  7124 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.691824  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.702296  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:54.703780  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9796736c241b42c283a7f6a433742bed" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:54.704399  3266 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:54.704994  3261 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:54.705926  3259 raft_consensus.cc:1275] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:54.706393  3262 raft_consensus.cc:1240] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:14:54.707042  7400 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.699288  7084 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:54.708056  7084 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.708683  7284 consensus_queue.cc:1048] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:14:54.714143  3307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.715204  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.715678  2017 thread.cc:527] Waited for 8000ms trying to join with heartbeat (tid 3218)
I20260709 12:14:54.728178  3339 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:14:54.737901  7309 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:54.738574  7309 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.740649  7309 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:54.741766  3924 consensus_queue.cc:237] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.744861  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.741993  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:54.745484  7253 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.746049  7253 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:54.748405  3268 raft_consensus.cc:1240] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Rejecting Update request from peer 6f0cdd57c5934921829c205d32b2b8a5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:54.751977  7253 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:54.752807  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49089e729c0f4f37b66d40abf2e3cfe6" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:54.754236  3262 raft_consensus.cc:3060] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.756155  7084 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:54.753103  3259 raft_consensus.cc:1275] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:14:54.753121  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:54.760596  3267 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 14.
I20260709 12:14:54.764169  7124 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:54.768783  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.769589  7113 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:54.773653  3342 raft_consensus.cc:1240] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:54.775676  3262 raft_consensus.cc:2468] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 11.
I20260709 12:14:54.776757  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.778825  7111 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:54.779585  7294 consensus_queue.cc:1059] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:54.783991  7111 raft_consensus.cc:3055] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:54.784472  7111 raft_consensus.cc:740] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:54.785501  7111 consensus_queue.cc:260] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:54.786856  7111 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:54.769940  7465 log.cc:927] Time spent T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:14:54.791522  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:54.792673  3264 raft_consensus.cc:1240] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:54.793773  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:54.794471  3267 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:54.809283  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:54.811273  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:54.812793  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.801558  3088 catalog_manager.cc:5697] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 5 to 7, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 7 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.812788  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:54.835598  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 177375us
I20260709 12:14:54.837105  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:54.840770  3259 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:54.862208  7198 consensus_queue.cc:1048] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:54.863420  3895 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:54.853554  3088 catalog_manager.cc:5697] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 3 to 9, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 9 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:54.868548  3305 leader_election.cc:336] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.879377  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:54.880147  3267 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:14:54.880374  3895 leader_election.cc:336] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:54.880009  3305 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:54.847474  7268 consensus_queue.cc:1059] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:14:54.884001  7268 consensus_queue.cc:1243] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:14:54.884559  7268 raft_consensus.cc:3055] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:54.900740  3263 raft_consensus.cc:1240] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:54.903616  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.904217  3259 raft_consensus.cc:1240] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:54.905951  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.893596  7198 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:14:54.923817  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.893460  7268 raft_consensus.cc:740] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:14:54.898414  7113 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:54.928618  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:54.929366  3263 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.932005  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.933734  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.947105  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:54.950492  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.952291  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.953125  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:54.954803  3333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a33bf1d7b914771971f31da16c86c31" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.927574  7198 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:14:54.957167  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9471f19ecb64571bc899936c896d99f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.964612  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.979851  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.982167  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:54.956911  7198 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:54.987534  3267 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 13.
I20260709 12:14:54.991926  3339 raft_consensus.cc:2393] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 7: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:54.964668  7253 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:54.975801  7464 log.cc:927] Time spent T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:14:55.003136  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e285af011d44cfc91bcd6499aa4c9f8" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:55.006670  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:55.015178  3259 raft_consensus.cc:1240] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:55.004675  7268 consensus_queue.cc:260] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:55.018751  3088 catalog_manager.cc:5697] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 6 to 8, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 8 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.019735  7371 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:55.020680  3088 catalog_manager.cc:5697] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 6 to 8, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 8 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.026666  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:55.022917  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8939008df61a42b5ab6d01a5cc782e16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:55.032389  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a56ad7de6f43239e103edd8e2b159f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:55.033562  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a639dfba9c4cd98fcc0e73a3de49f9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:55.034601  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:55.042552  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:55.021905  7468 log.cc:927] Time spent T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:14:55.059854  3088 catalog_manager.cc:5697] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 7 to 8, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 8 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:55.061429  7467 log.cc:927] Time spent T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:14:55.062677  3088 catalog_manager.cc:5697] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 reported cstate change: term changed from 5 to 6, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 6 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:55.072209  7470 log.cc:927] Time spent T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:14:55.084324  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 74507.3us
I20260709 12:14:55.016042  3264 raft_consensus.cc:1240] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:55.111558  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:55.114606  3335 raft_consensus.cc:2393] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 9: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:14:55.130013  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.130467  3263 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:55.141567  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:55.142995  3305 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:55.144052  7386 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:55.144510  7386 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:55.144891  7386 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:55.147552  3267 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:14:55.154350  7198 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:55.155675  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.158975  7113 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:55.161072  7475 log.cc:927] Time spent T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:14:55.166393  7386 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:55.169902  7386 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:55.170230  7268 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:55.161199  3305 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:55.159233  7472 log.cc:927] Time spent T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.143s	user 0.003s	sys 0.000s
W20260709 12:14:55.174888  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:55.180279  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.177346  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:55.178640  7386 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:55.194806  3305 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:55.204495  7474 log.cc:927] Time spent T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:14:55.210103  7322 raft_consensus.cc:493] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:55.211824  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:55.211944  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:55.212836  3263 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 14.
I20260709 12:14:55.213673  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:55.210798  7322 raft_consensus.cc:515] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:55.202696  7198 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:55.230955  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 134474us
I20260709 12:14:55.232200  3305 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:55.233306  7124 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.234227  7124 consensus_queue.cc:1048] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:55.235669  7113 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:55.236085  7113 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:55.236462  7113 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.238420  7111 raft_consensus.cc:493] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.239156  7111 raft_consensus.cc:515] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:55.240640  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:55.241469  3339 raft_consensus.cc:2393] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 14: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:55.241545  7111 leader_election.cc:290] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:55.243345  3342 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:14:55.227741  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 214353us
I20260709 12:14:55.253990  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:55.264456  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:55.265630  3267 raft_consensus.cc:2393] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 9: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:55.280733  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:55.281415  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:55.293105  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:55.294018  3267 raft_consensus.cc:2468] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 14.
I20260709 12:14:55.306723  3260 raft_consensus.cc:1275] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:55.313256  3259 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:14:55.321413  3266 raft_consensus.cc:1275] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:55.319715  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee459e79aec45909d356d039c69e72c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:55.325773  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 49278.7us
W20260709 12:14:55.328493  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 51486.3us
W20260709 12:14:55.329759  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:55.332988  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.358909  7113 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:55.359465  7322 leader_election.cc:290] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:55.361155  7113 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:55.361326  7294 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.362427  3334 raft_consensus.cc:1240] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:55.352229  3305 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:55.363804  3305 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:55.364439  7166 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:14:55.365096  3305 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:55.362041  7294 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:55.332455  7124 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:55.376294  3263 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 14.
W20260709 12:14:55.382609  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.374984  7212 raft_consensus.cc:2804] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:55.370633  7109 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.378311  7113 raft_consensus.cc:2804] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:55.374814  7124 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:55.408125  7109 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:55.404611  7124 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:55.443657  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 78682us
W20260709 12:14:55.456964  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.458359  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:55.421010  7386 raft_consensus.cc:2804] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:55.455165  7212 raft_consensus.cc:697] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:14:55.484942  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 94311.2us
I20260709 12:14:55.489786  7113 raft_consensus.cc:697] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
W20260709 12:14:55.542294  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 83031.8us
W20260709 12:14:55.544011  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 51132.9us
I20260709 12:14:55.552714  7113 consensus_queue.cc:237] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:55.558194  3895 leader_election.cc:336] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:55.586915  7484 log.cc:927] Time spent T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:14:55.590312  7212 consensus_queue.cc:237] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:55.582881  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:55.593742  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:55.601178  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 52519.9us
I20260709 12:14:55.602070  7109 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:55.602625  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:55.580396  7294 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:55.607136  7371 consensus_queue.cc:1059] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:55.593823  7124 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:55.603209  3895 leader_election.cc:336] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.614420  3895 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:55.593952  7482 log.cc:927] Time spent T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 12:14:55.630059  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 139894us
W20260709 12:14:55.632586  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.621908  7338 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.638433  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7af9c2d6334c6f84aed4586a66d701" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:55.636401  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 189710us
I20260709 12:14:55.641558  3305 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:55.642385  7504 raft_consensus.cc:493] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.643519  7504 raft_consensus.cc:515] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:55.645699  7504 leader_election.cc:290] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:55.647815  7371 raft_consensus.cc:493] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.648878  7371 raft_consensus.cc:515] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:55.649317  7124 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:55.651252  7371 leader_election.cc:290] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:55.657786  7481 log.cc:927] Time spent T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.237s	user 0.002s	sys 0.000s
I20260709 12:14:55.660681  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:55.661079  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:55.664067  7501 raft_consensus.cc:493] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.664721  7501 raft_consensus.cc:515] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:55.666326  7111 raft_consensus.cc:3055] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:55.666719  7111 raft_consensus.cc:740] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:55.668561  3305 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:55.652604  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.674278  3895 leader_election.cc:336] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:55.676946  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 135170us
I20260709 12:14:55.686094  7253 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.686664  7253 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:55.686734  7111 consensus_queue.cc:260] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:55.688431  7111 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.688774  7253 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:55.692345  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.699348  7497 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:14:55.705121  3895 leader_election.cc:336] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.705652  3895 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:55.711319  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.716187  7505 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:55.716199  2017 thread.cc:527] Waited for 9000ms trying to join with heartbeat (tid 3218)
I20260709 12:14:55.716631  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:55.672966  7386 raft_consensus.cc:697] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 13 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:55.699868  7497 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.723336  3342 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
W20260709 12:14:55.730345  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 122747us
I20260709 12:14:55.731488  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21406a1677884f049da5c65f8f2ed5ff" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:55.733317  3339 raft_consensus.cc:1240] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:55.706216  7500 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:55.734831  3232 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.529s (SENT)
W20260709 12:14:55.735642  3232 leader_election.cc:336] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.579s (SENT)
I20260709 12:14:55.736059  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:55.740630  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.729449  7497 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:14:55.729480  7191 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:55.746789  3895 leader_election.cc:336] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.748459  3335 raft_consensus.cc:1240] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Rejecting Update request from peer 7ac63b674f204bc4805ab989f8c965d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:55.751112  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:55.751173  7396 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:55.753798  7501 leader_election.cc:290] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:55.752820  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:55.755348  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:55.753191  7191 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:55.759369  3232 leader_election.cc:336] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Timed out: RequestConsensusVote RPC to 127.1.248.67:35301 timed out after 1.622s (SENT)
I20260709 12:14:55.762008  3232 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:55.761406  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:55.762804  3895 leader_election.cc:336] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.763265  3895 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:55.768026  7396 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.770115  7500 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:55.771636  3232 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:55.771760  7500 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:55.772953  3232 leader_election.cc:304] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:55.773782  7309 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.774326  3232 leader_election.cc:304] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:55.774573  7309 raft_consensus.cc:2749] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:55.775341  7309 raft_consensus.cc:2749] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.775815  7500 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:55.777127  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:55.761555  7191 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:55.781740  7386 consensus_queue.cc:237] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:55.798745  3232 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:55.809170  3156 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:55.810200  7191 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:55.811864  7191 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:55.812017  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:55.813301  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:55.813454  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:55.837967  3157 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:55.792347  7488 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:55.841007  7309 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:55.845986  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 83216.1us
W20260709 12:14:55.848655  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 56665.6us
I20260709 12:14:55.849659  3232 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:55.849534  7309 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:55.847102  3895 leader_election.cc:336] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.852497  3895 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:55.837610  7322 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:55.853722  3157 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:55.858135  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 88524.8us
W20260709 12:14:55.858596  3895 leader_election.cc:336] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.859045  3895 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:55.861600  3157 leader_election.cc:304] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:55.863633  3305 leader_election.cc:336] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.854216  7253 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:55.839507  7497 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:55.852926  7501 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:14:55.872148  7263 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.879079  3156 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:55.866310  7371 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:55.880338  7396 raft_consensus.cc:2749] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:14:55.871299  7502 raft_consensus.cc:2749] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:14:55.885788  3895 leader_election.cc:336] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.886597  3895 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:55.887830  7402 consensus_queue.cc:1048] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:14:55.888197  7400 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.883709  7109 consensus_queue.cc:1059] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:14:55.891567  7309 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:55.892630  7501 raft_consensus.cc:3055] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:55.893046  7501 raft_consensus.cc:740] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:55.893916  7501 consensus_queue.cc:260] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:55.875387  7504 consensus_queue.cc:1059] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:14:55.883416  7505 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:55.883335  7371 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.908468  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:55.910225  3923 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:14:55.900080  3305 leader_election.cc:336] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.910998  3305 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:55.904115  7402 raft_consensus.cc:3055] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:55.916028  7402 raft_consensus.cc:740] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:55.903621  7508 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:55.905261  7371 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.916932  7402 consensus_queue.cc:260] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:55.918130  7402 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:55.919739  7508 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:55.920414  3305 leader_election.cc:336] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.920302  7508 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:55.921381  3305 leader_election.cc:336] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:55.922302  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:55.922816  3305 leader_election.cc:336] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.913901  7253 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.923947  7500 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.923107  7508 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:55.923928  7253 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:55.928781  7253 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:55.895390  7501 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:55.931172  3305 leader_election.cc:336] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.932410  3923 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 15.
I20260709 12:14:55.934335  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214d209d2c0940c1a4c43e368fff9e23" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:55.896786  7497 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:55.934926  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:55.936163  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1a64c911894ce08c1622f9307ed513" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:55.936400  3306 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:55.936745  3266 raft_consensus.cc:3060] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:14:55.937222  7497 raft_consensus.cc:2804] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:14:55.937690  7497 raft_consensus.cc:697] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 15 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:55.938558  7497 consensus_queue.cc:237] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:55.919775  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 70253.4us
I20260709 12:14:55.942124  3232 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:55.951036  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:55.959913  3266 raft_consensus.cc:2468] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 15.
I20260709 12:14:55.974964  3262 raft_consensus.cc:1275] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:14:55.974545  3305 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.976735  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:55.976697  3895 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:55.984958  7166 raft_consensus.cc:2764] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:14:55.967803  7198 consensus_queue.cc:1048] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 12:14:55.989135  3305 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.989575  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:55.961550  7500 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:55.993544  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 52028us
I20260709 12:14:55.994328  3232 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:55.979249  7396 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:55.995775  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 111462us
I20260709 12:14:55.997576  7509 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:14:55.996397  3305 leader_election.cc:336] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:55.974320  7400 consensus_queue.cc:1048] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:14:56.000471  7524 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:55.992552  7386 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:56.001748  3232 leader_election.cc:304] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:56.002676  3305 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:56.003541  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.010118  3157 leader_election.cc:304] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.013849  7526 raft_consensus.cc:2749] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:56.015583  7524 raft_consensus.cc:2749] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:56.016501  7371 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:56.017655  3232 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.018539  3232 leader_election.cc:304] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.019636  7322 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:56.020375  7322 raft_consensus.cc:2749] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:56.009251  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:56.022841  3305 leader_election.cc:336] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:56.023259  3305 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:56.028589  3305 leader_election.cc:336] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:56.029280  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:56.036149  3305 leader_election.cc:336] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:56.041046  7509 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:56.039738  7500 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:14:56.055727  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 176762us
I20260709 12:14:56.061517  3156 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.070935  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:56.071596  3337 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:56.072501  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.072888  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:56.080765  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:56.073496  3924 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 12.
I20260709 12:14:56.070302  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:56.023319  7371 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:56.079406  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:56.087034  3157 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:56.087321  7253 raft_consensus.cc:493] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.087817  7526 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:56.088081  7508 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:56.027772  7386 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:14:56.089522  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.058446  7493 consensus_queue.cc:1048] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:14:56.081193  7500 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:56.092607  7508 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.087925  7253 raft_consensus.cc:515] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:56.107710  7508 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:56.105032  7500 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:56.127969  7500 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:56.131067  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:56.131953  3924 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 12.
I20260709 12:14:56.135720  3306 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:56.136670  7493 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:56.137049  7493 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:56.137414  7493 raft_consensus.cc:3060] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:56.204993  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.227726  7527 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
W20260709 12:14:56.228197  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 98665us
I20260709 12:14:56.228513  7527 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:56.230537  7504 consensus_queue.cc:1059] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:56.230932  7527 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:56.144572  7524 raft_consensus.cc:493] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.231632  7504 raft_consensus.cc:3055] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:56.232040  7504 raft_consensus.cc:740] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:56.231802  7524 raft_consensus.cc:515] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:56.234349  3337 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
W20260709 12:14:56.241631  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.243734  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 162679us
I20260709 12:14:56.247105  3157 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:56.256008  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:56.256855  3261 raft_consensus.cc:2393] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 12: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:56.270010  3156 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.275319  3156 leader_election.cc:304] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:56.258074  7527 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:56.280435  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:56.283823  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:56.266199  7526 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.289176  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff9b5ea5944e51914ded65407b153b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:56.291118  3156 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:56.304579  7253 leader_election.cc:290] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:56.251636  7504 consensus_queue.cc:260] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:56.294415  7294 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:56.293705  7396 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:56.297271  7416 raft_consensus.cc:2749] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:56.308082  7322 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:56.290252  7526 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:56.340498  3261 raft_consensus.cc:1275] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:56.335788  7396 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:56.344129  7526 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:56.336750  7191 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:56.365942  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 74943.9us
I20260709 12:14:56.367671  3156 leader_election.cc:304] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:14:56.371995  7528 log.cc:927] Time spent T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:14:56.339986  7322 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:56.334730  7493 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:56.405680  7322 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:56.377493  7396 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:56.375120  7508 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:56.378242  7524 leader_election.cc:290] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:56.408201  7508 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:56.379755  7529 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 12:14:56.399463  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.400281  3260 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 15 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:14:56.405759  7493 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:56.425765  7508 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.426340  7508 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:56.428561  7508 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:56.435858  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:56.391762  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 96541.4us
I20260709 12:14:56.412633  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:56.364061  7527 raft_consensus.cc:697] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:56.419613  7212 consensus_queue.cc:1048] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:56.439316  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 113748us
I20260709 12:14:56.444084  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:56.447192  3157 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:56.447410  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.447961  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:56.447041  3338 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:56.431267  7191 raft_consensus.cc:493] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:56.462734  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7482671d98f47899c1d11f810abadb7" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:56.450439  7509 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:14:56.457386  7515 log.cc:927] Time spent T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:14:56.467993  3260 raft_consensus.cc:2393] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 12: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:56.473824  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:56.481572  7542 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:56.481045  7338 raft_consensus.cc:2955] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:56.482863  3928 raft_consensus.cc:2393] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 12: Already voted for candidate 6f0cdd57c5934921829c205d32b2b8a5 in this term.
I20260709 12:14:56.471477  7191 raft_consensus.cc:515] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:56.490959  7191 leader_election.cc:290] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:56.491559  3264 raft_consensus.cc:1275] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:14:56.493780  3924 raft_consensus.cc:2468] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 12.
I20260709 12:14:56.493513  7527 consensus_queue.cc:237] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:56.508383  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 56015.4us
W20260709 12:14:56.516284  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 62536.7us
W20260709 12:14:56.517571  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 149982us
I20260709 12:14:56.522265  3157 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:56.535725  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 70438.7us
I20260709 12:14:56.535567  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:56.543094  3338 raft_consensus.cc:2393] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 11: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:14:56.544618  3231 leader_election.cc:336] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.525s (SENT)
I20260709 12:14:56.545176  3231 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:56.549345  3231 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.529s (SENT)
I20260709 12:14:56.549898  3231 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.548337  7544 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:56.551083  7544 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.551466  7544 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.551795  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:56.555951  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:56.559082  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 47687.8us
I20260709 12:14:56.514425  7542 raft_consensus.cc:2749] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:56.559537  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:56.574365  3305 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:56.585407  3305 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:56.576459  7322 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:56.567606  7396 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:14:56.549650  7500 consensus_queue.cc:1048] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:14:56.574406  7253 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.629292  3306 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:14:56.583810  7191 consensus_queue.cc:1059] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 12:14:56.654659  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.655280  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 45705.1us
I20260709 12:14:56.628216  3260 raft_consensus.cc:2955] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:56.670840  3925 raft_consensus.cc:1275] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 15 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:14:56.671972  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:56.672835  3924 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:56.674597  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b974e8909e0b47e2bd4e0d28fbafe975" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:56.678181  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.658906  7541 raft_consensus.cc:2804] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:14:56.689345  3157 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.697563  3157 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.625579  7253 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:56.671732  7338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37050 (request call id 0) took 1901 ms. Trace:
I20260709 12:14:56.702304  7253 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:56.703115  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb103e3ac0ca481bace4eb01f0725ae8" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:56.687829  7541 raft_consensus.cc:697] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 12 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:14:56.699697  3156 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.708341  7541 consensus_queue.cc:237] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:56.709759  3156 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:56.710512  7526 raft_consensus.cc:2804] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:14:56.710911  7526 raft_consensus.cc:493] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.711279  7526 raft_consensus.cc:3060] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:14:56.711668  7502 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:56.713585  7416 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:56.715306  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:56.715644  3157 leader_election.cc:304] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.701514  7540 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:56.719147  7545 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 12:14:56.723475  2017 thread.cc:527] Waited for 10000ms trying to join with heartbeat (tid 3218)
I20260709 12:14:56.725212  7504 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:56.728745  7542 raft_consensus.cc:3055] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:56.729166  7542 raft_consensus.cc:740] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:56.729919  7542 consensus_queue.cc:260] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:56.732697  7546 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:56.733397  7546 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:56.687372  7544 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:56.734448  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85f3b72388e43eb9b3f81e8f5ba7385" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:56.735762  7544 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:56.736480  7253 raft_consensus.cc:2749] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:56.738240  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:56.739494  3337 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.701525  7338 rpcz_store.cc:276] 0709 12:14:54.739521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.739641 (+   120us) service_pool.cc:224] Handling call
0709 12:14:54.797055 (+ 57414us) log.cc:844] Serialized 494 byte log entry
0709 12:14:55.078258 (+281203us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b180034d560. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb45ac0a 00007f1af4b9a219 00007f1aeb4e2a40 00007f1aeb4dd4e4 00007f1aeb4dd455 00007f1aee526b0b 00007f1aee5abb63 00007f1aee5d3752 00007f1aee5cb9fa
0709 12:14:55.224297 (+146039us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b180034d560. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1af43a8ab1 00007f1af43b5281 00007f1aeb45ac0a 00007f1af4b9a219 00007f1af24a158f 00007f1aeb4e0571 00007f1aeb4e27c1 00007f1aeb4e2779 00007f1aeb4e2709 00007f1aeb4e26d1 00007f1aeb4e19cd
0709 12:14:56.631481 (+1407184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178166,"raft.queue_time_us":89196,"raft.run_cpu_time_us":1402,"raft.run_wall_time_us":57847,"spinlock_wait_cycles":37067008,"thread_start_us":154974,"threads_started":1,"wal-append.queue_time_us":271585,"wal-append.run_cpu_time_us":8351,"wal-append.run_wall_time_us":1121524}
I20260709 12:14:56.696236  7493 consensus_queue.cc:1048] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:14:56.736382  3157 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.745024  7109 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:56.746428  3076 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a85351bf981e43bea61620452a2c7b3a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:56.749668  3337 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:56.751910  3924 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 13.
I20260709 12:14:56.753145  3157 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:56.754977  3157 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:56.731242  7542 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:56.758273  7502 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:56.764031  7502 raft_consensus.cc:697] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 13 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:56.764890  7502 consensus_queue.cc:237] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:56.758029  7253 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:56.766214  7253 raft_consensus.cc:697] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:56.767678  7546 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:56.767521  7253 consensus_queue.cc:237] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:56.775307  7555 log.cc:927] Time spent T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.074s	user 0.004s	sys 0.000s
W20260709 12:14:56.777938  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:56.778591  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 92317.7us
I20260709 12:14:56.792794  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:56.795630  3338 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 13: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:56.799907  3088 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48764 (request call id 298) took 9842 ms. Trace:
W20260709 12:14:56.825349  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 187356us
W20260709 12:14:56.827839  3231 leader_election.cc:336] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.638s (SENT)
I20260709 12:14:56.829551  3231 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.835230  7527 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.835839  7527 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:56.838009  7527 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:56.847069  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:56.800307  3088 rpcz_store.cc:276] 0709 12:14:46.957691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.957902 (+   211us) service_pool.cc:224] Handling call
0709 12:14:56.799849 (+9841947us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:55.553974 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:55.554548 (+   574us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:55.554614 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:14:55.554633 (+    19us) tablet.cc:662] Decoding operations
0709 12:14:55.556004 (+  1371us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:55.556103 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:55.556132 (+    29us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:14:55.660006 (+103874us) tablet.cc:701] Row locks acquired
0709 12:14:55.660057 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:14:55.660226 (+   169us) write_op.cc:270] Start()
0709 12:14:55.660383 (+   157us) write_op.cc:276] Timestamp: P: 1783599295660165 usec, L: 0
0709 12:14:55.660419 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:14:55.661138 (+   719us) log.cc:844] Serialized 5910 byte log entry
0709 12:14:55.879960 (+218822us) op_driver.cc:464] REPLICATION: finished
0709 12:14:55.978189 (+ 98229us) write_op.cc:301] APPLY: starting
0709 12:14:55.978288 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:56.052894 (+ 74606us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:56.053008 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:56.303002 (+249994us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:56.319915 (+ 16913us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:14:56.335305 (+ 15390us) write_op.cc:312] APPLY: finished
0709 12:14:56.380351 (+ 45046us) log.cc:844] Serialized 139 byte log entry
0709 12:14:56.380582 (+   231us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:56.380749 (+   167us) write_op.cc:454] Released schema lock
0709 12:14:56.380827 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:56.381285 (+   458us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:56.381316 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":804470,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":97906,"apply.run_cpu_time_us":27425,"apply.run_wall_time_us":403062,"cfile_cache_hit":58,"cfile_cache_hit_bytes":60523,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":1,"lbm_read_time_us":15606,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":7,"num_ops":15,"prepare.queue_time_us":137782,"prepare.run_cpu_time_us":36334,"prepare.run_wall_time_us":216154,"raft.queue_time_us":81469,"raft.run_cpu_time_us":10518,"raft.run_wall_time_us":72223,"replication_time_us":219338,"thread_start_us":298854,"threads_started":4,"wal-append.queue_time_us":134482}]]}
W20260709 12:14:56.869408  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:56.867609  7546 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:56.888767  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 60953.4us
W20260709 12:14:56.897856  3231 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.653s (SENT)
I20260709 12:14:56.900758  3231 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.904215  7309 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:14:56.911928  7560 log.cc:927] Time spent T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:14:56.920936  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:56.915091  7526 raft_consensus.cc:515] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:56.924774  2017 tablet_replica.cc:333] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:56.926348  2017 raft_consensus.cc:2243] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:14:56.927309  2017 raft_consensus.cc:2272] T 8e46c8b6a4494f6d8742bb7ef609d94c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.933413  2017 tablet_replica.cc:333] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:56.935499  3090 catalog_manager.cc:5697] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 6 to 7, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 7 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:56.923899  3231 leader_election.cc:336] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.667s (SENT)
I20260709 12:14:56.937091  3231 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:56.939209  7526 leader_election.cc:290] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 15 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:56.947781  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:56.952105  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.952898  3895 leader_election.cc:336] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:56.953622  3895 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.958256  7546 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:56.965221  3231 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Timed out: RequestConsensusVote RPC to 127.1.248.65:44889 timed out after 1.753s (SENT)
I20260709 12:14:56.965664  3231 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:56.970691  3231 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:56.972314  7309 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:14:56.976759  3231 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:56.977298  3231 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.978286  7309 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:56.978663  3231 leader_election.cc:336] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:56.979120  3231 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.980048  7309 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:56.981066  3231 leader_election.cc:336] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:56.981577  3231 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.982400  7309 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:56.983675  7427 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:56.985021  3895 leader_election.cc:336] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:56.988826  7542 raft_consensus.cc:493] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.991780  7542 raft_consensus.cc:515] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:56.992148  3895 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:56.996276  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:56.993919  7542 leader_election.cc:290] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:56.996762  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fc559f70f94ad8b2da50624147942a" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:57.000123  7427 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:57.001561  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.002534  3157 leader_election.cc:304] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:57.002616  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:57.003471  3895 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.004060  7526 raft_consensus.cc:2749] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:57.004299  3895 leader_election.cc:336] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.004885  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:57.006659  7427 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:57.006910  2017 raft_consensus.cc:2243] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:57.009043  3231 leader_election.cc:336] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.009086  2017 pending_rounds.cc:70] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3: Trying to abort 1 pending ops.
I20260709 12:14:57.019495  3231 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:57.020572  7309 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:57.021052  3231 leader_election.cc:336] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.021549  3231 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:57.022352  7309 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:57.019825  2017 pending_rounds.cc:77] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3: Aborting op as it isn't in flight: id { term: 9 index: 6 } timestamp: 7305622684768342016 op_type: NO_OP noop_request { }
I20260709 12:14:57.023128  2017 raft_consensus.cc:2889] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:57.023522  2017 raft_consensus.cc:2272] T c333bd40d0a34c96bb74838b3ea8986c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.026902  2017 tablet_replica.cc:333] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
W20260709 12:14:57.022739  3231 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:57.040050  3231 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.040501  3231 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:57.041303  7309 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:57.041880  3231 leader_election.cc:336] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.042363  3231 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:57.043105  7309 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:57.043486  3231 leader_election.cc:336] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:57.044447  3231 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.044946  3231 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:57.049258  7309 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:57.049630  3231 leader_election.cc:336] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.050175  3231 leader_election.cc:304] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:57.050910  7309 raft_consensus.cc:2749] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:57.056334  2017 raft_consensus.cc:2243] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.057111  2017 raft_consensus.cc:2272] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:57.058179  3231 leader_election.cc:336] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.058655  3231 leader_election.cc:304] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:57.059104  7541 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:57.059362  7309 raft_consensus.cc:2749] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:57.059670  7541 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:57.060279  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.060904  3263 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:57.061846  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2274893aa4cc087f9d4af8119b1ea" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.062378  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb8348062364c7c878da1d2999c325b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.062501  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.061889  7541 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:57.066581  3305 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.069186  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:57.072603  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:57.077893  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 69955.8us
I20260709 12:14:57.078789  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227a6b3f36540848b2525ba007e6a35" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:57.079061  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.083210  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.083786  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:57.083806  3266 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:57.084523  3262 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:57.086711  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960fd01223d4443593561ba739ba7ec9" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.077497  2017 tablet_replica.cc:333] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:57.089213  3261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.089587  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:57.089804  3261 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:57.090093  3266 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:14:57.087641  7541 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:57.091856  7541 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:57.093878  7541 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:57.098968  3262 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
W20260709 12:14:57.114023  3305 leader_election.cc:336] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.123871  2017 raft_consensus.cc:2243] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.124658  2017 raft_consensus.cc:2272] T 4d7af9c2d6334c6f84aed4586a66d701 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.133936  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:57.134320  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab3ecc4f0b34068a804b174b02b9a16" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.134575  3268 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:14:57.135987  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb25fe7122b4568ac690e16b514ee7d" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:57.138602  3266 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 13.
I20260709 12:14:57.142704  2017 tablet_replica.cc:333] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:57.143949  2017 raft_consensus.cc:2243] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.145179  2017 raft_consensus.cc:2272] T 5f390a5a17da4b61aa47d48ea74bae91 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.145283  3268 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:57.149466  2017 tablet_replica.cc:333] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
W20260709 12:14:57.151671  3159 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.152397  2017 raft_consensus.cc:2243] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.153097  2017 raft_consensus.cc:2272] T 21a56ad7de6f43239e103edd8e2b159f P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.156100  2017 tablet_replica.cc:333] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:57.157009  2017 raft_consensus.cc:2243] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.157898  2017 raft_consensus.cc:2272] T 68838261f2ca456f9b5583e60f9f3d2c P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.160719  2017 tablet_replica.cc:333] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:57.161662  2017 raft_consensus.cc:2243] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.162257  2017 raft_consensus.cc:2272] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.169827  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.170361  3156 leader_election.cc:304] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:57.173125  3156 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:57.176630  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:57.177165  3231 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.177762  3231 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:57.180064  3156 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:57.183775  3156 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:57.189905  3231 leader_election.cc:336] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.217209  3231 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:57.188264  7527 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:57.219734  7524 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:57.190954  7546 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:57.181375  7542 raft_consensus.cc:2749] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:14:57.221261  3231 leader_election.cc:336] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.221679  3231 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:57.181535  7504 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:57.181339  7493 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:57.226233  3259 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:14:57.216984  7253 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:14:57.231712  7546 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:57.225423  3156 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:57.232565  3231 leader_election.cc:336] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:57.240535  3231 leader_election.cc:336] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.241019  3231 leader_election.cc:304] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:57.247861  7546 raft_consensus.cc:2749] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:57.249277  3231 leader_election.cc:336] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.249708  3231 leader_election.cc:304] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:57.250419  7546 raft_consensus.cc:2749] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:14:57.250419  2017 tablet_replica.cc:333] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
W20260709 12:14:57.251621  3231 leader_election.cc:336] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.252020  3231 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:57.252655  7546 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:57.253494  2017 raft_consensus.cc:2243] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:57.253708  3231 leader_election.cc:336] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.254123  3231 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:57.255268  3231 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:57.253981  3156 raft_consensus.cc:2686] T 960fd01223d4443593561ba739ba7ec9 P 7ac63b674f204bc4805ab989f8c965d3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:57.255679  3231 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:57.237125  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.271342  3156 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:57.287933  3156 leader_election.cc:304] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:57.291708  3156 raft_consensus.cc:2686] T 5bb25fe7122b4568ac690e16b514ee7d P 7ac63b674f204bc4805ab989f8c965d3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:57.284945  7546 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:57.285851  7504 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:57.301105  3156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.292060  7543 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:57.291852  7524 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:57.307180  3268 raft_consensus.cc:1275] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:14:57.304790  3265 raft_consensus.cc:1275] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:57.308669  3259 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:14:57.306804  3090 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34704 (request call id 182) took 30793 ms (client timeout 15000 ms). Trace:
I20260709 12:14:57.322647  3305 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:57.303965  7504 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:57.327906  7541 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:14:57.360083  3928 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:14:57.360437  7541 consensus_queue.cc:1243] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Peer 1ef05c9d901046dca7fe0e638cc693b9 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:14:57.310873  3090 rpcz_store.cc:269] 0709 12:14:26.508703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.512723 (+  4020us) service_pool.cc:224] Handling call
0709 12:14:57.302392 (+30789669us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:57.020770 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:57.021485 (+   715us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:57.021519 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:14:57.021537 (+    18us) tablet.cc:662] Decoding operations
0709 12:14:57.021859 (+   322us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:57.021929 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:57.021961 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:14:57.022142 (+   181us) tablet.cc:701] Row locks acquired
0709 12:14:57.022160 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:14:57.022306 (+   146us) write_op.cc:270] Start()
0709 12:14:57.022424 (+   118us) write_op.cc:276] Timestamp: P: 1783599297022257 usec, L: 0
0709 12:14:57.022451 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:14:57.023094 (+   643us) log.cc:844] Serialized 533 byte log entry
0709 12:14:57.096201 (+ 73107us) op_driver.cc:464] REPLICATION: finished
0709 12:14:57.166707 (+ 70506us) write_op.cc:301] APPLY: starting
0709 12:14:57.166795 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:57.185088 (+ 18293us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:57.217007 (+ 31919us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:57.226268 (+  9261us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:57.226465 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:14:57.226523 (+    58us) write_op.cc:312] APPLY: finished
0709 12:14:57.226721 (+   198us) log.cc:844] Serialized 25 byte log entry
0709 12:14:57.226898 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:57.226978 (+    80us) write_op.cc:454] Released schema lock
0709 12:14:57.227891 (+   913us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:57.247741 (+ 19850us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:57.247777 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2461305,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":67562,"apply.run_cpu_time_us":3695,"apply.run_wall_time_us":71040,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"num_ops":1,"prepare.queue_time_us":53307,"prepare.run_cpu_time_us":2556,"prepare.run_wall_time_us":7617,"replication_time_us":73594,"thread_start_us":63138,"threads_started":2}]]}
I20260709 12:14:57.373731  7502 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:14:57.386029  7575 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:57.437558  2017 raft_consensus.cc:2272] T e227a6b3f36540848b2525ba007e6a35 P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.455962  7585 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:57.456636  7585 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:57.458894  7585 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:57.460575  3340 raft_consensus.cc:1275] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:14:57.470368  7582 raft_consensus.cc:493] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.470968  7582 raft_consensus.cc:515] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:57.473467  7582 leader_election.cc:290] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:57.474855  3334 raft_consensus.cc:1275] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:57.477021  7504 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:57.480845  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:57.482144  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:57.482846  3337 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:57.495955  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.478930  7542 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:14:57.434372  7545 consensus_queue.cc:1048] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:14:57.484447  7524 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:57.490187  3157 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:57.539255  7253 consensus_queue.cc:1048] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 12:14:57.539597  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 55328.5us
I20260709 12:14:57.541821  3259 pending_rounds.cc:85] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting all ops after (but not including) 8
I20260709 12:14:57.563113  3259 pending_rounds.cc:107] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:14:57.563448  3259 raft_consensus.cc:2889] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:57.554823  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb4310417b348518d7accdf0538e249" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:57.550590  3263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.568925  3263 raft_consensus.cc:2393] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 12: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:57.540664  3925 raft_consensus.cc:1275] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:14:57.574576  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 43628.2us
I20260709 12:14:57.499356  2017 tablet_replica.cc:333] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
W20260709 12:14:57.585335  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 45652.4us
I20260709 12:14:57.587625  7526 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:14:57.588362  3305 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.591902  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:57.599646  7578 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:57.612723  7578 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:57.540253  7545 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:14:57.580808  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:57.625125  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 45662.5us
W20260709 12:14:57.626201  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:57.624993  7545 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:57.627291  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:57.639071  7545 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:57.639536  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:57.642150  7109 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:14:57.584375  7502 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.645390  7502 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:57.646550  7576 consensus_queue.cc:1048] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:57.523125  7546 raft_consensus.cc:2749] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:57.649197  2017 raft_consensus.cc:2243] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.649441  7309 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:57.649936  7309 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:57.652426  7309 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:57.653074  3268 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:57.649936  2017 pending_rounds.cc:70] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: Trying to abort 1 pending ops.
I20260709 12:14:57.654892  2017 pending_rounds.cc:77] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3: Aborting op as it isn't in flight: id { term: 10 index: 7 } timestamp: 7305622718690824192 op_type: NO_OP noop_request { }
I20260709 12:14:57.655248  2017 raft_consensus.cc:2889] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:57.655627  2017 raft_consensus.cc:2272] T 1aa66ee25a6347bf8c52ec788a373117 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.692864  7504 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.704582  7504 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:57.706835  7504 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:57.710480  2017 tablet_replica.cc:333] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:57.710381  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:57.711445  3340 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:57.712829  3157 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:57.713992  7109 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:57.714488  7109 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.714906  7109 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:57.715718  7502 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:57.716423  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.717046  3264 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 13.
I20260709 12:14:57.719463  2017 raft_consensus.cc:2243] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.720256  2017 raft_consensus.cc:2272] T 9ec2274893aa4cc087f9d4af8119b1ea P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.724527  3156 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:57.727766  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:57.728649  3334 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 13.
W20260709 12:14:57.729844  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 87973.5us
I20260709 12:14:57.732474  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:57.733114  3264 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
W20260709 12:14:57.743894  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 79711.7us
I20260709 12:14:57.747776  2017 tablet_replica.cc:333] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:57.729250  7527 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:14:57.733438  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 111167us
W20260709 12:14:57.772599  3305 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:57.766515  3231 leader_election.cc:336] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:57.765648  3157 leader_election.cc:304] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:57.780802  3231 consensus_peers.cc:597] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:57.781756  3231 consensus_peers.cc:597] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:57.773221  7527 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.781343  7543 raft_consensus.cc:2749] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:57.855044  2017 raft_consensus.cc:2243] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.851112  7527 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:57.891300  2017 pending_rounds.cc:70] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3: Trying to abort 1 pending ops.
I20260709 12:14:57.893770  2017 pending_rounds.cc:77] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3: Aborting op as it isn't in flight: id { term: 12 index: 9 } timestamp: 7305622695653507072 op_type: NO_OP noop_request { }
I20260709 12:14:57.894260  2017 raft_consensus.cc:2889] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:57.894688  2017 raft_consensus.cc:2272] T ebb8348062364c7c878da1d2999c325b P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.847221  7545 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:57.915184  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:57.921428  3334 raft_consensus.cc:2393] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 10: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
W20260709 12:14:57.927242  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 61268.7us
I20260709 12:14:57.930524  7575 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:57.917979  7594 log.cc:927] Time spent T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:14:57.947886  3089 catalog_manager.cc:5697] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
W20260709 12:14:57.949317  7589 log.cc:927] Time spent T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:14:57.954993  3089 catalog_manager.cc:5697] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 6 to 7, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 7 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:57.971984  3089 catalog_manager.cc:5697] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 7 to 8, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 8 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:57.972085  7595 log.cc:927] Time spent T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 12:14:57.984444  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 64072.9us
I20260709 12:14:57.931121  7575 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:58.000728  2017 tablet_replica.cc:333] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
W20260709 12:14:58.049510  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 62367.3us
I20260709 12:14:58.017370  7109 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:58.055621  7597 log.cc:927] Time spent T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:14:58.056593  7109 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:58.057199  7588 log.cc:927] Time spent T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:14:58.070262  3089 catalog_manager.cc:5697] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 4 to 6, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 6 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:14:58.143004  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 92772us
I20260709 12:14:58.145432  2017 raft_consensus.cc:2243] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:58.151297  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 79887us
I20260709 12:14:58.160076  3089 catalog_manager.cc:5697] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
W20260709 12:14:58.169709  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 151033us
I20260709 12:14:58.162635  3089 catalog_manager.cc:5697] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:58.136287  7526 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:58.194279  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 47456.6us
W20260709 12:14:58.211452  3267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.091s	sys 0.197s
W20260709 12:14:58.211884  3267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.091s	sys 0.197s
I20260709 12:14:58.210294  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:58.214003  3334 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:58.215744  3158 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.220073  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:58.220745  3260 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.224390  2017 raft_consensus.cc:2272] T 8939008df61a42b5ab6d01a5cc782e16 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.231997  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:58.232863  3266 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:58.212739  7427 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.260627  7545 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:58.263995  3267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56758 (request call id 2490) took 1160 ms. Trace:
I20260709 12:14:58.264496  3267 rpcz_store.cc:276] 0709 12:14:57.103650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.104096 (+   446us) service_pool.cc:224] Handling call
0709 12:14:57.104374 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:57.111400 (+  7026us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:57.392028 (+280628us) log.cc:844] Serialized 14 byte log entry
0709 12:14:58.219671 (+827643us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:58.240642 (+ 20971us) log.cc:844] Serialized 26 byte log entry
0709 12:14:58.240854 (+   212us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:58.241185 (+   331us) log.cc:844] Serialized 14 byte log entry
0709 12:14:58.245558 (+  4373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:58.245688 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:58.263702 (+ 18014us) raft_consensus.cc:1685] finished
0709 12:14:58.263728 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:58.263892 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133104,"prepare.queue_time_us":223298,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":31727,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":5242,"thread_start_us":906102,"threads_started":2,"wal-append.queue_time_us":518253}
I20260709 12:14:58.247887  7427 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:58.232823  7493 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.214936  7526 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:14:58.293160  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 44546.1us
W20260709 12:14:58.281697  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 51703us
I20260709 12:14:58.294960  3232 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:58.296170  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 87590.7us
I20260709 12:14:58.297806  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:58.298441  3337 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:58.298691  3260 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
W20260709 12:14:58.384220  7608 log.cc:927] Time spent T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 12:14:58.385430  7605 log.cc:927] Time spent T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
W20260709 12:14:58.414530  7591 log.cc:927] Time spent T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:14:58.270565  7493 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.351101  7546 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:58.286718  7614 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:58.457470  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 153342us
I20260709 12:14:58.466858  3266 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 12.
W20260709 12:14:58.491577  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 197642us
I20260709 12:14:58.470822  3334 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:58.473881  3337 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 12.
W20260709 12:14:58.480993  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 254086us
I20260709 12:14:58.499691  3157 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:58.494489  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 202339us
W20260709 12:14:58.487293  7527 consensus_meta.cc:287] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.007s
W20260709 12:14:58.505038  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 168778us
I20260709 12:14:58.478858  7583 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.515458  7526 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:58.495012  7614 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.517971  7614 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:58.520557  2017 tablet_replica.cc:333] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:58.521435  2017 raft_consensus.cc:2243] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.524950  7493 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:58.505599  7546 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.528198  7546 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.530383  7546 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:58.508548  7527 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.532809  7427 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:58.533607  7527 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 14 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:58.512858  7583 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.535349  7542 raft_consensus.cc:2706] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Received election callback for term 12 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:14:58.536003  2017 raft_consensus.cc:2272] T 1c7c3fc93e9d456eb83867c8095af00c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.536213  7583 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:58.538744  7575 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:58.538940  2017 tablet_replica.cc:333] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:58.562654  7309 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.563289  7309 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.565688  7309 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:58.580369  2017 raft_consensus.cc:2243] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.583029  7554 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.583846  7554 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.587800  7554 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:58.604059  7309 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.609412  7309 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.607708  7627 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:58.611804  7627 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:58.615306  7627 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:58.621919  7546 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.622730  7546 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.626130  7546 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:58.627597  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 45084.4us
I20260709 12:14:58.628106  7554 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.628294  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:58.630445  7309 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:58.628819  7554 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.635207  7554 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:58.639963  2017 pending_rounds.cc:70] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3: Trying to abort 1 pending ops.
I20260709 12:14:58.640393  2017 pending_rounds.cc:77] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3: Aborting op as it isn't in flight: id { term: 4 index: 6 } timestamp: 7305622596877725696 op_type: NO_OP noop_request { }
I20260709 12:14:58.640856  2017 raft_consensus.cc:2889] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:58.641355  2017 raft_consensus.cc:2272] T 9796736c241b42c283a7f6a433742bed P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.644786  2017 tablet_replica.cc:333] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:58.646188  2017 raft_consensus.cc:2243] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.647006  2017 pending_rounds.cc:70] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3: Trying to abort 1 pending ops.
I20260709 12:14:58.647763  2017 pending_rounds.cc:77] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3: Aborting op as it isn't in flight: id { term: 9 index: 10 } timestamp: 7305622686909497344 op_type: NO_OP noop_request { }
I20260709 12:14:58.649571  2017 raft_consensus.cc:2889] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:58.667841  2017 raft_consensus.cc:2272] T b974e8909e0b47e2bd4e0d28fbafe975 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:58.668556  3157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 168955us
W20260709 12:14:58.657716  7635 log.cc:927] Time spent T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 12:14:58.651471  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 300822us
I20260709 12:14:58.670600  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:58.674511  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:58.674906  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 174900us
I20260709 12:14:58.679662  3337 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:58.678653  3338 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 12.
I20260709 12:14:58.685425  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:58.686165  3926 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 9.
I20260709 12:14:58.689327  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:58.691247  7554 raft_consensus.cc:493] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:58.691880  7554 raft_consensus.cc:515] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:58.694422  7554 leader_election.cc:290] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:58.695505  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:58.701133  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:58.701552  3157 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:58.702493  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:58.703131  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 207747us
I20260709 12:14:58.701838  3260 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 11.
I20260709 12:14:58.705601  3266 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
I20260709 12:14:58.706862  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85351bf981e43bea61620452a2c7b3a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:58.716092  7631 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.716768  7631 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.719099  7631 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:58.721253  7632 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:58.741334  7632 raft_consensus.cc:697] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:58.741581  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:58.742254  3338 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 12.
I20260709 12:14:58.742327  7632 consensus_queue.cc:237] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.744133  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:58.744379  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:58.744765  3342 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
I20260709 12:14:58.745005  3338 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 11.
I20260709 12:14:58.726641  2017 tablet_replica.cc:333] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:58.750774  2017 raft_consensus.cc:2243] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.751417  7554 raft_consensus.cc:493] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:58.751600  2017 raft_consensus.cc:2272] T acb4310417b348518d7accdf0538e249 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.752058  7554 raft_consensus.cc:515] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:58.754406  7554 leader_election.cc:290] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:58.754472  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:58.755285  3340 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:14:58.756225  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:58.756907  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:14:58.758288  3156 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 78849.4us
I20260709 12:14:58.768218  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:58.769929  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10fd7fda53e4a8ea272336588c66980" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:58.774142  3157 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:58.793462  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 290062us
I20260709 12:14:58.794910  3157 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:58.806254  7554 raft_consensus.cc:493] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
I20260709 12:14:58.810153  7554 raft_consensus.cc:515] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:58.812927  7554 leader_election.cc:290] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:14:58.819630  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 50661.5us
W20260709 12:14:58.820719  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 59246.2us
I20260709 12:14:58.819924  2017 tablet_replica.cc:333] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:58.822216  3337 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 14.
I20260709 12:14:58.823613  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:58.824219  3266 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 10.
I20260709 12:14:58.825376  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:58.809233  7543 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:58.825951  3266 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 12.
I20260709 12:14:58.822012  7633 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:58.829978  7633 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.830384  7633 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.826876  7543 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.831931  7543 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:58.844831  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:58.845546  3259 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:58.852016  3157 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:58.845542  2017 raft_consensus.cc:2243] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.856315  7638 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:14:58.856904  7638 raft_consensus.cc:697] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 14 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:58.857839  7638 consensus_queue.cc:237] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.861560  3259 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 14.
I20260709 12:14:58.864027  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:58.865451  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:58.895793  3262 raft_consensus.cc:2393] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f0cdd57c5934921829c205d32b2b8a5 in current term 10: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:58.886195  7543 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:58.904901  7543 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:58.906638  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
W20260709 12:14:58.893044  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 48092.9us
I20260709 12:14:58.911506  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:58.912086  3337 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:58.912508  3259 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:58.914662  3232 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:58.918443  2017 raft_consensus.cc:2272] T cab3ecc4f0b34068a804b174b02b9a16 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.917232  3232 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:58.921373  7627 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:58.921495  3232 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:58.921814  7627 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.922261  7627 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:58.918527  3231 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:58.924502  3231 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:58.925447  3231 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:58.928226  3337 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 13.
I20260709 12:14:58.929293  3259 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 13.
I20260709 12:14:58.930114  3157 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:58.930629  3232 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:14:58.931100  3231 leader_election.cc:336] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:58.931593  3231 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:58.932898  3231 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:58.933338  3231 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:58.934247  3305 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:58.936407  3232 leader_election.cc:304] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
W20260709 12:14:58.939410  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:58.940634  3895 leader_election.cc:336] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:58.939319  3305 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:58.942703  7113 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:58.942854  3305 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:58.943737  7538 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:58.944166  7538 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.944576  7538 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.940501  7543 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:58.931460  7554 raft_consensus.cc:2764] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:14:58.941038  3895 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:58.931625  7309 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:58.955127  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cb299c977a476ab873860cf7e2a44c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:58.937554  7631 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:58.954581  7309 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.957258  7400 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:58.957614  7309 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:58.957463  7621 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:58.943220  7113 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.941035  7587 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:58.950126  7633 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:58.967408  2017 tablet_replica.cc:333] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:58.968487  2017 raft_consensus.cc:2243] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.969193  2017 raft_consensus.cc:2272] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.972045  2017 tablet_replica.cc:333] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
W20260709 12:14:58.972117  3231 leader_election.cc:336] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:58.972888  2017 raft_consensus.cc:2243] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:14:58.973141  3231 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:58.974222  3231 leader_election.cc:336] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:58.973655  2017 pending_rounds.cc:70] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3: Trying to abort 1 pending ops.
I20260709 12:14:58.975075  2017 pending_rounds.cc:77] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3: Aborting op as it isn't in flight: id { term: 11 index: 8 } timestamp: 7305622727674085376 op_type: NO_OP noop_request { }
I20260709 12:14:58.975497  2017 raft_consensus.cc:2889] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:58.956939  7543 raft_consensus.cc:697] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 13 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:58.975859  2017 raft_consensus.cc:2272] T 90c20968bf7e4f29893d6df711ca41d1 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.974586  7400 raft_consensus.cc:2749] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:58.966269  3305 leader_election.cc:336] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:58.963018  7113 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:58.979705  3305 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:58.963402  7546 raft_consensus.cc:2749] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:14:58.981657  3305 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:58.960134  7621 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:58.974694  3231 leader_election.cc:304] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:58.966048  7524 raft_consensus.cc:2749] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:58.985047  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:58.985195  3305 leader_election.cc:336] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:58.990650  7587 raft_consensus.cc:2749] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:58.983326  7621 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:58.976421  7543 consensus_queue.cc:237] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:59.008183  2017 tablet_replica.cc:333] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.009441  2017 raft_consensus.cc:2243] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:14:59.008337  7633 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:59.012063  2017 raft_consensus.cc:2272] T f72e701fa9c047c59371e2759c4303ab P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.014000  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:14:59.014624  3924 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:59.016757  3895 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 171 similar messages]
I20260709 12:14:59.026693  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:59.027498  3260 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.049753  3924 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
W20260709 12:14:59.050426  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 114096us
I20260709 12:14:59.053599  3232 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:59.055946  3232 leader_election.cc:304] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:59.060030  7546 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:59.061159  7546 raft_consensus.cc:2749] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:59.064925  3157 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3; no voters: 
I20260709 12:14:59.046440  7627 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:59.066531  7502 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.071357  7543 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:59.073212  3260 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ac63b674f204bc4805ab989f8c965d3 in term 11.
I20260709 12:14:59.077638  7502 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:59.084306  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:59.081171  7543 raft_consensus.cc:697] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Becoming Leader. State: Replica: 7ac63b674f204bc4805ab989f8c965d3, State: Running, Role: LEADER
I20260709 12:14:59.087999  2017 tablet_replica.cc:333] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.091955  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:59.096778  2017 raft_consensus.cc:2243] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:14:59.098213  2017 raft_consensus.cc:2272] T 0d98324eb9764f8e9470a5c111b82bb1 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.086205  7309 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:59.109216  7586 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:59.117633  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd9302593554fbabfffed2fd5ca4443" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:59.124274  3157 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:59.104974  7543 consensus_queue.cc:237] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:59.114244  7502 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:59.132391  7545 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:59.117024  7586 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:59.146073  7586 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:14:59.153033  3305 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:59.157455  2017 tablet_replica.cc:333] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.158577  2017 raft_consensus.cc:2243] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:14:59.159655  2017 raft_consensus.cc:2272] T 57d85bc226d34560b470d2d44e89c8cc P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.162145  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:59.161145  3231 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:59.133071  7538 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:59.172387  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:59.178443  7309 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:14:59.187018  3231 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:59.190495  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:59.198567  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:59.180703  7627 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:59.199306  7631 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:59.200790  3340 raft_consensus.cc:2393] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 11: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:59.201435  2017 tablet_replica.cc:333] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.202293  2017 raft_consensus.cc:2243] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:14:59.202366  7538 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:59.203349  2017 raft_consensus.cc:2272] T 57c6fad3865d45a1b0c364058f3550b4 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.209579  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:59.210474  3260 raft_consensus.cc:2393] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 11: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:14:59.223989  3305 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:59.224792  3305 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:59.224933  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:59.220834  2017 tablet_replica.cc:333] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.227509  3232 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:59.232494  7647 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:59.233048  7647 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:59.242046  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:59.242796  3334 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
I20260709 12:14:59.235191  7647 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:59.228229  3086 catalog_manager.cc:5697] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:59.256239  3086 catalog_manager.cc:5697] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 9 to 12, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 12 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:59.259716  3232 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:59.261998  7627 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:59.262413  7627 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:14:59.262799  7627 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.263473  2017 raft_consensus.cc:2243] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:14:59.245327  7538 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:59.252275  7546 raft_consensus.cc:2749] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:59.252009  7309 raft_consensus.cc:493] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f0cdd57c5934921829c205d32b2b8a5)
W20260709 12:14:59.269975  3231 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:59.270056  7309 raft_consensus.cc:515] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:59.272377  7309 leader_election.cc:290] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:59.273751  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4338ede94a794c41ba16cba6ac585f9a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:14:59.275846  3231 leader_election.cc:336] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:59.277211  7113 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:59.278578  3337 raft_consensus.cc:2393] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 12: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:14:59.260157  7621 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:59.281343  3262 raft_consensus.cc:2393] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:59.282246  7621 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:59.282388  3232 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:59.283855  7621 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:14:59.287209  3089 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48778 (request call id 283) took 19266 ms (client timeout 15000 ms). Trace:
I20260709 12:14:59.294049  2017 raft_consensus.cc:2272] T 37160a9f5c0a4847b38b9c87a80891de P 7ac63b674f204bc4805ab989f8c965d3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.287868  3232 leader_election.cc:304] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:59.297199  2017 tablet_replica.cc:333] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.297873  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f390a5a17da4b61aa47d48ea74bae91" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:59.300179  3337 raft_consensus.cc:3060] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:59.301879  2017 raft_consensus.cc:2243] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:59.302572  2017 raft_consensus.cc:2272] T c85f3b72388e43eb9b3f81e8f5ba7385 P 7ac63b674f204bc4805ab989f8c965d3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.305855  7502 raft_consensus.cc:493] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.306376  7502 raft_consensus.cc:515] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:14:59.308617  7502 leader_election.cc:290] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:14:59.315595  7113 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:14:59.317525  7621 raft_consensus.cc:2749] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:59.324034  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:14:59.325553  3305 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:59.327211  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:14:59.328015  3260 raft_consensus.cc:2393] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 12: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:14:59.330734  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:14:59.294129  3089 rpcz_store.cc:269] 0709 12:14:40.021237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.021517 (+   280us) service_pool.cc:224] Handling call
0709 12:14:59.287143 (+19265626us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:58.567369 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:58.567978 (+   609us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:58.568013 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:14:58.568032 (+    19us) tablet.cc:662] Decoding operations
0709 12:14:58.568784 (+   752us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:58.568862 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:58.568890 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:14:58.569379 (+   489us) tablet.cc:701] Row locks acquired
0709 12:14:58.569396 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:14:58.569529 (+   133us) write_op.cc:270] Start()
0709 12:14:58.569651 (+   122us) write_op.cc:276] Timestamp: P: 1783599298569483 usec, L: 0
0709 12:14:58.569673 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:14:58.594024 (+ 24351us) log.cc:844] Serialized 2454 byte log entry
0709 12:14:58.843866 (+249842us) op_driver.cc:464] REPLICATION: finished
0709 12:14:58.944174 (+100308us) write_op.cc:301] APPLY: starting
0709 12:14:58.944267 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:58.948327 (+  4060us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:58.948420 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:59.034895 (+ 86475us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:59.066079 (+ 31184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 12:14:59.070164 (+  4085us) write_op.cc:312] APPLY: finished
0709 12:14:59.078649 (+  8485us) log.cc:844] Serialized 65 byte log entry
0709 12:14:59.081133 (+  2484us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:59.085757 (+  4624us) write_op.cc:454] Released schema lock
0709 12:14:59.086514 (+   757us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:59.110004 (+ 23490us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:59.111269 (+  1265us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":709218,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":100060,"apply.run_cpu_time_us":9816,"apply.run_wall_time_us":153144,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29171,"num_ops":6,"prepare.queue_time_us":275381,"prepare.run_cpu_time_us":13343,"prepare.run_wall_time_us":91022,"raft.queue_time_us":182952,"raft.run_cpu_time_us":17865,"raft.run_wall_time_us":95300,"replication_time_us":274022,"spinlock_wait_cycles":21632,"thread_start_us":565616,"threads_started":4,"wal-append.queue_time_us":64162}]]}
I20260709 12:14:59.334689  3337 raft_consensus.cc:2468] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:14:59.331765  3086 catalog_manager.cc:5697] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:59.335928  3086 catalog_manager.cc:5697] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 9, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 9 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.336958  3086 catalog_manager.cc:5697] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:59.339026  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ed88d91bd49d4a95c3eb59fb97a63" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:14:59.340157  2017 tablet_replica.cc:333] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.341282  3232 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:14:59.343197  3305 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:59.343693  7526 raft_consensus.cc:493] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.348021  7526 raft_consensus.cc:515] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:14:59.342311  3231 leader_election.cc:336] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:59.337988  3086 catalog_manager.cc:5697] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.343713  7621 raft_consensus.cc:2804] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:59.340094  7541 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:59.358371  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:14:59.360574  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a1a5138f6d495dbacdde8c4b4dd898" candidate_uuid: "7ac63b674f204bc4805ab989f8c965d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:14:59.361606  3086 catalog_manager.cc:5697] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 10, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 10 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.364203  3157 leader_election.cc:304] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:14:59.365406  7545 raft_consensus.cc:2749] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:59.372403  2017 raft_consensus.cc:2243] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:59.373972  3156 leader_election.cc:304] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ac63b674f204bc4805ab989f8c965d3; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:14:59.376403  3086 catalog_manager.cc:5697] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:59.377903  3086 catalog_manager.cc:5697] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 5 to 10, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 10 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.379089  3086 catalog_manager.cc:5697] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.354030  7578 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:59.380082  3086 catalog_manager.cc:5697] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.353775  7526 leader_election.cc:290] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:59.387861  3086 catalog_manager.cc:5697] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 11, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65). New cstate: current_term: 11 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:59.390556  2017 raft_consensus.cc:2272] T fb103e3ac0ca481bace4eb01f0725ae8 P 7ac63b674f204bc4805ab989f8c965d3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.390141  3086 catalog_manager.cc:5697] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 9 to 10, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 10 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.379865  7621 raft_consensus.cc:697] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:59.392102  3086 catalog_manager.cc:5697] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:59.393929  3086 catalog_manager.cc:5697] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.394649  7621 consensus_queue.cc:237] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:59.395596  3086 catalog_manager.cc:5697] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:59.396929  3086 catalog_manager.cc:5697] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:59.398115  3086 catalog_manager.cc:5697] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 4 to 6, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 6 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:59.400100  3086 catalog_manager.cc:5697] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:59.375864  7633 raft_consensus.cc:2749] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:59.405563  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:59.410754  7627 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:59.401219  2017 tablet_replica.cc:333] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.401970  3086 catalog_manager.cc:5697] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 9, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 9 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:14:59.416814  3231 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:59.417687  3086 catalog_manager.cc:5697] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 9, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 9 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:59.418604  2017 raft_consensus.cc:2243] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:59.418910  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa66ee25a6347bf8c52ec788a373117" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:14:59.419292  3086 catalog_manager.cc:5697] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:59.419394  2017 pending_rounds.cc:70] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: Trying to abort 1 pending ops.
I20260709 12:14:59.431764  2017 pending_rounds.cc:77] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3: Aborting op as it isn't in flight: id { term: 9 index: 10 } timestamp: 7305622636412547072 op_type: NO_OP noop_request { }
I20260709 12:14:59.432134  2017 raft_consensus.cc:2889] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:59.432474  2017 raft_consensus.cc:2272] T 21406a1677884f049da5c65f8f2ed5ff P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.419569  3337 raft_consensus.cc:3060] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.436997  3262 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:14:59.420732  3086 catalog_manager.cc:5697] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 8 to 10, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 10 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:59.423251  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:59.440361  7633 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:59.443132  3086 catalog_manager.cc:5697] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:59.453033  2017 tablet_replica.cc:333] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
W20260709 12:14:59.456974  3305 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:59.416759  7627 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:14:59.491215  2017 raft_consensus.cc:2243] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:59.491931  2017 raft_consensus.cc:2272] T 8dd9302593554fbabfffed2fd5ca4443 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.492808  3337 raft_consensus.cc:2468] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 11.
I20260709 12:14:59.496119  3232 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:14:59.501322  3260 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:14:59.503691  7526 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:14:59.504824  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:59.506031  3337 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:14:59.509589  7526 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:59.497970  7587 raft_consensus.cc:2804] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:59.515885  7587 raft_consensus.cc:697] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:14:59.516770  7587 consensus_queue.cc:237] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:14:59.540249  2017 tablet_replica.cc:333] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.541312  2017 raft_consensus.cc:2243] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:59.543805  3337 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Refusing update from remote peer 7ac63b674f204bc4805ab989f8c965d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:14:59.547780  7526 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:59.550261  2017 pending_rounds.cc:70] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3: Trying to abort 1 pending ops.
I20260709 12:14:59.550592  2017 pending_rounds.cc:77] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3: Aborting op as it isn't in flight: id { term: 7 index: 8 } timestamp: 7305622599150551040 op_type: NO_OP noop_request { }
I20260709 12:14:59.550923  2017 raft_consensus.cc:2889] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:59.551260  2017 raft_consensus.cc:2272] T 4338ede94a794c41ba16cba6ac585f9a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.591914  2017 tablet_replica.cc:333] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.592995  2017 raft_consensus.cc:2243] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:59.593916  2017 raft_consensus.cc:2272] T f904cee1d1e04a36bc93a9dcf405d9a8 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:59.596305  3231 consensus_peers.cc:597] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:59.647854  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:59.652278  2017 tablet_replica.cc:333] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.653206  2017 raft_consensus.cc:2243] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:14:59.654989  2017 pending_rounds.cc:70] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3: Trying to abort 1 pending ops.
I20260709 12:14:59.655268  2017 pending_rounds.cc:77] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3: Aborting op as it isn't in flight: id { term: 11 index: 10 } timestamp: 7305622729651269632 op_type: NO_OP noop_request { }
I20260709 12:14:59.655701  2017 raft_consensus.cc:2889] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:59.656038  2017 raft_consensus.cc:2272] T eb7809b208b14a549539330993804c34 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.677878  2017 tablet_replica.cc:333] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.683580  2017 raft_consensus.cc:2243] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:59.683671  3305 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:59.685765  2017 raft_consensus.cc:2272] T f0fc559f70f94ad8b2da50624147942a P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.690548  2017 tablet_replica.cc:333] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.705761  2017 raft_consensus.cc:2243] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:14:59.706708  2017 raft_consensus.cc:2272] T ac73674a60ce47a481b9d61f7e78e5f3 P 7ac63b674f204bc4805ab989f8c965d3 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:59.716462  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:59.737242  2017 tablet_replica.cc:333] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.742578  2017 raft_consensus.cc:2243] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:14:59.743485  2017 raft_consensus.cc:2272] T afca51be89bf4a7681690f9913aa6f82 P 7ac63b674f204bc4805ab989f8c965d3 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:59.743952  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:59.786530  3087 catalog_manager.cc:5697] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 7 to 10, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 10 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:59.787901  3087 catalog_manager.cc:5697] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 2 to 7, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 7 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.789129  3087 catalog_manager.cc:5697] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 7 to 9, leader changed from eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 9 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.790128  3087 catalog_manager.cc:5697] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 10 to 13, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 13 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.795997  3086 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48786 (request call id 306) took 5200 ms. Trace:
I20260709 12:14:59.796684  3086 rpcz_store.cc:276] 0709 12:14:54.602531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.604391 (+  1860us) service_pool.cc:224] Handling call
0709 12:14:59.795903 (+5191512us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:59.509818 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:59.510351 (+   533us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:59.510384 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:14:59.510403 (+    19us) tablet.cc:662] Decoding operations
0709 12:14:59.512097 (+  1694us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:59.512167 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:59.512193 (+    26us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:14:59.514105 (+  1912us) tablet.cc:701] Row locks acquired
0709 12:14:59.514132 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:14:59.514266 (+   134us) write_op.cc:270] Start()
0709 12:14:59.514382 (+   116us) write_op.cc:276] Timestamp: P: 1783599299514224 usec, L: 0
0709 12:14:59.514404 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:14:59.515077 (+   673us) log.cc:844] Serialized 9339 byte log entry
0709 12:14:59.537367 (+ 22290us) op_driver.cc:464] REPLICATION: finished
0709 12:14:59.538249 (+   882us) write_op.cc:301] APPLY: starting
0709 12:14:59.538335 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:59.592911 (+ 54576us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:59.593009 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:59.709000 (+115991us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:59.709299 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=0,mrs_lookups=0
0709 12:14:59.709343 (+    44us) write_op.cc:312] APPLY: finished
0709 12:14:59.709766 (+   423us) log.cc:844] Serialized 212 byte log entry
0709 12:14:59.709940 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:59.710141 (+   201us) write_op.cc:454] Released schema lock
0709 12:14:59.710200 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:59.710559 (+   359us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:59.710587 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40052,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":29357,"apply.run_wall_time_us":172284,"cfile_cache_hit":96,"cfile_cache_hit_bytes":100176,"num_ops":24,"prepare.queue_time_us":19390,"prepare.run_cpu_time_us":5621,"prepare.run_wall_time_us":8459,"replication_time_us":22810,"spinlock_wait_cycles":15744,"thread_start_us":7145,"threads_started":1}]]}
I20260709 12:14:59.807766  2017 tablet_replica.cc:333] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.807962  3087 catalog_manager.cc:5697] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:59.811283  3087 catalog_manager.cc:5697] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:14:59.814497  3087 catalog_manager.cc:5697] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 6 to 9, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 9 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.816524  3087 catalog_manager.cc:5697] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.808781  2017 raft_consensus.cc:2243] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:59.824615  2017 raft_consensus.cc:2272] T c34244f67d5045c49554e8a2ce27891d P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.827574  2017 tablet_replica.cc:333] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.832154  2017 raft_consensus.cc:2243] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:14:59.833408  2017 raft_consensus.cc:2272] T 94318f741f4143469cf9140cb1be3c4c P 7ac63b674f204bc4805ab989f8c965d3 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:59.843580  3231 consensus_peers.cc:597] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:59.853358  2017 tablet_replica.cc:333] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.856937  2017 raft_consensus.cc:2243] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:14:59.879565  2017 raft_consensus.cc:2272] T aa54c541b3454731ad51d4012eb0ad72 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.887012  2017 tablet_replica.cc:333] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.887948  2017 raft_consensus.cc:2243] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:59.888856  2017 raft_consensus.cc:2272] T a85351bf981e43bea61620452a2c7b3a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.915834  3342 raft_consensus.cc:1275] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:59.917438  7587 consensus_queue.cc:1048] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:59.924332  2017 tablet_replica.cc:333] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.937426  2017 raft_consensus.cc:2243] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:59.947017  2017 raft_consensus.cc:2272] T 34a1a5138f6d495dbacdde8c4b4dd898 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:59.961084  3087 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48778 (request call id 284) took 4260 ms. Trace:
I20260709 12:14:59.971832  2017 tablet_replica.cc:333] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:14:59.970573  3087 rpcz_store.cc:276] 0709 12:14:55.700890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.701182 (+   292us) service_pool.cc:224] Handling call
0709 12:14:55.772724 (+ 71542us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b5400189f54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee537090 00007f1aee5d5f3a 00007f1af438be9c 00007f1af448a04e 00007f1af294b2a4 00007f1af294b232 00007f1af294b161 00007f1af294b0dc 00007f1af294a392 00007f1aec90848c 00007f1aec9078c6
0709 12:14:59.961014 (+4188290us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:59.852636 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:59.853171 (+   535us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:59.853219 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:14:59.853232 (+    13us) tablet.cc:662] Decoding operations
0709 12:14:59.853996 (+   764us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:59.854063 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:59.854090 (+    27us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:14:59.854707 (+   617us) tablet.cc:701] Row locks acquired
0709 12:14:59.854721 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:14:59.854860 (+   139us) write_op.cc:270] Start()
0709 12:14:59.854981 (+   121us) write_op.cc:276] Timestamp: P: 1783599299854817 usec, L: 0
0709 12:14:59.854999 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:14:59.856068 (+  1069us) log.cc:844] Serialized 3258 byte log entry
0709 12:14:59.871734 (+ 15666us) op_driver.cc:464] REPLICATION: finished
0709 12:14:59.874093 (+  2359us) write_op.cc:301] APPLY: starting
0709 12:14:59.874170 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:59.878141 (+  3971us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:59.878220 (+    79us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:59.882905 (+  4685us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:59.883120 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:14:59.883173 (+    53us) write_op.cc:312] APPLY: finished
0709 12:14:59.883488 (+   315us) log.cc:844] Serialized 81 byte log entry
0709 12:14:59.890393 (+  6905us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:59.890567 (+   174us) write_op.cc:454] Released schema lock
0709 12:14:59.890635 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:59.899406 (+  8771us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:59.904121 (+  4715us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":49,"spinlock_wait_cycles":17752832,"child_traces":[["op",{"apply.queue_time_us":2136,"apply.run_cpu_time_us":10202,"apply.run_wall_time_us":21482,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33392,"num_ops":8,"prepare.queue_time_us":596,"prepare.run_cpu_time_us":3387,"prepare.run_wall_time_us":10507,"replication_time_us":16621,"spinlock_wait_cycles":38272}]]}
I20260709 12:14:59.984288  2017 raft_consensus.cc:2243] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:14:59.970029  3091 catalog_manager.cc:5697] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:59.989040  3091 catalog_manager.cc:5697] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:14:59.986465  2017 raft_consensus.cc:2272] T 4a4e9fd123b2418a86c69f2894fd2f4f P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:00.005882  3091 catalog_manager.cc:5697] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:00.007277  2017 tablet_replica.cc:333] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
W20260709 12:15:00.025432  3231 consensus_peers.cc:597] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:00.042837  2017 raft_consensus.cc:2243] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:00.030566  3342 raft_consensus.cc:1275] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:00.043605  2017 pending_rounds.cc:70] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Trying to abort 2 pending ops.
I20260709 12:15:00.043895  2017 pending_rounds.cc:77] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Aborting op as it isn't in flight: id { term: 11 index: 9 } timestamp: 7305622640330653696 op_type: NO_OP noop_request { }
I20260709 12:15:00.044253  2017 raft_consensus.cc:2889] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:15:00.044585  2017 pending_rounds.cc:77] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3: Aborting op as it isn't in flight: id { term: 9 index: 8 } timestamp: 7305622597612064768 op_type: NO_OP noop_request { }
I20260709 12:15:00.044914  7621 consensus_queue.cc:1048] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:00.044916  2017 raft_consensus.cc:2889] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:15:00.045980  2017 raft_consensus.cc:2272] T 9ee459e79aec45909d356d039c69e72c P 7ac63b674f204bc4805ab989f8c965d3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:00.049754  2017 tablet_replica.cc:333] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:15:00.050854  2017 raft_consensus.cc:2243] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:00.051462  2017 raft_consensus.cc:2272] T c79ed88d91bd49d4a95c3eb59fb97a63 P 7ac63b674f204bc4805ab989f8c965d3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:00.054423  2017 tablet_replica.cc:333] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:15:00.055274  2017 raft_consensus.cc:2243] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:15:00.056582  2017 raft_consensus.cc:2272] T e974711b37af4153b756b212bffc5915 P 7ac63b674f204bc4805ab989f8c965d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:00.060832  2017 tablet_replica.cc:333] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:15:00.061652  2017 raft_consensus.cc:2243] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:15:00.062980  2017 raft_consensus.cc:2272] T 7a515efb7c674e9997a33098bc2d7002 P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:00.066838  2017 tablet_replica.cc:333] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:15:00.067625  2017 raft_consensus.cc:2243] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:15:00.068729  7538 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.069321  7538 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.071651  7538 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:00.073330  2017 raft_consensus.cc:2272] T 132b388f4bf24fd482334847aadc601a P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:00.073971  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:00.074700  3267 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 12.
I20260709 12:15:00.077448  2017 tablet_replica.cc:333] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:15:00.078326  2017 raft_consensus.cc:2243] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:00.078963  2017 raft_consensus.cc:2272] T 51ff9b5ea5944e51914ded65407b153b P 7ac63b674f204bc4805ab989f8c965d3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:00.082069  2017 tablet_replica.cc:333] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3: stopping tablet replica
I20260709 12:15:00.095042  2017 raft_consensus.cc:2243] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:15:00.096130  2017 raft_consensus.cc:2272] T 72176593f52b48c28602984ef9c8ee6b P 7ac63b674f204bc4805ab989f8c965d3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:00.111502  3305 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:00.119836  7538 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:00.120317  7538 raft_consensus.cc:493] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:00.120688  7538 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:00.129211  7538 raft_consensus.cc:515] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.133332  7538 leader_election.cc:290] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:00.137247  3305 leader_election.cc:336] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:15:00.141136  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:00.149407  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7c3fc93e9d456eb83867c8095af00c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:00.150002  3267 raft_consensus.cc:3060] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:00.161705  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:00.163292  3086 catalog_manager.cc:5697] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 13 to 15, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 15 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:00.165196  3086 catalog_manager.cc:5697] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:15:00.167200  3086 catalog_manager.cc:5697] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:15:00.182557  3267 raft_consensus.cc:2468] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 13.
I20260709 12:15:00.191134  3305 leader_election.cc:304] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:00.178004  3086 catalog_manager.cc:5697] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 6 to 9, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 9 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:00.192982  3086 catalog_manager.cc:5697] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 11 to 12, leader changed from 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 12 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:00.194639  3086 catalog_manager.cc:5697] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:15:00.195952  3086 catalog_manager.cc:5697] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:15:00.197479  3086 catalog_manager.cc:5697] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } }
I20260709 12:15:00.199644  7538 raft_consensus.cc:2804] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:00.200219  7538 raft_consensus.cc:697] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 13 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:15:00.201128  7538 consensus_queue.cc:237] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:00.204489  3305 leader_election.cc:336] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.198856  3086 catalog_manager.cc:5697] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:00.208362  3091 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34704 (request call id 184) took 4482 ms. Trace:
I20260709 12:15:00.216717  3086 catalog_manager.cc:5697] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 6 to 7, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 7 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:00.209846  3091 rpcz_store.cc:276] 0709 12:14:55.725814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.726090 (+   276us) service_pool.cc:224] Handling call
0709 12:14:55.856695 (+130605us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b5400189f54. stack: 00007f1aeb4ae343 00007f1aeb4ae240 00007f1aeae3d1d4 00007f1af4b7b304 00007f1af4b7b299 00007f1aee537090 00007f1aee5d5f3a 00007f1af438be9c 00007f1af448a04e 00007f1af294b2a4 00007f1af294b232 00007f1af294b161 00007f1af294b0dc 00007f1af294a392 00007f1aec90848c 00007f1aec9078c6
0709 12:15:00.208295 (+4351600us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:00.078275 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:00.078916 (+   641us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:00.078959 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:15:00.078977 (+    18us) tablet.cc:662] Decoding operations
0709 12:15:00.079620 (+   643us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:00.079679 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:00.079720 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:15:00.080092 (+   372us) tablet.cc:701] Row locks acquired
0709 12:15:00.080108 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:15:00.080273 (+   165us) write_op.cc:270] Start()
0709 12:15:00.080407 (+   134us) write_op.cc:276] Timestamp: P: 1783599300080218 usec, L: 0
0709 12:15:00.080429 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:15:00.081134 (+   705us) log.cc:844] Serialized 1293 byte log entry
0709 12:15:00.083928 (+  2794us) op_driver.cc:464] REPLICATION: finished
0709 12:15:00.084571 (+   643us) write_op.cc:301] APPLY: starting
0709 12:15:00.084660 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:00.086571 (+  1911us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:00.086708 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:00.088612 (+  1904us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:00.088790 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:15:00.088837 (+    47us) write_op.cc:312] APPLY: finished
0709 12:15:00.089065 (+   228us) log.cc:844] Serialized 41 byte log entry
0709 12:15:00.092252 (+  3187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:00.092435 (+   183us) write_op.cc:454] Released schema lock
0709 12:15:00.092489 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:00.092888 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:00.092914 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13936,"reported_tablets":31,"spinlock_wait_cycles":13550976,"child_traces":[["op",{"apply.queue_time_us":370,"apply.run_cpu_time_us":5210,"apply.run_wall_time_us":8267,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12522,"num_ops":3,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":3202,"prepare.run_wall_time_us":5171,"replication_time_us":3058,"spinlock_wait_cycles":611200}]]}
I20260709 12:15:00.309412  3087 catalog_manager.cc:5697] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 6 to 8, VOTER eb49d92feeb14382b3baa49d696b6141 (127.1.248.67) evicted. New cstate: current_term: 7 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:00.312829  3087 catalog_manager.cc:5697] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7ac63b674f204bc4805ab989f8c965d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:00.315078  3087 catalog_manager.cc:5697] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 7 to 8, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 8 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:00.316744  3087 catalog_manager.cc:5697] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 8 to 11, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 11 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:00.321132  7541 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.321784  7541 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.324082  7541 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:00.327203  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:15:00.329936  3305 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.333362  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:00.334321  7541 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:00.339648  3895 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:00.348418  7627 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.349023  7627 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.354878  7665 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.355443  7665 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.357568  7665 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:00.358596  3086 catalog_manager.cc:5697] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 10 to 13, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 13 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:00.361652  3231 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:15:00.363730  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:00.366709  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:00.367558  3342 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 11.
I20260709 12:15:00.369266  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:00.370810  3232 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:00.371941  7665 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:00.372397  7665 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.372783  7665 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:00.372969  7627 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:00.374627  3231 leader_election.cc:336] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.375078  3231 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:00.376152  7627 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:00.392130  3328 tablet_service.cc:1558] Processing DeleteTablet for tablet a85351bf981e43bea61620452a2c7b3a with delete_type TABLET_DATA_TOMBSTONED (TS eb49d92feeb14382b3baa49d696b6141 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:45092
W20260709 12:15:00.394222  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:00.399511  7541 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.400108  7541 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.402223  7541 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:00.407383  7668 tablet_replica.cc:333] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:00.408620  7665 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.414726  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:15:00.423848  3231 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.425351  7665 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:00.425676  7668 raft_consensus.cc:2243] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:00.426147  3305 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.426626  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:00.426769  7668 raft_consensus.cc:2272] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:00.427347  7541 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:00.429137  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72e701fa9c047c59371e2759c4303ab" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:15:00.429702  3342 raft_consensus.cc:3060] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:00.432497  7668 ts_tablet_manager.cc:1916] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:00.440397  3342 raft_consensus.cc:2468] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 12.
I20260709 12:15:00.442524  3232 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:00.452901  7665 raft_consensus.cc:2804] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:00.453474  7665 raft_consensus.cc:697] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:15:00.454418  7665 consensus_queue.cc:237] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:00.467003  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:00.469760  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:00.473505  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:00.489919  7627 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.490597  7627 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.493623  7627 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:00.494635  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:15:00.497407  3231 leader_election.cc:336] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.497820  3231 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:00.498548  7627 raft_consensus.cc:2749] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:00.499342  3087 catalog_manager.cc:5697] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 11 to 12, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 12 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:00.545233  7667 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.545936  7667 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.548375  7667 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:00.550501  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:15:00.550772  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:00.551369  3260 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
I20260709 12:15:00.552724  7667 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.553464  3305 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:00.553292  7667 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:00.554409  3305 leader_election.cc:336] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.555640  7667 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:00.555680  7541 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:00.556866  7541 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.557264  7541 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:00.558653  7668 ts_tablet_manager.cc:1929] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 12:15:00.559271  7668 log.cc:1199] T a85351bf981e43bea61620452a2c7b3a P eb49d92feeb14382b3baa49d696b6141: Deleting WAL directory at /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/wals/a85351bf981e43bea61620452a2c7b3a
I20260709 12:15:00.564471  3076 catalog_manager.cc:5028] TS eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): tablet a85351bf981e43bea61620452a2c7b3a (table test-workload [id=a6badc6d9f0443c1be0688884bd03216]) successfully deleted
W20260709 12:15:00.565584  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:00.568151  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:00.568723  3267 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 13.
I20260709 12:15:00.566448  7665 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.569422  7665 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.573902  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:15:00.575863  3231 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.576274  7538 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:00.576716  7538 raft_consensus.cc:493] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.573506  7665 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:00.577101  7538 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:00.577569  3305 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:00.577723  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:15:00.578172  3305 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.578325  3342 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 11.
I20260709 12:15:00.579718  3232 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:00.580420  7665 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:00.581215  7665 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.581758  7665 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:00.590947  7665 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:00.594676  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:00.600414  3231 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.594890  7538 raft_consensus.cc:515] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.601826  7665 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:00.602897  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:15:00.603683  3342 raft_consensus.cc:3060] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:00.605072  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d85bc226d34560b470d2d44e89c8cc" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:00.605654  3267 raft_consensus.cc:3060] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:00.603473  7538 leader_election.cc:290] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:00.610118  3305 leader_election.cc:336] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.581148  7541 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.614176  3267 raft_consensus.cc:2468] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 14.
I20260709 12:15:00.614293  7541 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:00.616493  3305 leader_election.cc:304] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:00.617573  7541 raft_consensus.cc:2804] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:00.618069  7541 raft_consensus.cc:697] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 14 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:15:00.618906  7541 consensus_queue.cc:237] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.620921  3342 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 12.
I20260709 12:15:00.623380  3232 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:00.624231  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c6fad3865d45a1b0c364058f3550b4" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:00.624847  3267 raft_consensus.cc:3060] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:00.625731  7670 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.626307  7670 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.628468  7670 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:00.629310  7665 raft_consensus.cc:2804] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:00.630671  7665 raft_consensus.cc:697] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:15:00.631685  7665 consensus_queue.cc:237] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.638118  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:00.638993  3260 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 14.
I20260709 12:15:00.643111  3267 raft_consensus.cc:2468] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
W20260709 12:15:00.638983  3305 leader_election.cc:336] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.644719  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:00.645969  3305 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:00.645605  7670 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:00.647310  7667 raft_consensus.cc:2804] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:00.647477  7670 raft_consensus.cc:493] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:15:00.651558  3305 leader_election.cc:336] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.651952  7670 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:00.648867  7667 raft_consensus.cc:697] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:15:00.653635  7667 consensus_queue.cc:237] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.659139  7670 raft_consensus.cc:515] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.661293  7670 leader_election.cc:290] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:00.664057  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37160a9f5c0a4847b38b9c87a80891de" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:00.664671  3260 raft_consensus.cc:3060] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:00.675150  3087 catalog_manager.cc:5697] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 13 to 14, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 14 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:00.686650  3260 raft_consensus.cc:2468] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 15.
W20260709 12:15:00.686314  3305 leader_election.cc:336] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:00.688743  3305 leader_election.cc:304] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:00.691522  7671 raft_consensus.cc:2804] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:00.692117  7671 raft_consensus.cc:697] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 15 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:15:00.692924  7671 consensus_queue.cc:237] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:00.700389  3305 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:00.710213  3091 catalog_manager.cc:5697] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 11 to 12, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 12 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:00.771790  3087 catalog_manager.cc:5697] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 9 to 10, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 10 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:00.779924  3087 catalog_manager.cc:5697] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 14 to 15, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 15 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:00.791174  3260 raft_consensus.cc:1275] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:00.794198  7670 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.795784  7670 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.799182  7670 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:00.809422  7667 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:00.810032  7667 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.812253  7667 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:00.830890  3231 consensus_peers.cc:597] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:00.838357  7667 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.838927  7667 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.840968  7667 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:00.853979  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:00.854347  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:00.856315  7670 consensus_queue.cc:1048] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:00.856576  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:00.857290  3260 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 11.
I20260709 12:15:00.860018  3305 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:00.860814  7670 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:00.861244  7670 raft_consensus.cc:493] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:00.861599  7670 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:00.872974  7670 raft_consensus.cc:515] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.875101  7670 leader_election.cc:290] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:00.877244  3305 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:00.878032  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:15:00.879014  3305 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:00.879464  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:00.880270  7667 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:00.881028  7667 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:00.910208  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68838261f2ca456f9b5583e60f9f3d2c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:00.911013  3260 raft_consensus.cc:3060] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:00.921078  3305 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:00.935781  3231 consensus_peers.cc:597] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:00.939812  3231 consensus_peers.cc:597] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:00.952422  3305 leader_election.cc:336] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:00.953750  3260 raft_consensus.cc:2468] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 12.
I20260709 12:15:00.965052  3305 leader_election.cc:304] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:00.968566  7671 raft_consensus.cc:2804] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:00.969131  7671 raft_consensus.cc:697] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 12 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:15:00.970126  7671 consensus_queue.cc:237] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:00.991573  7548 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.992143  7548 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:00.994582  7548 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:00.999648  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:01.000432  3267 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 11.
I20260709 12:15:01.012431  3895 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:15:01.013278  7284 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:01.013700  7284 raft_consensus.cc:493] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.014108  7284 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:01.016283  3340 raft_consensus.cc:1275] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:01.017788  7627 consensus_queue.cc:1048] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:01.023773  7627 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.024356  7627 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.028657  7627 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.030224  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:01.030894  3337 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
W20260709 12:15:01.032027  3231 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.032971  3232 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.034648  7627 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:01.035173  7627 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.035708  7627 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:01.052951  7627 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:01.055060  3895 leader_election.cc:336] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.065874  3087 catalog_manager.cc:5697] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:01.077466  3231 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.083949  3305 consensus_peers.cc:597] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:01.093403  3260 raft_consensus.cc:1275] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 15 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:01.097018  7671 consensus_queue.cc:1048] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:01.095238  7627 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.091971  7284 raft_consensus.cc:515] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:01.114354  7284 leader_election.cc:290] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:01.125208  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34244f67d5045c49554e8a2ce27891d" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:15:01.125852  3340 raft_consensus.cc:3060] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:01.127517  3895 leader_election.cc:336] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.132495  3340 raft_consensus.cc:2468] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
I20260709 12:15:01.133988  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7809b208b14a549539330993804c34" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:01.134609  3267 raft_consensus.cc:3060] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:01.136363  7667 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.136881  7667 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:01.131601  3305 consensus_peers.cc:597] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:01.138933  7667 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:01.141080  7689 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.141464  3267 raft_consensus.cc:2468] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 12.
I20260709 12:15:01.141680  7689 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.144070  3895 leader_election.cc:304] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.145208  7687 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.145926  7284 raft_consensus.cc:2804] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:01.145751  7687 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.146529  7284 raft_consensus.cc:697] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:15:01.147728  7689 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.148166  7284 consensus_queue.cc:237] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:01.148861  7671 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.150597  7687 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.149473  7671 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.152169  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:01.152905  3267 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 14.
I20260709 12:15:01.144289  3232 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.154860  7687 raft_consensus.cc:2804] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:01.155340  7687 raft_consensus.cc:697] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:15:01.156430  7687 consensus_queue.cc:237] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:01.157732  3231 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.159577  7688 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.160125  7688 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.162796  7667 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.163328  7667 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.165302  7667 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:01.165503  3231 leader_election.cc:336] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.166611  7688 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.167243  7691 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.168008  7691 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:01.169716  7671 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:01.170410  7691 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:15:01.178048  7691 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.178584  7691 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.180909  7691 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.183274  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:15:01.185061  3087 catalog_manager.cc:5697] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 9 to 12, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 12 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:01.186543  3305 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.191654  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:01.192149  7671 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.192703  7671 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.194134  7671 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:01.196897  7671 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.197376  7671 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.201139  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:01.201490  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:01.201869  3340 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 14.
I20260709 12:15:01.204022  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:01.204735  3334 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 13.
I20260709 12:15:01.203958  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.205875  7670 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:01.206226  7670 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.204226  3342 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:01.206595  7670 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:01.209434  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:01.211650  3232 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:01.212448  7687 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:01.213752  3232 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.214596  7687 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:01.214957  7687 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.214999  3232 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:01.215418  7687 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:01.216974  7691 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:01.217375  7691 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.217743  7691 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:01.221498  7689 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:15:01.222945  3305 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.223529  3305 leader_election.cc:336] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.224090  7687 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.224887  7541 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.225524  7541 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:01.226977  7538 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.227317  7689 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.227545  7538 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.227833  7689 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.228700  7687 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 15 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.229542  7538 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:01.229693  7689 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.231076  7541 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:15:01.232122  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:15:01.232765  3924 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
I20260709 12:15:01.233625  7689 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.234351  3306 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
W20260709 12:15:01.236027  3305 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.236670  3305 consensus_peers.cc:597] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:01.237202  3337 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:15:01.237190  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:01.238060  3259 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 11.
I20260709 12:15:01.239022  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:01.239498  3338 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 11.
I20260709 12:15:01.240396  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:01.240530  3232 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:01.243368  3259 raft_consensus.cc:1275] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:01.244099  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:15:01.244354  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:01.250903  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:01.251586  3259 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
I20260709 12:15:01.237967  7689 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.256217  7688 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.256752  7688 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.257489  7671 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:01.258056  7689 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.258689  7688 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.260715  3265 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 11.
I20260709 12:15:01.243968  7548 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.264097  7548 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:01.266043  7548 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
W20260709 12:15:01.267143  3231 leader_election.cc:336] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.249555  7687 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:01.267896  7687 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.269196  3232 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:15:01.270282  3305 leader_election.cc:336] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.270931  3305 leader_election.cc:336] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.273258  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:01.273833  3265 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 7.
I20260709 12:15:01.274673  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:01.274155  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.276652  3305 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.276908  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:01.277518  3337 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 11.
I20260709 12:15:01.279714  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:01.280336  3265 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 13.
I20260709 12:15:01.283905  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:15:01.284643  7679 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:01.285037  7679 raft_consensus.cc:493] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.285398  7679 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:01.292906  7679 raft_consensus.cc:515] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:01.275343  3338 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 9.
I20260709 12:15:01.269891  7667 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:01.296895  7667 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.297302  7667 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:01.297160  7695 consensus_queue.cc:1048] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:01.299784  7695 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:01.300263  7695 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.300729  7695 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:01.301501  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.302739  3305 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:01.300724  7698 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.304358  3232 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:01.305563  7689 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:01.306064  7689 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.306627  7689 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:01.308555  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72176593f52b48c28602984ef9c8ee6b" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:01.309345  3260 raft_consensus.cc:3060] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:01.303778  7698 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.314380  7698 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:01.268230  7687 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:01.295758  3087 catalog_manager.cc:5697] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 7 to 8, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 8 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:01.323010  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 88726.3us
I20260709 12:15:01.323478  3232 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:01.306107  7667 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:01.317129  7541 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:01.318385  7691 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.329123  7541 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.321401  7671 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:01.329905  7671 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.330356  7671 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:01.330605  7691 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.280015  7670 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.296465  7688 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:15:01.322675  3231 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.331394  3267 raft_consensus.cc:2393] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 14: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:15:01.333963  3231 leader_election.cc:336] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.334731  3231 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.332995  7670 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:01.335517  3231 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.296228  7538 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:01.336746  7538 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.337159  7538 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:01.328697  7690 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:01.329552  7541 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:01.333580  3342 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 15: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:15:01.344928  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
W20260709 12:15:01.349139  3895 leader_election.cc:336] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.354877  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:01.355700  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4e9fd123b2418a86c69f2894fd2f4f" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:15:01.356267  3337 raft_consensus.cc:3060] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:01.356920  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.360574  3265 raft_consensus.cc:2393] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 15: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:15:01.352900  3260 raft_consensus.cc:2468] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 14.
I20260709 12:15:01.367761  7689 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.369055  7679 leader_election.cc:290] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889)
I20260709 12:15:01.369961  7689 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.370281  7671 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.333761  7688 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:15:01.373399  3231 leader_election.cc:336] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.373452  7688 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:01.375698  3231 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 6f0cdd57c5934921829c205d32b2b8a5, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:15:01.376641  3231 consensus_peers.cc:597] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:01.377075  3231 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.381534  3895 leader_election.cc:304] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5; no voters: 
I20260709 12:15:01.382412  3232 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:01.383359  7627 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:01.346375  7690 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.388782  3337 raft_consensus.cc:2468] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 14.
I20260709 12:15:01.389506  7690 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:01.390610  7667 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:15:01.402281  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:15:01.379875  7689 raft_consensus.cc:2749] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:01.403417  7695 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.407943  7687 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.410053  7687 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.403270  7672 raft_consensus.cc:2804] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:01.403160  7699 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:01.440968  3265 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:01.439884  3232 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:01.442962  3337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:15:01.442991  7665 raft_consensus.cc:2804] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:01.444235  7665 raft_consensus.cc:697] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:15:01.445178  7665 consensus_queue.cc:237] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.460358  7671 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:01.460198  7698 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:01.435905  7691 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.448069  7667 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:01.476451  3305 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.477195  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:15:01.478547  3305 leader_election.cc:336] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.481153  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:01.482467  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:01.483192  3260 raft_consensus.cc:3060] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:01.479163  3305 leader_election.cc:336] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.495162  3305 leader_election.cc:336] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.496512  3305 leader_election.cc:336] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.504120  3305 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.517681  3260 raft_consensus.cc:2468] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 11.
I20260709 12:15:01.451872  7672 raft_consensus.cc:697] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:15:01.463884  7691 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.531133  7691 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.510668  7701 raft_consensus.cc:2749] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:15:01.527681  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 94500.3us
I20260709 12:15:01.465214  7667 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.528074  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa54c541b3454731ad51d4012eb0ad72" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5"
I20260709 12:15:01.463594  7695 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:01.534721  3926 raft_consensus.cc:3060] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:01.535369  3895 leader_election.cc:336] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.531409  7688 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.518244  7671 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:01.432468  7690 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:01.564049  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 45431.3us
I20260709 12:15:01.463363  7541 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.463994  7538 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.575235  3265 raft_consensus.cc:2393] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 8: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:15:01.583737  3342 raft_consensus.cc:2393] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 12: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:15:01.585445  3337 raft_consensus.cc:2393] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 12: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:15:01.571532  7691 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
W20260709 12:15:01.602119  3231 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.602897  3231 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.593937  7691 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.613170  7691 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.619681  7690 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.596863  7672 consensus_queue.cc:237] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:01.625844  3926 raft_consensus.cc:2468] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 11.
W20260709 12:15:01.629052  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 104124us
I20260709 12:15:01.632673  7541 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:01.633823  7667 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:01.643006  3231 leader_election.cc:336] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.644150  3231 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.650200  3339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:01.650671  3305 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:01.650902  3339 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 7.
I20260709 12:15:01.650187  3340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:01.652032  3340 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 12.
I20260709 12:15:01.651029  3267 raft_consensus.cc:1275] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:01.652717  7697 raft_consensus.cc:2804] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:01.624238  7688 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.653292  7697 raft_consensus.cc:697] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 11 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:15:01.653584  3338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:15:01.653986  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afca51be89bf4a7681690f9913aa6f82" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:15:01.654328  3338 raft_consensus.cc:2393] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 8: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:15:01.654501  7697 consensus_queue.cc:237] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.654539  3335 raft_consensus.cc:3060] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:01.666599  3335 raft_consensus.cc:2468] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 10.
W20260709 12:15:01.668758  3231 leader_election.cc:336] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.669638  3231 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.668839  7538 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:01.670624  3231 leader_election.cc:336] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.671377  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 257925us
W20260709 12:15:01.693305  3231 consensus_peers.cc:597] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:01.696085  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 128095us
I20260709 12:15:01.707414  3306 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.708418  3305 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.714169  7538 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:01.716854  7538 consensus_queue.cc:1048] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:01.726691  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:01.727608  3267 raft_consensus.cc:2393] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 12: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
W20260709 12:15:01.733840  3305 leader_election.cc:336] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.728996  3087 catalog_manager.cc:5697] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 13 to 14, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 14 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:01.751088  3091 catalog_manager.cc:5697] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 10 to 11, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 11 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:01.753108  3086 catalog_manager.cc:5697] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 13 to 14, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 14 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:01.712064  7697 raft_consensus.cc:2804] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:01.758561  7697 raft_consensus.cc:697] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 11 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:15:01.759578  7697 consensus_queue.cc:237] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:01.764860  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:01.765553  3267 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 12.
I20260709 12:15:01.781015  3232 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.782338  7713 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:01.782778  7713 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ac63b674f204bc4805ab989f8c965d3)
I20260709 12:15:01.783154  7713 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:01.791901  7713 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.793164  3232 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:15:01.794482  2017 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3214)
I20260709 12:15:01.795804  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:01.797020  3267 raft_consensus.cc:2393] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 12: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:15:01.799592  3232 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:01.800658  3232 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:01.801932  3232 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:01.800446  7690 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:01.804924  7627 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.805320  3342 raft_consensus.cc:1275] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:01.805760  7691 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.806337  7714 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:01.806872  7714 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.806288  3232 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.807202  7714 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:01.813439  7690 raft_consensus.cc:2804] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:01.813966  7690 raft_consensus.cc:697] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:15:01.814857  7690 consensus_queue.cc:237] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:01.816074  3139 auto_rebalancer.cc:629] Failed to schedule move for tablet 132b388f4bf24fd482334847aadc601a: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.811058  3086 catalog_manager.cc:5697] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 10 to 11, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 11 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:01.825560  3305 consensus_peers.cc:597] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:01.826653  3305 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.832057  3342 consensus_queue.cc:237] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:15:01.843214  3306 consensus_peers.cc:597] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57c6fad3865d45a1b0c364058f3550b4. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:01.846959  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:01.850872  3265 raft_consensus.cc:1275] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:01.853281  7713 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:01.854390  7714 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.856746  7714 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:01.853629  3231 leader_election.cc:336] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.859943  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:01.862015  7696 consensus_queue.cc:1048] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:15:01.868942  3231 consensus_peers.cc:597] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:01.878078  7714 consensus_queue.cc:1048] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:15:01.879845  3231 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.892500  3086 catalog_manager.cc:5697] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 9 to 10, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 10 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:01.902608  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.903553  7667 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.940223  3305 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:01.941105  7667 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:01.941536  7667 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.941895  7667 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:01.957603  3260 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:01.965008  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132b388f4bf24fd482334847aadc601a" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:15:01.965663  3342 raft_consensus.cc:3060] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:01.970626  3335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:15:01.981240  3334 raft_consensus.cc:1275] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:01.981438  3342 raft_consensus.cc:2468] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 8.
W20260709 12:15:01.981477  3305 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:01.983829  3305 leader_election.cc:336] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:01.984302  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:01.993571  7697 raft_consensus.cc:2749] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.996176  7667 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:01.997503  3335 raft_consensus.cc:2393] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ef05c9d901046dca7fe0e638cc693b9 in current term 13: Already voted for candidate eb49d92feeb14382b3baa49d696b6141 in this term.
I20260709 12:15:02.000032  7667 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:02.036356  7667 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:02.043329  7690 consensus_queue.cc:1048] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:02.050093  3232 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:02.051290  7690 raft_consensus.cc:2804] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:02.052084  7690 raft_consensus.cc:697] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:15:02.053084  7690 consensus_queue.cc:237] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:02.061960  3232 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:02.063166  7714 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:15:02.063961  3231 consensus_peers.cc:597] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:02.069123  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:02.069933  3267 raft_consensus.cc:2393] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate eb49d92feeb14382b3baa49d696b6141 in current term 13: Already voted for candidate 1ef05c9d901046dca7fe0e638cc693b9 in this term.
I20260709 12:15:02.086714  3086 catalog_manager.cc:5697] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 7 to 8, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 8 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:02.097410  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:02.098109  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:02.098894  3305 consensus_peers.cc:597] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:02.099393  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:02.099815  3305 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:02.187175  7697 raft_consensus.cc:2955] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
W20260709 12:15:02.222193  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:02.228134  3926 raft_consensus.cc:1275] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:02.231985  7667 consensus_queue.cc:1048] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:02.241930  3265 raft_consensus.cc:1275] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:02.247687  7705 consensus_queue.cc:1048] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:15:02.284180  3231 consensus_peers.cc:597] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:02.304136  3139 auto_rebalancer.cc:629] Failed to schedule move for tablet 94318f741f4143469cf9140cb1be3c4c: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:02.308589  3139 auto_rebalancer.cc:629] Failed to schedule move for tablet 90c20968bf7e4f29893d6df711ca41d1: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:02.317752  3086 catalog_manager.cc:5697] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 8, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 10 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:02.304106  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:02.321842  3305 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:02.322261  3305 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:02.333482  7667 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:02.361677  3267 raft_consensus.cc:1275] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:02.374898  3267 raft_consensus.cc:2955] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:15:02.402637  3337 raft_consensus.cc:1275] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:15:02.431820  3231 consensus_peers.cc:597] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:02.444092  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:02.454535  3305 consensus_peers.cc:597] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:02.500602  7691 consensus_queue.cc:1048] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:02.513058  7538 consensus_queue.cc:1048] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:02.528030  7735 ts_tablet_manager.cc:933] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:02.542423  7735 tablet_copy_client.cc:323] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.67:35301
I20260709 12:15:02.545686  3352 tablet_copy_service.cc:140] P eb49d92feeb14382b3baa49d696b6141: Received BeginTabletCopySession request for tablet 57c6fad3865d45a1b0c364058f3550b4 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:52822)
I20260709 12:15:02.546332  3352 tablet_copy_service.cc:161] P eb49d92feeb14382b3baa49d696b6141: Beginning new tablet copy session on tablet 57c6fad3865d45a1b0c364058f3550b4 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:52822: session id = 6f0cdd57c5934921829c205d32b2b8a5-57c6fad3865d45a1b0c364058f3550b4
W20260709 12:15:02.549176  3305 consensus_peers.cc:597] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:02.549774  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:02.550261  3305 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:02.568012  3352 tablet_copy_source_session.cc:215] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:15:02.568068  3231 consensus_peers.cc:597] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:02.575065  7735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c6fad3865d45a1b0c364058f3550b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.581900  3334 raft_consensus.cc:1275] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:15:02.595716  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:02.623420  7691 consensus_queue.cc:1048] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:15:02.674224  7735 tablet_copy_client.cc:806] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:02.675109  7735 tablet_copy_client.cc:670] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
W20260709 12:15:02.686255  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 54673.4us
W20260709 12:15:02.708705  3231 consensus_peers.cc:597] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:02.699232  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:02.686842  7735 tablet_copy_client.cc:538] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:15:02.774320  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:02.788798  7735 tablet_bootstrap.cc:492] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
W20260709 12:15:02.800954  2017 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:02.843708  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:02.874513  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:02.887180  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:02.972855  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:02.986003  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:03.016324  3305 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:03.019646  3895 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:03.048131  7735 tablet_bootstrap.cc:492] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:03.049232  7735 tablet_bootstrap.cc:492] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:15:03.050060  7735 ts_tablet_manager.cc:1403] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.262s	user 0.036s	sys 0.010s
I20260709 12:15:03.076123  7735 raft_consensus.cc:359] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:15:03.077124  7735 raft_consensus.cc:740] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:15:03.080425  7739 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.081050  7739 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:03.083384  7739 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:03.086146  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:03.085848  7735 consensus_queue.cc:260] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:15:03.086809  3267 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 15.
I20260709 12:15:03.089514  7735 ts_tablet_manager.cc:1434] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:15:03.090978  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:03.095924  7739 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:03.096362  7739 raft_consensus.cc:493] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.096714  7739 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:03.101490  3352 tablet_copy_service.cc:342] P eb49d92feeb14382b3baa49d696b6141: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-57c6fad3865d45a1b0c364058f3550b4 received from {username='slave'} at 127.0.0.1:52822
I20260709 12:15:03.102087  3352 tablet_copy_service.cc:434] P eb49d92feeb14382b3baa49d696b6141: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-57c6fad3865d45a1b0c364058f3550b4 on tablet 57c6fad3865d45a1b0c364058f3550b4 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:15:03.105862  7739 raft_consensus.cc:515] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:03.107717  3305 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:03.126343  7739 leader_election.cc:290] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 16 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:03.128623  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94318f741f4143469cf9140cb1be3c4c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:03.129256  3267 raft_consensus.cc:3060] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:03.136955  3267 raft_consensus.cc:2468] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 16.
I20260709 12:15:03.144459  3305 leader_election.cc:304] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:03.147708  7712 raft_consensus.cc:2804] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:03.148334  7712 raft_consensus.cc:697] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 16 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:15:03.151247  7712 consensus_queue.cc:237] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:03.157898  3305 leader_election.cc:336] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:03.162586  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:03.213578  3091 catalog_manager.cc:5697] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 14 to 16, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 16 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:03.236372  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:03.250131  3231 consensus_peers.cc:597] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:03.254118  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:03.301304  3924 raft_consensus.cc:1217] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
W20260709 12:15:03.318174  3305 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:03.320530  7691 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.321138  7691 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:03.323345  7691 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:03.330454  3231 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:03.350975  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:03.351783  3342 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 12.
I20260709 12:15:03.362350  3232 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:03.363355  7691 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:03.363862  7691 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.364365  7691 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:03.385154  7691 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:03.387457  7691 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:03.393313  3231 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:03.419750  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac73674a60ce47a481b9d61f7e78e5f3" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:15:03.420527  3342 raft_consensus.cc:3060] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:03.428756  3342 raft_consensus.cc:2468] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ef05c9d901046dca7fe0e638cc693b9 in term 13.
W20260709 12:15:03.453882  3231 consensus_peers.cc:597] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:03.465984  3232 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:03.466948  7691 raft_consensus.cc:2804] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:03.467522  7691 raft_consensus.cc:697] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 LEADER]: Becoming Leader. State: Replica: 1ef05c9d901046dca7fe0e638cc693b9, State: Running, Role: LEADER
I20260709 12:15:03.468452  7691 consensus_queue.cc:237] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:03.500178  3086 catalog_manager.cc:5697] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: term changed from 11 to 13, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66). New cstate: current_term: 13 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:03.507683  7667 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.508235  7667 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:03.510304  7667 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:03.521720  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:03.522405  3265 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 8.
I20260709 12:15:03.525453  3305 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:03.526196  7712 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:03.526582  7712 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.526919  7712 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:03.535701  7712 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:03.550792  3305 leader_election.cc:336] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:03.551637  7712 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:03.573673  3231 consensus_peers.cc:597] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:03.595978  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:03.596581  3265 raft_consensus.cc:3060] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:03.610859  3265 raft_consensus.cc:2468] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 9.
W20260709 12:15:03.611714  3231 consensus_peers.cc:597] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:03.614362  3305 leader_election.cc:336] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:03.636945  3305 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:03.637745  7712 raft_consensus.cc:2804] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:03.638447  7712 raft_consensus.cc:697] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:15:03.639314  7712 consensus_queue.cc:237] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:03.647218  3305 consensus_peers.cc:597] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:03.668424  3086 catalog_manager.cc:5697] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 7 to 9, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 9 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:03.700984  3305 consensus_peers.cc:597] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:03.721550  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:03.729803  3267 raft_consensus.cc:1275] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 16 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:15:03.732043  7739 consensus_queue.cc:1048] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:03.772468  7712 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.773128  7712 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:03.787313  3305 leader_election.cc:336] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:03.788611  3260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:03.789332  3260 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 12.
I20260709 12:15:03.788676  7712 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:03.800822  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:15:03.801455  2017 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 3214)
I20260709 12:15:03.801755  7739 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:03.802217  7739 raft_consensus.cc:493] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.802611  7739 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:03.810871  7739 raft_consensus.cc:515] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:03.836612  7739 leader_election.cc:290] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:03.874892  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c20968bf7e4f29893d6df711ca41d1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:03.875576  3267 raft_consensus.cc:3060] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:03.883415  7739 raft_consensus.cc:1064] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:15:03.908218  7739 consensus_queue.cc:237] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:15:03.931924  3231 consensus_peers.cc:597] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:03.944664  3305 leader_election.cc:336] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:03.956048  3924 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:03.958016  7712 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:04.031383  3335 raft_consensus.cc:1275] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:15:04.031095  3305 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111) [suppressed 426 similar messages]
I20260709 12:15:04.040350  3267 raft_consensus.cc:2468] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 13.
I20260709 12:15:04.072466  7749 consensus_queue.cc:1048] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:04.078181  3260 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:15:04.082908  3305 consensus_peers.cc:597] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:04.093451  3231 consensus_peers.cc:597] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:04.111902  3305 leader_election.cc:304] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:04.112877  7712 raft_consensus.cc:2804] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:04.113482  7712 raft_consensus.cc:697] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 13 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:15:04.114563  7712 consensus_queue.cc:237] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:04.116731  7740 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:15:04.165796  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 52284.7us
W20260709 12:15:04.202176  3305 consensus_peers.cc:597] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:04.212774  3305 consensus_peers.cc:597] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:04.299748  3305 consensus_peers.cc:597] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:04.327175  3086 catalog_manager.cc:5697] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 9 to 13, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 13 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:04.345239  3305 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:04.371887  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:04.380756  3265 raft_consensus.cc:1275] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:15:04.397121  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 104022us
I20260709 12:15:04.426687  7667 consensus_queue.cc:1048] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:04.427974  7739 raft_consensus.cc:2955] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:04.459769  3926 raft_consensus.cc:2955] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:04.503652  7667 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.504338  7667 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:04.506678  7667 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:04.517721  3259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9" is_pre_election: true
I20260709 12:15:04.518697  3259 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 13.
I20260709 12:15:04.522308  3267 raft_consensus.cc:1275] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:04.538223  3262 raft_consensus.cc:2955] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:15:04.540629  3305 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:04.550694  3305 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:04.551699  7667 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:04.555871  7667 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.556272  7667 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:04.574570  7712 consensus_queue.cc:1048] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 12:15:04.576694  3231 consensus_peers.cc:597] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:04.584335  3091 catalog_manager.cc:5697] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 8 to 9, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } attrs { replace: true } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:15:04.596570  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:04.611217  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 64466.3us
W20260709 12:15:04.613958  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:04.617195  3231 consensus_peers.cc:597] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:04.621309  7667 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:04.624989  7667 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 election: Requested vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:04.627373  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:04.629931  3262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e46c8b6a4494f6d8742bb7ef609d94c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1ef05c9d901046dca7fe0e638cc693b9"
I20260709 12:15:04.630751  3262 raft_consensus.cc:3060] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:04.634096  3305 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:04.645174  3262 raft_consensus.cc:2468] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 14.
W20260709 12:15:04.662912  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:04.664191  3305 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141; no voters: 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:04.665155  7667 raft_consensus.cc:2804] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:04.671583  7667 raft_consensus.cc:697] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 14 LEADER]: Becoming Leader. State: Replica: eb49d92feeb14382b3baa49d696b6141, State: Running, Role: LEADER
I20260709 12:15:04.673094  7667 consensus_queue.cc:237] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:04.746402  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 80271.6us
W20260709 12:15:04.790225  3305 consensus_peers.cc:597] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:04.790827  3305 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:04.794709  3091 catalog_manager.cc:5697] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: term changed from 11 to 14, leader changed from 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) to eb49d92feeb14382b3baa49d696b6141 (127.1.248.67). New cstate: current_term: 14 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:04.802305  2017 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:04.812857  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:04.816053  3335 consensus_queue.cc:237] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:15:04.823889  3231 consensus_peers.cc:597] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:04.833490  3924 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:15:04.834806  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:04.835070  7771 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:04.839131  3260 raft_consensus.cc:1275] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:15:04.835372  3305 consensus_peers.cc:597] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:04.845463  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:04.848791  7771 consensus_queue.cc:1048] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:04.856777  7712 raft_consensus.cc:2955] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:04.866731  3924 raft_consensus.cc:2955] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:04.885957  3267 raft_consensus.cc:2955] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:04.900223  3091 catalog_manager.cc:5697] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: config changed from index 9 to 10, VOTER 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65) evicted. New cstate: current_term: 10 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:04.907295  3076 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57c6fad3865d45a1b0c364058f3550b4 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:15:04.983692  3075 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 47829.2us
W20260709 12:15:04.997258  3075 catalog_manager.cc:4755] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 57c6fad3865d45a1b0c364058f3550b4: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:05.023345  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:05.059563  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:05.076224  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:05.161410  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:05.162791  3231 consensus_peers.cc:597] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:05.245783  3267 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:05.247630  7771 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:15:05.262826  3231 consensus_peers.cc:597] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:05.278287  3305 consensus_peers.cc:597] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:05.376122  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:05.403239  3305 consensus_peers.cc:597] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:05.416702  3231 consensus_peers.cc:597] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:05.465965  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:05.530086  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:05.530586  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:05.572547  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:05.651130  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:05.718456  3231 consensus_peers.cc:597] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:05.728647  3895 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:05.735633  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:05.783298  3305 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:05.802783  2017 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:05.898267  3305 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:05.922290  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:05.950057  3231 consensus_peers.cc:597] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:06.035643  3231 consensus_peers.cc:597] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:06.150728  3231 consensus_peers.cc:597] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.194046  3305 consensus_peers.cc:597] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:06.203660  3305 consensus_peers.cc:597] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.250051  3075 catalog_manager.cc:4755] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 57c6fad3865d45a1b0c364058f3550b4: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:06.271668  3231 consensus_peers.cc:597] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:06.340941  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:06.443586  3335 consensus_queue.cc:237] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:15:06.469671  3306 consensus_peers.cc:597] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e46c8b6a4494f6d8742bb7ef609d94c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:06.472299  3260 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:06.477329  7780 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:15:06.508971  3305 consensus_peers.cc:597] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:06.541570  7771 raft_consensus.cc:2955] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:15:06.549085  3260 raft_consensus.cc:2955] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
W20260709 12:15:06.578851  3305 consensus_peers.cc:597] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:06.587661  3087 catalog_manager.cc:5697] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 10, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 14 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:06.594631  3305 consensus_peers.cc:597] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:06.631680  3231 consensus_peers.cc:597] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:06.630424  3305 consensus_peers.cc:597] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:06.648903  3260 consensus_queue.cc:237] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:15:06.691630  3335 raft_consensus.cc:1275] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:06.693742  7762 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:15:06.695176  3232 consensus_peers.cc:597] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c333bd40d0a34c96bb74838b3ea8986c. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:06.709713  3231 consensus_peers.cc:597] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:06.752228  7762 raft_consensus.cc:2955] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:15:06.780202  3335 raft_consensus.cc:2955] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:15:06.792352  3334 consensus_queue.cc:237] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:15:06.803310  2017 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 3214)
I20260709 12:15:06.808820  3091 catalog_manager.cc:5697] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 7, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 10 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
W20260709 12:15:06.866711  3306 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8dd9302593554fbabfffed2fd5ca4443. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:06.898501  3267 raft_consensus.cc:1275] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:15:06.928566  7771 consensus_queue.cc:1048] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:15:06.954949  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:06.977227  7796 ts_tablet_manager.cc:933] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:06.974360  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:06.979614  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:06.993822  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:06.992705  7795 raft_consensus.cc:2955] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:15:07.005172  3267 raft_consensus.cc:2955] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:15:07.008316  7796 tablet_copy_client.cc:323] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.67:35301
I20260709 12:15:07.011209  3352 tablet_copy_service.cc:140] P eb49d92feeb14382b3baa49d696b6141: Received BeginTabletCopySession request for tablet 8e46c8b6a4494f6d8742bb7ef609d94c from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:52822)
I20260709 12:15:07.011824  3352 tablet_copy_service.cc:161] P eb49d92feeb14382b3baa49d696b6141: Beginning new tablet copy session on tablet 8e46c8b6a4494f6d8742bb7ef609d94c from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:52822: session id = 6f0cdd57c5934921829c205d32b2b8a5-8e46c8b6a4494f6d8742bb7ef609d94c
I20260709 12:15:07.016340  3260 consensus_queue.cc:237] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:15:07.023713  3352 tablet_copy_source_session.cc:215] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:07.024662  3087 catalog_manager.cc:5697] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 7, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 9 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.032186  7796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e46c8b6a4494f6d8742bb7ef609d94c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:07.045193  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:07.050115  3305 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:07.074997  3305 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:07.075609  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:07.151003  3334 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:07.148643  7796 tablet_copy_client.cc:806] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:07.168536  7802 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
W20260709 12:15:07.170797  3232 consensus_peers.cc:597] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599): Couldn't send request to peer 6f0cdd57c5934921829c205d32b2b8a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d98324eb9764f8e9470a5c111b82bb1. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:07.172410  3231 consensus_peers.cc:597] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:07.175642  7796 tablet_copy_client.cc:670] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:07.181130  7796 tablet_copy_client.cc:538] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:07.208884  7802 raft_consensus.cc:2955] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
W20260709 12:15:07.213598  3231 consensus_peers.cc:597] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:07.227030  3342 raft_consensus.cc:2955] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
I20260709 12:15:07.250644  7796 tablet_bootstrap.cc:492] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:15:07.251389  3091 catalog_manager.cc:5697] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index -1 to 10, NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) added. New cstate: current_term: 12 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } } }
W20260709 12:15:07.266033  3305 consensus_peers.cc:597] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:07.266499  3231 consensus_peers.cc:597] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:07.283607  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:07.308868  7805 ts_tablet_manager.cc:933] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:07.322685  3305 consensus_peers.cc:597] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:07.355496  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:07.367384  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:07.371362  7805 tablet_copy_client.cc:323] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.66:38853
W20260709 12:15:07.377949  3075 catalog_manager.cc:4755] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 57c6fad3865d45a1b0c364058f3550b4: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:07.379984  3278 tablet_copy_service.cc:140] P 1ef05c9d901046dca7fe0e638cc693b9: Received BeginTabletCopySession request for tablet c333bd40d0a34c96bb74838b3ea8986c from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:40120)
I20260709 12:15:07.380630  3278 tablet_copy_service.cc:161] P 1ef05c9d901046dca7fe0e638cc693b9: Beginning new tablet copy session on tablet c333bd40d0a34c96bb74838b3ea8986c from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:40120: session id = 6f0cdd57c5934921829c205d32b2b8a5-c333bd40d0a34c96bb74838b3ea8986c
I20260709 12:15:07.396241  3278 tablet_copy_source_session.cc:215] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:07.408830  7807 ts_tablet_manager.cc:933] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:07.426657  7805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c333bd40d0a34c96bb74838b3ea8986c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:07.461781  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:07.462288  7807 tablet_copy_client.cc:323] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.67:35301
I20260709 12:15:07.464216  3352 tablet_copy_service.cc:140] P eb49d92feeb14382b3baa49d696b6141: Received BeginTabletCopySession request for tablet 8dd9302593554fbabfffed2fd5ca4443 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:52822)
I20260709 12:15:07.464804  3352 tablet_copy_service.cc:161] P eb49d92feeb14382b3baa49d696b6141: Beginning new tablet copy session on tablet 8dd9302593554fbabfffed2fd5ca4443 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:52822: session id = 6f0cdd57c5934921829c205d32b2b8a5-8dd9302593554fbabfffed2fd5ca4443
I20260709 12:15:07.474216  3352 tablet_copy_source_session.cc:215] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:07.501775  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd9302593554fbabfffed2fd5ca4443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.525333  7805 tablet_copy_client.cc:806] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:07.535501  7805 tablet_copy_client.cc:670] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:07.545699  7805 tablet_copy_client.cc:538] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:07.616430  7812 ts_tablet_manager.cc:933] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5: Initiating tablet copy from peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:07.628829  7807 tablet_copy_client.cc:806] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
W20260709 12:15:07.628747  3231 consensus_peers.cc:597] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:07.629580  7807 tablet_copy_client.cc:670] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:07.634886  7807 tablet_copy_client.cc:538] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:07.643472  7796 tablet_bootstrap.cc:492] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:07.644898  7807 tablet_bootstrap.cc:492] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:15:07.646471  7805 tablet_bootstrap.cc:492] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
I20260709 12:15:07.647879  7812 tablet_copy_client.cc:323] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Beginning tablet copy session from remote peer at address 127.1.248.66:38853
I20260709 12:15:07.649926  3278 tablet_copy_service.cc:140] P 1ef05c9d901046dca7fe0e638cc693b9: Received BeginTabletCopySession request for tablet 0d98324eb9764f8e9470a5c111b82bb1 from peer 6f0cdd57c5934921829c205d32b2b8a5 ({username='slave'} at 127.0.0.1:40120)
I20260709 12:15:07.650498  3278 tablet_copy_service.cc:161] P 1ef05c9d901046dca7fe0e638cc693b9: Beginning new tablet copy session on tablet 0d98324eb9764f8e9470a5c111b82bb1 from peer 6f0cdd57c5934921829c205d32b2b8a5 at {username='slave'} at 127.0.0.1:40120: session id = 6f0cdd57c5934921829c205d32b2b8a5-0d98324eb9764f8e9470a5c111b82bb1
I20260709 12:15:07.644759  7796 tablet_bootstrap.cc:492] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
W20260709 12:15:07.667536  3231 consensus_peers.cc:597] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:07.674293  3278 tablet_copy_source_session.cc:215] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:07.676206  7796 ts_tablet_manager.cc:1403] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.426s	user 0.046s	sys 0.004s
I20260709 12:15:07.688012  7796 raft_consensus.cc:359] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:15:07.689175  7796 raft_consensus.cc:740] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:15:07.690023  7796 consensus_queue.cc:260] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:15:07.692312  7812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d98324eb9764f8e9470a5c111b82bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.705925  7796 ts_tablet_manager.cc:1434] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 12:15:07.707867  3352 tablet_copy_service.cc:342] P eb49d92feeb14382b3baa49d696b6141: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-8e46c8b6a4494f6d8742bb7ef609d94c received from {username='slave'} at 127.0.0.1:52822
I20260709 12:15:07.708432  3352 tablet_copy_service.cc:434] P eb49d92feeb14382b3baa49d696b6141: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-8e46c8b6a4494f6d8742bb7ef609d94c on tablet 8e46c8b6a4494f6d8742bb7ef609d94c with peer 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:15:07.717275  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:07.739374  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:07.772996  7812 tablet_copy_client.cc:806] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:07.773931  7812 tablet_copy_client.cc:670] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:07.778316  7812 tablet_copy_client.cc:538] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:15:07.801802  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:07.814307  7812 tablet_bootstrap.cc:492] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap starting.
W20260709 12:15:07.817684  2017 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:07.820137  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:07.839407  3305 consensus_peers.cc:597] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:07.847595  7807 tablet_bootstrap.cc:492] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:07.852135  7807 tablet_bootstrap.cc:492] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:15:07.872598  7807 ts_tablet_manager.cc:1403] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.228s	user 0.040s	sys 0.037s
I20260709 12:15:07.877319  7807 raft_consensus.cc:359] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:15:07.878186  7807 raft_consensus.cc:740] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:15:07.878872  7807 consensus_queue.cc:260] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
W20260709 12:15:07.905005  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:07.911482  7807 ts_tablet_manager.cc:1434] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:15:07.920226  3926 raft_consensus.cc:1217] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 12:15:07.921454  3924 raft_consensus.cc:1217] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
W20260709 12:15:07.922901  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:07.931871  3352 tablet_copy_service.cc:342] P eb49d92feeb14382b3baa49d696b6141: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-8dd9302593554fbabfffed2fd5ca4443 received from {username='slave'} at 127.0.0.1:52822
I20260709 12:15:07.932396  3352 tablet_copy_service.cc:434] P eb49d92feeb14382b3baa49d696b6141: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-8dd9302593554fbabfffed2fd5ca4443 on tablet 8dd9302593554fbabfffed2fd5ca4443 with peer 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:15:07.971233  7805 tablet_bootstrap.cc:492] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:15:07.980218  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:07.972293  7805 tablet_bootstrap.cc:492] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:15:08.007233  7805 ts_tablet_manager.cc:1403] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.361s	user 0.038s	sys 0.024s
I20260709 12:15:08.015110  7805 raft_consensus.cc:359] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:15:08.016132  7805 raft_consensus.cc:740] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:15:08.016865  7805 consensus_queue.cc:260] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:15:08.040113  7805 ts_tablet_manager.cc:1434] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:15:08.044510  3278 tablet_copy_service.cc:342] P 1ef05c9d901046dca7fe0e638cc693b9: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-c333bd40d0a34c96bb74838b3ea8986c received from {username='slave'} at 127.0.0.1:40120
I20260709 12:15:08.045015  3278 tablet_copy_service.cc:434] P 1ef05c9d901046dca7fe0e638cc693b9: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-c333bd40d0a34c96bb74838b3ea8986c on tablet c333bd40d0a34c96bb74838b3ea8986c with peer 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:15:08.073581  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:08.105067  3231 consensus_peers.cc:597] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:08.113181  7812 tablet_bootstrap.cc:492] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:08.142743  7812 tablet_bootstrap.cc:492] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5: Bootstrap complete.
I20260709 12:15:08.144308  7812 ts_tablet_manager.cc:1403] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent bootstrapping tablet: real 0.330s	user 0.039s	sys 0.010s
I20260709 12:15:08.167590  7812 raft_consensus.cc:359] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:15:08.171090  7812 raft_consensus.cc:740] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Initialized, Role: LEARNER
I20260709 12:15:08.172019  7812 consensus_queue.cc:260] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: NON_VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: true } }
I20260709 12:15:08.185115  7812 ts_tablet_manager.cc:1434] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:15:08.231079  3278 tablet_copy_service.cc:342] P 1ef05c9d901046dca7fe0e638cc693b9: Request end of tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-0d98324eb9764f8e9470a5c111b82bb1 received from {username='slave'} at 127.0.0.1:40120
I20260709 12:15:08.231593  3278 tablet_copy_service.cc:434] P 1ef05c9d901046dca7fe0e638cc693b9: ending tablet copy session 6f0cdd57c5934921829c205d32b2b8a5-0d98324eb9764f8e9470a5c111b82bb1 on tablet 0d98324eb9764f8e9470a5c111b82bb1 with peer 6f0cdd57c5934921829c205d32b2b8a5
W20260709 12:15:08.347915  3305 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:08.384522  3305 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:08.399899  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:08.470413  3231 consensus_peers.cc:597] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:08.470570  7712 raft_consensus.cc:1064] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:15:08.473160  7712 consensus_queue.cc:237] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:08.489776  3924 raft_consensus.cc:1217] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 12:15:08.506632  7819 raft_consensus.cc:1064] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:15:08.509821  7819 consensus_queue.cc:237] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:08.518304  3924 raft_consensus.cc:1217] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 12:15:08.525115  3924 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:08.527753  7771 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:08.538395  3267 raft_consensus.cc:1275] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:08.541764  7816 consensus_queue.cc:1048] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:15:08.546739  3305 consensus_peers.cc:597] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:08.570457  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:08.572466  3924 raft_consensus.cc:1275] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEARNER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:08.574261  7819 consensus_queue.cc:1048] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:08.576202  7819 raft_consensus.cc:2955] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:08.578106  3924 raft_consensus.cc:2955] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:15:08.607750  3231 consensus_peers.cc:597] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:08.611182  3267 raft_consensus.cc:1275] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Refusing update from remote peer eb49d92feeb14382b3baa49d696b6141: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:08.613871  7771 consensus_queue.cc:1048] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:15:08.625953  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:08.642819  3260 raft_consensus.cc:2955] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:08.644205  3087 catalog_manager.cc:5697] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 reported cstate change: config changed from index 10 to 11, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:08.670343  3895 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:08.684437  3231 consensus_peers.cc:597] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:08.699568  3231 consensus_peers.cc:597] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:08.715513  7819 raft_consensus.cc:2955] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:08.719729  3267 raft_consensus.cc:2955] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:15:08.729298  3231 consensus_peers.cc:597] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:08.750828  3924 raft_consensus.cc:2955] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:08.763687  3086 catalog_manager.cc:5697] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 7 to 8, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "eb49d92feeb14382b3baa49d696b6141" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
W20260709 12:15:08.818670  2017 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:08.844100  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:08.922150  7803 raft_consensus.cc:1064] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
W20260709 12:15:08.953774  3305 consensus_peers.cc:597] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:08.961184  7803 consensus_queue.cc:237] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:08.976989  7802 raft_consensus.cc:1064] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9: attempting to promote NON_VOTER 6f0cdd57c5934921829c205d32b2b8a5 to VOTER
I20260709 12:15:08.979739  7802 consensus_queue.cc:237] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:09.006369  3924 raft_consensus.cc:1275] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEARNER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:09.008078  7691 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:15:09.030587  3305 consensus_peers.cc:597] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:09.035957  3231 consensus_peers.cc:597] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:09.041240  3305 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111) [suppressed 476 similar messages]
I20260709 12:15:09.044906  3342 raft_consensus.cc:1275] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:09.056537  3926 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 LEARNER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:09.059108  7691 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:15:09.067247  3231 consensus_peers.cc:597] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:09.073973  7803 consensus_queue.cc:1048] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:09.090355  3334 raft_consensus.cc:1275] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Refusing update from remote peer 1ef05c9d901046dca7fe0e638cc693b9: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:09.106442  7691 consensus_queue.cc:1048] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:15:09.107582  3305 consensus_peers.cc:597] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:09.116634  7802 raft_consensus.cc:2955] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:09.132107  3335 raft_consensus.cc:2955] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:09.140125  3924 raft_consensus.cc:2955] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:09.146605  3091 catalog_manager.cc:5697] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 7 to 8, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:09.209451  7802 raft_consensus.cc:2955] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:09.224869  3334 raft_consensus.cc:2955] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:09.240397  3924 raft_consensus.cc:2955] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } } }
I20260709 12:15:09.257352  3087 catalog_manager.cc:5697] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 reported cstate change: config changed from index 10 to 11, 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "1ef05c9d901046dca7fe0e638cc693b9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:09.248598  3305 consensus_peers.cc:597] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:09.313620  3305 consensus_peers.cc:597] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:09.328226  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:09.345001  3305 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:09.480872  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:09.512007  3075 catalog_manager.cc:4755] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 57c6fad3865d45a1b0c364058f3550b4: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:09.526918  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:09.530963  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:09.543416  3305 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:09.594365  3305 consensus_peers.cc:597] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:09.663558  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:09.701885  3231 consensus_peers.cc:597] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:09.735366  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:09.802901  3305 consensus_peers.cc:597] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:09.819157  2017 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:09.827950  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:09.906256  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:09.915468  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:09.994453  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:10.032150  3231 consensus_peers.cc:597] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:10.125844  3896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 57466.7us
W20260709 12:15:10.153059  3231 consensus_peers.cc:597] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:10.324144  3231 consensus_peers.cc:597] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:10.335886  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:10.338778  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:10.390537  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:10.456017  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:10.514333  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:10.567788  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:10.635511  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:10.681107  3305 consensus_peers.cc:597] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:10.688431  3231 consensus_peers.cc:597] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:10.803647  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:10.819671  2017 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:10.851632  3305 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:11.032922  3895 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:11.035987  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:11.048760  3231 consensus_peers.cc:597] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:11.091985  3305 consensus_peers.cc:597] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:11.128335  3305 consensus_peers.cc:597] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:11.148989  3231 consensus_peers.cc:597] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:11.158660  3231 consensus_peers.cc:597] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:11.169152  3305 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:11.210449  3231 consensus_peers.cc:597] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:11.310491  3231 consensus_peers.cc:597] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:11.345448  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:11.353828  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:11.422574  3231 consensus_peers.cc:597] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:11.465533  3305 consensus_peers.cc:597] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:11.566855  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:11.632418  3305 consensus_peers.cc:597] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:11.756368  3305 consensus_peers.cc:597] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:11.768286  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:11.802357  3231 consensus_peers.cc:597] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:11.807626  3305 consensus_peers.cc:597] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:11.820161  2017 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:11.869656  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:11.910171  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:11.958220  3305 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:12.043383  3305 consensus_peers.cc:597] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:12.066529  3305 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:12.170205  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:12.183297  3231 consensus_peers.cc:597] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:12.184396  3305 consensus_peers.cc:597] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:12.247042  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:12.309571  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:12.520144  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:12.529714  3231 consensus_peers.cc:597] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:12.605319  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:12.677639  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:12.752303  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:12.771822  3231 consensus_peers.cc:597] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:12.810568  3231 consensus_peers.cc:597] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:12.820725  2017 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:12.826737  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:12.900755  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:12.904838  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:12.905543  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:12.943966  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:13.232898  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:13.329527  3231 consensus_peers.cc:597] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:13.367880  3305 consensus_peers.cc:597] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:13.375028  3305 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:13.442991  3895 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:13.478621  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:13.576382  3231 consensus_peers.cc:597] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:13.578624  3231 consensus_peers.cc:597] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:13.631093  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:13.652968  3231 consensus_peers.cc:597] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:13.660327  3075 catalog_manager.cc:4755] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 57c6fad3865d45a1b0c364058f3550b4: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:13.745869  3231 consensus_peers.cc:597] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:13.786361  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:13.788740  3231 consensus_peers.cc:597] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:13.789665  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:13.793998  3305 consensus_peers.cc:597] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:13.821228  2017 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:13.863024  3305 consensus_peers.cc:597] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:13.885859  3305 consensus_peers.cc:597] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:13.954823  3289 debug-util.cc:398] Leaking SignalData structure 0x7b0800347c20 after lost signal to thread 2020
W20260709 12:15:13.956094  3289 debug-util.cc:398] Leaking SignalData structure 0x7b080022f4a0 after lost signal to thread 3125
W20260709 12:15:13.957523  3289 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6a40 after lost signal to thread 3292
W20260709 12:15:13.958670  3289 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3dc0 after lost signal to thread 3366
W20260709 12:15:13.959928  3289 debug-util.cc:398] Leaking SignalData structure 0x7b08003adce0 after lost signal to thread 3956
W20260709 12:15:13.985275  3305 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:14.046252  3231 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111) [suppressed 467 similar messages]
W20260709 12:15:14.057767  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:14.088070  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:14.163672  3305 consensus_peers.cc:597] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:14.234438  3305 consensus_peers.cc:597] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:14.253286  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:14.436151  3231 consensus_peers.cc:597] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:14.645607  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:14.654466  3231 consensus_peers.cc:597] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:14.656874  3305 consensus_peers.cc:597] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:14.695164  3231 consensus_peers.cc:597] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:14.721050  3305 consensus_peers.cc:597] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:14.821715  3305 consensus_peers.cc:597] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:14.821904  2017 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:14.856245  3305 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:14.900767  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:14.923084  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:14.966854  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:14.989137  3305 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:14.996482  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:15.033939  3231 consensus_peers.cc:597] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:15.058616  3231 consensus_peers.cc:597] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:15.115496  3231 consensus_peers.cc:597] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:15.116961  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:15.237519  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:15.785151  3231 consensus_peers.cc:597] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:15.854574  2017 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:15.879441  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 151381us
W20260709 12:15:15.886034  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 72345.4us
W20260709 12:15:15.946802  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:38853, user_credentials={real_user=slave}} blocked reactor thread for 427019us
W20260709 12:15:15.993710  3305 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:16.092079  3305 consensus_peers.cc:597] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:16.115398  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:16.118353  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:16.119182  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:16.119719  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:16.120242  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:16.122997  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:16.123689  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:16.124128  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:16.213634  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:16.236861  3305 consensus_peers.cc:597] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:16.283536  3895 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:16.292994  3231 consensus_peers.cc:597] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:16.318820  3231 consensus_peers.cc:597] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:16.348894  3305 consensus_peers.cc:597] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:16.402485  3231 consensus_peers.cc:597] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:16.419061  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:16.445045  3231 consensus_peers.cc:597] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:16.458849  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:16.510169  3231 consensus_peers.cc:597] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:16.613955  3305 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:16.634307  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:16.698242  3231 consensus_peers.cc:597] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:16.782568  3305 consensus_peers.cc:597] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:16.826045  3305 consensus_peers.cc:597] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:16.866909  2017 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:16.867460  3305 consensus_peers.cc:597] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:16.872851  3231 consensus_peers.cc:597] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:16.981576  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:17.006639  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:17.009083  3232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:35301, user_credentials={real_user=slave}} blocked reactor thread for 53874us
W20260709 12:15:17.218654  3231 consensus_peers.cc:597] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:17.254770  3305 consensus_peers.cc:597] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:17.266798  3305 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:17.320559  3305 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:17.335714  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:17.438086  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:17.503633  3231 consensus_peers.cc:597] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:17.522589  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:17.525907  3305 consensus_peers.cc:597] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:17.562388  3231 consensus_peers.cc:597] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:17.671463  3305 consensus_peers.cc:597] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:17.750380  3306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:43599, user_credentials={real_user=slave}} blocked reactor thread for 52387.2us
W20260709 12:15:17.776392  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:17.867388  2017 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:18.058938  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 179250us
W20260709 12:15:18.122572  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 240859us
W20260709 12:15:18.182873  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:18.261152  3305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 78327.5us
W20260709 12:15:18.264412  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:18.320571  3231 consensus_peers.cc:597] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:18.328653  3231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:44889, user_credentials={real_user=slave}} blocked reactor thread for 45253.6us
W20260709 12:15:18.332926  3231 consensus_peers.cc:597] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:18.440826  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:18.451354  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:18.452049  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:18.458123  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:18.592245  3895 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:18.577672  3305 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:18.643163  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:18.660266  3231 consensus_peers.cc:597] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:18.670253  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:18.701910  3305 consensus_peers.cc:597] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:18.794441  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:18.805081  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:18.826148  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:18.827857  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:18.867914  2017 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 3214)
W20260709 12:15:18.908113  3305 consensus_peers.cc:597] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:18.914247  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:18.974558  3305 consensus_peers.cc:597] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:18.992969  3231 consensus_peers.cc:597] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:18.998759  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:19.029438  3231 consensus_peers.cc:597] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:19.079061  3231 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111) [suppressed 439 similar messages]
W20260709 12:15:19.215771  3231 consensus_peers.cc:597] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:19.222434  3305 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:19.236449  3231 consensus_peers.cc:597] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:19.251323  3231 consensus_peers.cc:597] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:15:19.254572  2017 tablet_server.cc:196] TabletServer@127.1.248.65:0 shutdown complete.
W20260709 12:15:19.283617  3231 consensus_peers.cc:597] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:19.343164  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:19.557552  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:19.621377  3231 consensus_peers.cc:597] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:19.686339  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:15:19.699801  2017 tablet_server.cc:179] TabletServer@127.1.248.66:0 shutting down...
W20260709 12:15:19.741854  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.742532  3895 consensus_peers.cc:597] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.743129  3305 consensus_peers.cc:597] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:19.749861  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.787739  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.790271  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:19.795346  3305 consensus_peers.cc:597] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:19.796623  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.798385  3305 consensus_peers.cc:597] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.802511  3305 consensus_peers.cc:597] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.800019  3895 consensus_peers.cc:597] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.804996  3305 consensus_peers.cc:597] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.805939  3305 consensus_peers.cc:597] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.811785  3305 consensus_peers.cc:597] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.813799  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.814682  3305 consensus_peers.cc:597] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.828507  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.829169  3305 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.838128  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.841221  3231 consensus_peers.cc:597] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:19.846168  3305 consensus_peers.cc:597] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.861147  3895 consensus_peers.cc:597] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.864481  3305 consensus_peers.cc:597] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:19.867559  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.872392  3305 consensus_peers.cc:597] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:19.886633  3895 consensus_peers.cc:597] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.895978  3305 consensus_peers.cc:597] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.898504  3895 consensus_peers.cc:597] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.903062  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.924033  3895 consensus_peers.cc:597] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.948729  3305 consensus_peers.cc:597] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.949712  3895 consensus_peers.cc:597] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:19.968382  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:19.972293  2017 tablet_replica.cc:333] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
W20260709 12:15:19.985460  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:19.986953  2017 raft_consensus.cc:2243] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:19.987643  3305 consensus_peers.cc:597] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.989892  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.991011  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:19.991700  2017 raft_consensus.cc:2272] T 53307990662b42ecae5100eb9bdb80b6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:19.995442  2017 tablet_replica.cc:333] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.001237  2017 raft_consensus.cc:2243] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.003326  2017 raft_consensus.cc:2272] T c333bd40d0a34c96bb74838b3ea8986c P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.017144  2017 tablet_replica.cc:333] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
W20260709 12:15:20.025763  3895 consensus_peers.cc:597] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:20.033180  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:20.034580  2017 raft_consensus.cc:2243] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.035918  2017 raft_consensus.cc:2272] T 8e46c8b6a4494f6d8742bb7ef609d94c P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.037065  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:20.037724  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:20.039598  2017 tablet_replica.cc:333] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.040606  2017 raft_consensus.cc:2243] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.042059  2017 raft_consensus.cc:2272] T 5f390a5a17da4b61aa47d48ea74bae91 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.045324  2017 tablet_replica.cc:333] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.046316  2017 raft_consensus.cc:2243] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.047154  2017 raft_consensus.cc:2272] T 960fd01223d4443593561ba739ba7ec9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.049460  3305 consensus_peers.cc:597] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:20.050503  2017 tablet_replica.cc:333] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.052014  2017 raft_consensus.cc:2243] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.052930  2017 raft_consensus.cc:2272] T 5bb25fe7122b4568ac690e16b514ee7d P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.056357  2017 tablet_replica.cc:333] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.057337  2017 raft_consensus.cc:2243] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.058049  2017 raft_consensus.cc:2272] T 68838261f2ca456f9b5583e60f9f3d2c P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.061527  2017 tablet_replica.cc:333] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.065171  2017 raft_consensus.cc:2243] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.066694  2017 raft_consensus.cc:2272] T 1aa66ee25a6347bf8c52ec788a373117 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.073422  2017 tablet_replica.cc:333] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.074411  2017 raft_consensus.cc:2243] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.075695  2017 raft_consensus.cc:2272] T 21a56ad7de6f43239e103edd8e2b159f P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.077673  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:20.079164  2017 tablet_replica.cc:333] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.080480  2017 raft_consensus.cc:2243] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.081724  2017 raft_consensus.cc:2272] T 9ec2274893aa4cc087f9d4af8119b1ea P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.085210  2017 tablet_replica.cc:333] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.086326  2017 raft_consensus.cc:2243] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.087668  2017 raft_consensus.cc:2272] T ebb8348062364c7c878da1d2999c325b P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.090997  2017 tablet_replica.cc:333] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.092041  2017 raft_consensus.cc:2243] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.092777  2017 raft_consensus.cc:2272] T 9796736c241b42c283a7f6a433742bed P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.097353  2017 tablet_replica.cc:333] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.098505  2017 raft_consensus.cc:2243] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.099328  2017 raft_consensus.cc:2272] T 5e285af011d44cfc91bcd6499aa4c9f8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.102790  2017 tablet_replica.cc:333] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.103783  2017 raft_consensus.cc:2243] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.105063  2017 raft_consensus.cc:2272] T 8c298faf2e6b4619a5c83569e86043e8 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.107996  2017 tablet_replica.cc:333] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.108925  2017 raft_consensus.cc:2243] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.110114  2017 raft_consensus.cc:2272] T 8939008df61a42b5ab6d01a5cc782e16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.113107  2017 tablet_replica.cc:333] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.114045  2017 raft_consensus.cc:2243] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.114785  2017 raft_consensus.cc:2272] T 90c20968bf7e4f29893d6df711ca41d1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.118024  2017 tablet_replica.cc:333] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.118989  2017 raft_consensus.cc:2243] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.120428  2017 raft_consensus.cc:2272] T f72e701fa9c047c59371e2759c4303ab P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.123870  2017 tablet_replica.cc:333] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.124938  2017 raft_consensus.cc:2243] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:15:20.125505  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:20.126458  2017 raft_consensus.cc:2272] T cab3ecc4f0b34068a804b174b02b9a16 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.129916  2017 tablet_replica.cc:333] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.131057  2017 raft_consensus.cc:2243] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.132010  2017 raft_consensus.cc:2272] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.135159  2017 tablet_replica.cc:333] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.136133  2017 raft_consensus.cc:2243] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.137001  2017 raft_consensus.cc:2272] T 5a33bf1d7b914771971f31da16c86c31 P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.148967  2017 tablet_replica.cc:333] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.158280  2017 raft_consensus.cc:2243] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.159009  2017 raft_consensus.cc:2272] T ea1a64c911894ce08c1622f9307ed513 P 1ef05c9d901046dca7fe0e638cc693b9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.162823  2017 tablet_replica.cc:333] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.163908  2017 raft_consensus.cc:2243] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.164582  2017 raft_consensus.cc:2272] T 1c7c3fc93e9d456eb83867c8095af00c P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.167457  2017 tablet_replica.cc:333] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.170310  2017 raft_consensus.cc:2243] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.171667  2017 raft_consensus.cc:2272] T a10fd7fda53e4a8ea272336588c66980 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.173926  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:20.185889  2017 tablet_replica.cc:333] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.193051  2017 raft_consensus.cc:2243] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.193898  2017 raft_consensus.cc:2272] T 4338ede94a794c41ba16cba6ac585f9a P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.197382  2017 tablet_replica.cc:333] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.227629  2017 raft_consensus.cc:2243] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.229799  2017 raft_consensus.cc:2272] T 0d98324eb9764f8e9470a5c111b82bb1 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.266530  2017 tablet_replica.cc:333] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.272670  2017 raft_consensus.cc:2243] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.273638  2017 raft_consensus.cc:2272] T 09cb299c977a476ab873860cf7e2a44c P 1ef05c9d901046dca7fe0e638cc693b9 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.291996  2017 tablet_replica.cc:333] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.293735  2017 raft_consensus.cc:2243] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.294806  2017 raft_consensus.cc:2272] T e227a6b3f36540848b2525ba007e6a35 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.297719  2017 tablet_replica.cc:333] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
W20260709 12:15:20.329888  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:15:20.298632  2017 raft_consensus.cc:2243] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.344461  2017 raft_consensus.cc:2272] T eb7809b208b14a549539330993804c34 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.349900  3231 consensus_peers.cc:597] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:20.368837  2017 tablet_replica.cc:333] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.385010  2017 raft_consensus.cc:2243] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:20.403102  3305 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:20.406162  3305 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:20.411149  2017 raft_consensus.cc:2272] T 37160a9f5c0a4847b38b9c87a80891de P 1ef05c9d901046dca7fe0e638cc693b9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.419699  2017 tablet_replica.cc:333] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.430452  2017 raft_consensus.cc:2243] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.432651  2017 raft_consensus.cc:2272] T 8dd9302593554fbabfffed2fd5ca4443 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.437178  2017 tablet_replica.cc:333] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.444901  2017 raft_consensus.cc:2243] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.451206  2017 raft_consensus.cc:2272] T 49089e729c0f4f37b66d40abf2e3cfe6 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.453755  2017 tablet_replica.cc:333] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.460579  2017 raft_consensus.cc:2243] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.465698  2017 raft_consensus.cc:2272] T a85351bf981e43bea61620452a2c7b3a P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.475565  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:15:20.481838  2017 tablet_replica.cc:333] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.482511  2017 raft_consensus.cc:2243] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.483119  2017 raft_consensus.cc:2272] T 57d85bc226d34560b470d2d44e89c8cc P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.485865  2017 tablet_replica.cc:333] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.500062  2017 raft_consensus.cc:2243] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:20.502388  3305 consensus_peers.cc:597] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:20.503460  2017 raft_consensus.cc:2272] T 57c6fad3865d45a1b0c364058f3550b4 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.513979  2017 tablet_replica.cc:333] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.520083  2017 raft_consensus.cc:2243] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.520809  2017 raft_consensus.cc:2272] T 34a1a5138f6d495dbacdde8c4b4dd898 P 1ef05c9d901046dca7fe0e638cc693b9 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.524194  3305 consensus_peers.cc:597] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:20.536567  2017 tablet_replica.cc:333] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.537492  2017 raft_consensus.cc:2243] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.540437  2017 raft_consensus.cc:2272] T 4a4e9fd123b2418a86c69f2894fd2f4f P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.560197  2017 tablet_replica.cc:333] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.564075  2017 raft_consensus.cc:2243] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.571923  2017 raft_consensus.cc:2272] T 9ee459e79aec45909d356d039c69e72c P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.581632  2017 tablet_replica.cc:333] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
W20260709 12:15:20.595394  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:15:20.603163  2017 raft_consensus.cc:2243] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.604182  2017 raft_consensus.cc:2272] T 94318f741f4143469cf9140cb1be3c4c P 1ef05c9d901046dca7fe0e638cc693b9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.614137  2017 tablet_replica.cc:333] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.620164  2017 raft_consensus.cc:2243] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.621649  2017 raft_consensus.cc:2272] T c34244f67d5045c49554e8a2ce27891d P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.634970  3305 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:20.637127  2017 tablet_replica.cc:333] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.644225  2017 raft_consensus.cc:2243] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.645604  2017 raft_consensus.cc:2272] T ac73674a60ce47a481b9d61f7e78e5f3 P 1ef05c9d901046dca7fe0e638cc693b9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.654039  2017 tablet_replica.cc:333] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.664099  2017 raft_consensus.cc:2243] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.665763  2017 raft_consensus.cc:2272] T afca51be89bf4a7681690f9913aa6f82 P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.669046  7919 raft_consensus.cc:493] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:20.669714  7919 raft_consensus.cc:515] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:20.675475  7919 leader_election.cc:290] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:20.678056  3231 leader_election.cc:336] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:20.678678  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974711b37af4153b756b212bffc5915" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:20.680757  3232 leader_election.cc:304] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:20.681638  2017 tablet_replica.cc:333] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.682576  2017 raft_consensus.cc:2243] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.683372  2017 raft_consensus.cc:2272] T 214d209d2c0940c1a4c43e368fff9e23 P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.687605  7919 raft_consensus.cc:2749] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:20.705991  2017 tablet_replica.cc:333] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.706957  2017 raft_consensus.cc:2243] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.711997  2017 raft_consensus.cc:2272] T b9471f19ecb64571bc899936c896d99f P 1ef05c9d901046dca7fe0e638cc693b9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.714551  2017 tablet_replica.cc:333] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.715152  2017 raft_consensus.cc:2243] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.716181  2017 raft_consensus.cc:2272] T c79ed88d91bd49d4a95c3eb59fb97a63 P 1ef05c9d901046dca7fe0e638cc693b9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.716252  7919 raft_consensus.cc:493] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:20.716884  7919 raft_consensus.cc:515] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:20.719048  7919 leader_election.cc:290] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:20.719205  2017 tablet_replica.cc:333] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.720112  2017 raft_consensus.cc:2243] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.720562  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a515efb7c674e9997a33098bc2d7002" candidate_uuid: "1ef05c9d901046dca7fe0e638cc693b9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:20.721097  2017 raft_consensus.cc:2272] T c7482671d98f47899c1d11f810abadb7 P 1ef05c9d901046dca7fe0e638cc693b9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.724596  2017 tablet_replica.cc:333] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.725498  2017 raft_consensus.cc:2243] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 LEADER]: Raft consensus shutting down.
W20260709 12:15:20.725836  3231 leader_election.cc:336] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:20.726333  3231 leader_election.cc:304] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ef05c9d901046dca7fe0e638cc693b9; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:20.726934  2017 raft_consensus.cc:2272] T 132b388f4bf24fd482334847aadc601a P 1ef05c9d901046dca7fe0e638cc693b9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.729825  2017 tablet_replica.cc:333] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.729903  7919 raft_consensus.cc:2749] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:20.730576  2017 raft_consensus.cc:2243] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.731312  2017 raft_consensus.cc:2272] T e974711b37af4153b756b212bffc5915 P 1ef05c9d901046dca7fe0e638cc693b9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.733949  2017 tablet_replica.cc:333] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.734668  2017 raft_consensus.cc:2243] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.736871  2017 raft_consensus.cc:2272] T 7a515efb7c674e9997a33098bc2d7002 P 1ef05c9d901046dca7fe0e638cc693b9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.739537  2017 tablet_replica.cc:333] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9: stopping tablet replica
I20260709 12:15:20.740163  2017 raft_consensus.cc:2243] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.740762  2017 raft_consensus.cc:2272] T 72176593f52b48c28602984ef9c8ee6b P 1ef05c9d901046dca7fe0e638cc693b9 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.788403  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:20.844445  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:20.846588  3305 consensus_peers.cc:597] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:20.858132  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:20.868748  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:20.881752  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:20.894666  7913 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:20.895795  7913 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:20.907222  7913 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:20.909144  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:15:20.917085  3895 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:20.917588  3895 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:20.919705  7913 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:20.938793  3895 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:21.085403  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:21.096370  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:15:21.172747  7928 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.173316  7928 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:21.175395  7928 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:21.192318  3895 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:15:21.197309  7877 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.197901  7877 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:15:21.199966  3305 leader_election.cc:336] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:21.201889  7877 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:21.204257  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
W20260709 12:15:21.203220  3305 leader_election.cc:336] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:21.218101  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:15:21.213433  3895 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:21.224009  7928 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:21.226477  3895 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:21.228036  7928 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.229871  7877 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:21.230038  7928 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:21.231037  3895 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:21.232302  7928 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:21.256036  7877 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.256616  7877 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:21.258543  7877 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:21.265650  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:21.269279  3305 leader_election.cc:336] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:21.274199  3895 leader_election.cc:336] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:21.277360  3895 leader_election.cc:336] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:21.279601  3895 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:15:21.276178  3305 leader_election.cc:336] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:21.280490  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:21.281483  7928 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:21.282430  7913 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:21.302655  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:21.360314  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:21.370481  7928 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.371045  7928 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:21.373558  7928 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:15:21.374679  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
W20260709 12:15:21.378700  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:21.384457  3305 leader_election.cc:336] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:21.384989  3305 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 6f0cdd57c5934921829c205d32b2b8a5
I20260709 12:15:21.388051  7928 raft_consensus.cc:2749] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:21.442909  7928 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.443480  7928 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:21.447108  7928 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:15:21.447263  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:15:21.447928  3931 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
W20260709 12:15:21.452418  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:21.460723  7928 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.461336  7928 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:21.463454  7928 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:21.464787  3305 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:21.474746  3305 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:21.475354  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:21.476248  7928 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:21.490206  3305 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:21.494154  3305 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:21.494699  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:21.495502  7928 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:21.525651  7877 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.526355  7877 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:21.528445  7877 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:21.529568  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141" is_pre_election: true
I20260709 12:15:21.530241  3334 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 10.
I20260709 12:15:21.531746  3896 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 
I20260709 12:15:21.532882  7877 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:21.533656  7877 raft_consensus.cc:493] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.534044  7877 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:21.534443  3895 leader_election.cc:336] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:21.545413  7928 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.546038  7928 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:21.548254  7928 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:21.600850  7877 raft_consensus.cc:515] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:15:21.613129  3305 consensus_peers.cc:597] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:15:21.615446  3334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c298faf2e6b4619a5c83569e86043e8" candidate_uuid: "6f0cdd57c5934921829c205d32b2b8a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb49d92feeb14382b3baa49d696b6141"
I20260709 12:15:21.616639  7877 leader_election.cc:290] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Requested vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:21.618922  3895 leader_election.cc:336] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:21.627558  3334 raft_consensus.cc:3060] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:21.628294  3305 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:21.632738  3305 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:21.634243  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:21.635236  7928 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:21.635689  3334 raft_consensus.cc:2468] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0cdd57c5934921829c205d32b2b8a5 in term 11.
I20260709 12:15:21.637429  3896 leader_election.cc:304] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9
I20260709 12:15:21.638725  7877 raft_consensus.cc:2804] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:21.643626  7877 raft_consensus.cc:697] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 LEADER]: Becoming Leader. State: Replica: 6f0cdd57c5934921829c205d32b2b8a5, State: Running, Role: LEADER
I20260709 12:15:21.645829  7877 consensus_queue.cc:237] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:21.691687  7928 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.692237  7928 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:21.694564  7928 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:21.720616  3091 catalog_manager.cc:5697] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 reported cstate change: term changed from 10 to 11, leader changed from 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66) to 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68). New cstate: current_term: 11 leader_uuid: "6f0cdd57c5934921829c205d32b2b8a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:21.726191  7928 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.726902  7928 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:21.731479  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:15:21.732239  3931 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 12.
I20260709 12:15:21.737264  7928 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:15:21.748409  7928 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.749053  7928 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:21.754662  7928 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:21.770776  3305 consensus_peers.cc:597] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:21.779680  3305 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:21.788887  3305 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:21.789410  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:15:21.791939  3305 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:21.798257  3305 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:21.798862  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:21.799710  7928 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:21.800532  7926 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:21.812165  3305 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:21.828899  3305 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:21.832151  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:21.837523  7926 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:21.865727  3305 consensus_peers.cc:597] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:21.866674  7926 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.867304  7926 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:21.869609  7926 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:21.898483  3305 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:21.912143  2017 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3289)
W20260709 12:15:21.920796  3305 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:21.921404  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:21.922389  7926 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:21.938117  7939 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:21.938726  7939 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:21.941332  7939 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:21.964812  3075 catalog_manager.cc:4755] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 57c6fad3865d45a1b0c364058f3550b4: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:21.980806  3305 leader_election.cc:336] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:21.989876  3305 leader_election.cc:336] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:21.990459  3305 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:22.008844  7939 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:22.041256  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:22.050969  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:22.078156  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.078758  3895 consensus_peers.cc:597] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.115770  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:22.118836  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.123203  3305 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:22.136330  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:22.141072  7928 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:22.141659  7928 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:22.144027  3305 consensus_peers.cc:597] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:22.144649  7928 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:22.156582  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.183797  3305 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:22.185463  3305 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:22.185933  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:22.186676  7928 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:22.189083  3305 consensus_peers.cc:597] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.189612  3305 consensus_peers.cc:597] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.192585  3305 consensus_peers.cc:597] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.212196  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:22.229318  3895 consensus_peers.cc:597] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:22.229908  3895 consensus_peers.cc:597] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.230597  3305 consensus_peers.cc:597] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.252193  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:22.254940  3334 raft_consensus.cc:1275] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Refusing update from remote peer 6f0cdd57c5934921829c205d32b2b8a5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:22.256438  7913 consensus_queue.cc:1048] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:15:22.256747  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:22.319248  3305 consensus_peers.cc:597] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:22.340193  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.344242  3895 consensus_peers.cc:597] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.354436  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.357821  3305 consensus_peers.cc:597] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:22.367238  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.379987  3305 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.396725  3305 consensus_peers.cc:597] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.417028  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.440407  3895 consensus_peers.cc:597] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.452275  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.456218  3305 consensus_peers.cc:597] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.469799  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.473624  3895 consensus_peers.cc:597] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.477905  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.485642  3305 consensus_peers.cc:597] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:22.513895  3305 consensus_peers.cc:597] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:22.550527  3305 consensus_peers.cc:597] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.563241  3895 consensus_peers.cc:597] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.572453  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.595595  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.596182  3305 consensus_peers.cc:597] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.592630  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.723699  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:22.746239  3895 consensus_peers.cc:597] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.746819  3895 consensus_peers.cc:597] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.748713  3305 consensus_peers.cc:597] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:22.780545  7928 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:22.781255  7928 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:22.783636  7928 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:22.836972  3305 leader_election.cc:336] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:22.842689  3305 leader_election.cc:336] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:22.843192  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:22.850126  7928 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:22.886793  3305 consensus_peers.cc:597] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:22.887357  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:22.891359  7944 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:22.891989  7944 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:22.894289  7944 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:22.913220  2017 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 3289)
W20260709 12:15:22.929813  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:22.930464  3895 leader_election.cc:336] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:22.941687  3895 leader_election.cc:336] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:22.942219  3895 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:22.949774  7913 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:22.961673  3305 consensus_peers.cc:597] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:22.973062  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:22.983263  3305 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:22.983950  3305 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:23.020001  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:23.099169  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:15:23.114297  7928 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:23.115669  7928 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:23.121039  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:15:23.121773  3928 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
I20260709 12:15:23.123248  7928 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:15:23.161708  3305 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:23.166404  3305 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:23.194172  3305 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:23.194675  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:23.199491  7928 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:23.229460  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:23.461911  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:23.469726  7928 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:23.470232  7928 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
W20260709 12:15:23.472756  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:15:23.483258  7928 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:23.488437  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:23.516336  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:15:23.517885  7928 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:23.518389  7928 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:23.520203  7928 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:23.521245  7928 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:23.521665  7928 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:23.523380  7928 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:23.525449  3895 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:23.547547  7956 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:23.548144  7956 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:23.550443  7956 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
I20260709 12:15:23.551687  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:15:23.552000  7928 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:23.552405  3931 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 12.
I20260709 12:15:23.552655  7928 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:23.554636  7928 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
I20260709 12:15:23.555574  7928 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:23.556108  7928 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:23.558329  7928 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:23.600472  3305 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:23.615350  3305 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:23.620568  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:23.622840  7956 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:23.624570  3305 consensus_peers.cc:597] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:23.625111  3305 leader_election.cc:336] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:23.625641  3305 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:23.643977  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:23.679298  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:15:23.683285  7956 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:23.683931  7956 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:23.686259  7956 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:23.688930  3305 leader_election.cc:336] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:23.689432  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:23.693188  7956 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:23.696862  3305 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:23.697371  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:23.700587  7956 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:23.702392  3305 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:23.705588  3305 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:23.706122  3305 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:23.707391  3305 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:23.707829  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:23.709378  7956 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:23.714732  7956 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:23.715328  7956 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:23.717782  7956 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:23.732232  3305 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:23.732793  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:23.733542  7956 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:23.734620  3305 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:23.735054  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:23.737457  7956 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:23.825909  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:23.824247  3305 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:23.832440  3305 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:23.835103  3305 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:23.835546  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:23.840268  7956 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:23.842837  3305 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:23.844866  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:23.846457  7956 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:23.898871  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:15:23.902308  7956 raft_consensus.cc:493] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:23.902920  7956 raft_consensus.cc:515] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:23.905202  7956 leader_election.cc:290] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:23.913739  2017 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 3289)
W20260709 12:15:23.938166  3305 leader_election.cc:336] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:23.943773  3305 leader_election.cc:336] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:23.944263  3305 leader_election.cc:304] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:23.945034  7956 raft_consensus.cc:2749] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:23.956017  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:24.073604  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:24.084559  3305 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111) [suppressed 760 similar messages]
W20260709 12:15:24.276523  3305 consensus_peers.cc:597] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:24.332422  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:24.396283  3305 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:24.583534  3305 consensus_peers.cc:597] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.593876  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.602029  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.644310  3305 consensus_peers.cc:597] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:15:24.651602  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.651615  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:24.652513  3305 consensus_peers.cc:597] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.661464  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.667682  3305 consensus_peers.cc:597] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.669677  3895 consensus_peers.cc:597] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.678217  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.693562  3895 consensus_peers.cc:597] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.693849  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:24.720618  3305 consensus_peers.cc:597] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.733944  3895 consensus_peers.cc:597] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:24.734702  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.746244  3305 consensus_peers.cc:597] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:24.762952  3895 consensus_peers.cc:597] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.821463  3305 consensus_peers.cc:597] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.853317  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:24.854801  7955 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:24.856029  7955 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:24.859282  7955 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:24.862708  3305 consensus_peers.cc:597] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.868522  3895 leader_election.cc:336] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:24.871229  3895 leader_election.cc:336] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:24.871768  3895 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:24.872678  7955 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:24.876890  3305 consensus_peers.cc:597] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.898190  3305 consensus_peers.cc:597] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.914563  3305 consensus_peers.cc:597] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.949039  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.958038  3305 consensus_peers.cc:597] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:24.958069  3895 consensus_peers.cc:597] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.958741  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:24.973802  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:25.026741  3305 consensus_peers.cc:597] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.046978  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.054915  3305 consensus_peers.cc:597] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:25.069674  3305 consensus_peers.cc:597] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.088510  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.107623  3895 consensus_peers.cc:597] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.115214  3305 consensus_peers.cc:597] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:25.140184  3895 consensus_peers.cc:597] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.149247  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.172794  3305 consensus_peers.cc:597] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:25.173616  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.174304  3895 consensus_peers.cc:597] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.192346  3305 consensus_peers.cc:597] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.199651  3895 consensus_peers.cc:597] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.231141  3305 consensus_peers.cc:597] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:25.234882  3305 consensus_peers.cc:597] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.348628  3305 consensus_peers.cc:597] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.366340  3305 consensus_peers.cc:597] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:25.369125  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:15:25.402437  7956 raft_consensus.cc:493] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:25.403216  7956 raft_consensus.cc:515] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:25.405668  7956 leader_election.cc:290] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:25.414430  3305 leader_election.cc:336] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:25.415717  3305 leader_election.cc:336] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:25.416165  3305 leader_election.cc:304] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:25.417101  7960 raft_consensus.cc:2749] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:25.420310  3305 consensus_peers.cc:597] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:15:25.428097  7960 raft_consensus.cc:493] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:25.428936  7960 raft_consensus.cc:515] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:25.431505  7960 leader_election.cc:290] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:25.441273  3305 leader_election.cc:336] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:25.442144  3305 leader_election.cc:336] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:25.442636  3305 leader_election.cc:304] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:25.443449  7960 raft_consensus.cc:2749] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:25.467305  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:25.493393  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:25.497638  3305 consensus_peers.cc:597] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:15:25.513095  7960 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:25.513933  7960 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:25.529422  7960 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:15:25.530510  3305 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:25.531256  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d98324eb9764f8e9470a5c111b82bb1" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:15:25.532985  3931 raft_consensus.cc:2468] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 12.
I20260709 12:15:25.543016  7967 raft_consensus.cc:493] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:25.544941  7967 raft_consensus.cc:515] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:25.547155  7967 leader_election.cc:290] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:25.558444  3305 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:25.558868  3305 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:25.560447  7967 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:25.594993  3305 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:25.603459  3305 leader_election.cc:336] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:25.604105  3305 leader_election.cc:304] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:25.613107  7967 raft_consensus.cc:2749] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:25.621956  3305 consensus_peers.cc:597] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:15:25.624202  2017 tablet_server.cc:196] TabletServer@127.1.248.66:0 shutdown complete.
W20260709 12:15:25.657485  3305 consensus_peers.cc:597] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:15:25.672441  3305 consensus_peers.cc:597] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:25.689661  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:15:25.696141  3305 consensus_peers.cc:597] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:15:25.706923  7967 raft_consensus.cc:493] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:25.707657  7967 raft_consensus.cc:515] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:25.709975  7967 leader_election.cc:290] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:25.718732  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:25.741325  3305 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:25.744429  3305 leader_election.cc:336] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:25.745363  3305 leader_election.cc:304] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:25.746459  7967 raft_consensus.cc:2749] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:25.816931  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:25.855993  3305 consensus_peers.cc:597] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:25.858244  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:15:25.939924  7967 raft_consensus.cc:493] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:25.940452  7967 raft_consensus.cc:515] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:25.955713  7967 leader_election.cc:290] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:25.987565  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:15:25.991134  7968 raft_consensus.cc:493] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:25.991822  7968 raft_consensus.cc:515] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:25.993911  7968 leader_election.cc:290] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:26.001014  3305 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:26.002689  3305 leader_election.cc:336] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:26.003590  3305 leader_election.cc:304] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:26.004480  7968 raft_consensus.cc:2749] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:26.010188  3305 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:26.011898  3305 leader_election.cc:336] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:26.013221  3305 leader_election.cc:304] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:26.016888  7968 raft_consensus.cc:2749] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:26.055277  7968 raft_consensus.cc:493] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:26.055929  7968 raft_consensus.cc:515] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:26.059958  2017 tablet_server.cc:179] TabletServer@127.1.248.67:0 shutting down...
I20260709 12:15:26.060560  7968 leader_election.cc:290] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:26.072777  3305 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:26.085091  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:26.100965  3305 leader_election.cc:336] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:26.102054  3305 leader_election.cc:304] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:26.103374  7968 raft_consensus.cc:2749] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:26.107010  3896 consensus_peers.cc:597] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:26.119047  3305 consensus_peers.cc:597] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:15:26.132061  7967 raft_consensus.cc:493] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:26.132718  7967 raft_consensus.cc:515] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } }
I20260709 12:15:26.135228  7967 leader_election.cc:290] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:26.149950  3305 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:26.154469  3305 leader_election.cc:336] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:26.155025  3305 leader_election.cc:304] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:26.155930  7967 raft_consensus.cc:2749] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:26.186856  3896 consensus_peers.cc:597] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:26.202147  3896 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:26.211786  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:15:26.229909  3896 consensus_peers.cc:597] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:26.241603  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:26.248106  2017 tablet_replica.cc:333] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.258777  2017 raft_consensus.cc:2243] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.262589  2017 raft_consensus.cc:2272] T 8e46c8b6a4494f6d8742bb7ef609d94c P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:26.263551  3896 consensus_peers.cc:597] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:26.273209  3896 consensus_peers.cc:597] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:26.277058  2017 tablet_replica.cc:333] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.286584  2017 raft_consensus.cc:2243] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.287555  2017 raft_consensus.cc:2272] T 214d209d2c0940c1a4c43e368fff9e23 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:26.289268  3896 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:26.290619  2017 tablet_replica.cc:333] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.296181  2017 raft_consensus.cc:2243] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.296967  2017 raft_consensus.cc:2272] T 21a56ad7de6f43239e103edd8e2b159f P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.301855  2017 tablet_replica.cc:333] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.304989  2017 raft_consensus.cc:2243] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:26.313095  3896 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:26.316195  2017 raft_consensus.cc:2272] T 5f390a5a17da4b61aa47d48ea74bae91 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.316195  7954 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:26.317039  7954 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:26.319630  2017 tablet_replica.cc:333] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.320658  2017 raft_consensus.cc:2243] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.321604  2017 raft_consensus.cc:2272] T 53307990662b42ecae5100eb9bdb80b6 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.324963  2017 tablet_replica.cc:333] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.332746  7967 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
W20260709 12:15:26.336093  3895 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:26.335842  7967 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:26.338538  7967 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), 6f0cdd57c5934921829c205d32b2b8a5 (127.1.248.68:43599)
W20260709 12:15:26.334901  3896 consensus_peers.cc:597] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:26.339671  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c333bd40d0a34c96bb74838b3ea8986c" candidate_uuid: "eb49d92feeb14382b3baa49d696b6141" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f0cdd57c5934921829c205d32b2b8a5" is_pre_election: true
I20260709 12:15:26.340348  3930 raft_consensus.cc:2468] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb49d92feeb14382b3baa49d696b6141 in term 10.
I20260709 12:15:26.341578  2017 raft_consensus.cc:2243] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.343799  2017 raft_consensus.cc:2272] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:26.344430  3896 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:26.344929  3896 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:26.338905  7954 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:26.345840  7961 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:26.349298  2017 tablet_replica.cc:333] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.350306  2017 raft_consensus.cc:2243] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.351662  2017 raft_consensus.cc:2272] T 960fd01223d4443593561ba739ba7ec9 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.354663  2017 tablet_replica.cc:333] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.356809  2017 raft_consensus.cc:2243] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:26.359623  3305 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:26.360795  2017 raft_consensus.cc:2272] T ac73674a60ce47a481b9d61f7e78e5f3 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:26.361651  3305 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:26.362180  3305 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5, eb49d92feeb14382b3baa49d696b6141; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
W20260709 12:15:26.362977  3305 raft_consensus.cc:2686] T c333bd40d0a34c96bb74838b3ea8986c P eb49d92feeb14382b3baa49d696b6141: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:15:26.374133  3896 consensus_peers.cc:597] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:26.363798  2017 tablet_replica.cc:333] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.376358  2017 raft_consensus.cc:2243] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.378356  2017 raft_consensus.cc:2272] T e227a6b3f36540848b2525ba007e6a35 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.381932  2017 tablet_replica.cc:333] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.382989  2017 raft_consensus.cc:2243] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.384109  2017 raft_consensus.cc:2272] T 09cb299c977a476ab873860cf7e2a44c P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.387156  2017 tablet_replica.cc:333] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.396229  2017 raft_consensus.cc:2243] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.397606  2017 raft_consensus.cc:2272] T 5bb25fe7122b4568ac690e16b514ee7d P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.406942  2017 tablet_replica.cc:333] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.412202  2017 raft_consensus.cc:2243] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.413681  2017 raft_consensus.cc:2272] T 68838261f2ca456f9b5583e60f9f3d2c P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.416724  2017 tablet_replica.cc:333] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
W20260709 12:15:26.418038  3896 consensus_peers.cc:597] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:26.427676  2017 raft_consensus.cc:2243] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.428515  2017 raft_consensus.cc:2272] T 1aa66ee25a6347bf8c52ec788a373117 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.431561  2017 tablet_replica.cc:333] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.432472  2017 raft_consensus.cc:2243] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.433184  2017 raft_consensus.cc:2272] T 9ec2274893aa4cc087f9d4af8119b1ea P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.436486  2017 tablet_replica.cc:333] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
W20260709 12:15:26.442274  3896 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:26.447996  2017 raft_consensus.cc:2243] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.448748  2017 raft_consensus.cc:2272] T acb4310417b348518d7accdf0538e249 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.452307  2017 tablet_replica.cc:333] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.453557  2017 raft_consensus.cc:2243] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.456562  2017 raft_consensus.cc:2272] T ea1a64c911894ce08c1622f9307ed513 P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.460629  2017 tablet_replica.cc:333] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.476162  2017 raft_consensus.cc:2243] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.477645  2017 raft_consensus.cc:2272] T 1c7c3fc93e9d456eb83867c8095af00c P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.480556  2017 tablet_replica.cc:333] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.481657  2017 raft_consensus.cc:2243] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.482340  2017 raft_consensus.cc:2272] T 8c298faf2e6b4619a5c83569e86043e8 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.485198  2017 tablet_replica.cc:333] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.486111  2017 raft_consensus.cc:2243] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.486888  2017 raft_consensus.cc:2272] T 5e285af011d44cfc91bcd6499aa4c9f8 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.489984  2017 tablet_replica.cc:333] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.495777  2017 raft_consensus.cc:2243] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.497388  2017 raft_consensus.cc:2272] T 4d7af9c2d6334c6f84aed4586a66d701 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.507419  2017 tablet_replica.cc:333] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.508333  2017 raft_consensus.cc:2243] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.509721  2017 raft_consensus.cc:2272] T 90c20968bf7e4f29893d6df711ca41d1 P eb49d92feeb14382b3baa49d696b6141 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.512724  2017 tablet_replica.cc:333] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.516067  2017 raft_consensus.cc:2243] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.516798  2017 raft_consensus.cc:2272] T f72e701fa9c047c59371e2759c4303ab P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.522369  2017 tablet_replica.cc:333] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.525460  2017 raft_consensus.cc:2243] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.526294  2017 raft_consensus.cc:2272] T 5a33bf1d7b914771971f31da16c86c31 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.541208  2017 tablet_replica.cc:333] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.543948  2017 raft_consensus.cc:2243] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.545279  2017 raft_consensus.cc:2272] T b974e8909e0b47e2bd4e0d28fbafe975 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:26.546838  3896 consensus_peers.cc:597] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:26.549189  2017 tablet_replica.cc:333] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.550128  2017 raft_consensus.cc:2243] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.551452  2017 raft_consensus.cc:2272] T 0d98324eb9764f8e9470a5c111b82bb1 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.558027  2017 tablet_replica.cc:333] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.559042  2017 raft_consensus.cc:2243] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.563978  2017 raft_consensus.cc:2272] T f0fc559f70f94ad8b2da50624147942a P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.567198  2017 tablet_replica.cc:333] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.568079  2017 raft_consensus.cc:2243] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.576068  2017 raft_consensus.cc:2272] T fb103e3ac0ca481bace4eb01f0725ae8 P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:26.577104  3896 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:26.585079  2017 tablet_replica.cc:333] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.587210  2017 raft_consensus.cc:2243] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.590132  2017 raft_consensus.cc:2272] T 37160a9f5c0a4847b38b9c87a80891de P eb49d92feeb14382b3baa49d696b6141 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.598805  2017 tablet_replica.cc:333] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.614259  2017 raft_consensus.cc:2243] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.615665  2017 raft_consensus.cc:2272] T c85f3b72388e43eb9b3f81e8f5ba7385 P eb49d92feeb14382b3baa49d696b6141 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.618548  2017 tablet_replica.cc:333] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.619418  2017 raft_consensus.cc:2243] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.620268  2017 raft_consensus.cc:2272] T 21406a1677884f049da5c65f8f2ed5ff P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.623225  2017 tablet_replica.cc:333] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.624126  2017 raft_consensus.cc:2243] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.626024  2017 raft_consensus.cc:2272] T 8dd9302593554fbabfffed2fd5ca4443 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.635851  2017 tablet_replica.cc:333] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.636751  2017 raft_consensus.cc:2243] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.638051  2017 raft_consensus.cc:2272] T 49089e729c0f4f37b66d40abf2e3cfe6 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.649214  2017 tablet_replica.cc:333] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.650097  2017 raft_consensus.cc:2243] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.650883  2017 raft_consensus.cc:2272] T a10fd7fda53e4a8ea272336588c66980 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.653728  2017 tablet_replica.cc:333] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.654562  2017 raft_consensus.cc:2243] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.659456  2017 raft_consensus.cc:2272] T f904cee1d1e04a36bc93a9dcf405d9a8 P eb49d92feeb14382b3baa49d696b6141 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.662636  2017 tablet_replica.cc:333] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.667377  2017 raft_consensus.cc:2243] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.668756  2017 raft_consensus.cc:2272] T aa54c541b3454731ad51d4012eb0ad72 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.682343  2017 tablet_replica.cc:333] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.683245  2017 raft_consensus.cc:2243] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.684463  2017 raft_consensus.cc:2272] T 57c6fad3865d45a1b0c364058f3550b4 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.687147  2017 tablet_replica.cc:333] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.687983  2017 raft_consensus.cc:2243] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.689492  2017 raft_consensus.cc:2272] T 57d85bc226d34560b470d2d44e89c8cc P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.700925  2017 tablet_replica.cc:333] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.701795  2017 raft_consensus.cc:2243] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.702745  2017 raft_consensus.cc:2272] T 4a4e9fd123b2418a86c69f2894fd2f4f P eb49d92feeb14382b3baa49d696b6141 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.705747  2017 tablet_replica.cc:333] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.706490  2017 raft_consensus.cc:2243] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.718103  2017 raft_consensus.cc:2272] T c7482671d98f47899c1d11f810abadb7 P eb49d92feeb14382b3baa49d696b6141 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.720980  2017 tablet_replica.cc:333] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.721952  2017 raft_consensus.cc:2243] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.723326  2017 raft_consensus.cc:2272] T 34a1a5138f6d495dbacdde8c4b4dd898 P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.738322  2017 tablet_replica.cc:333] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.739198  2017 raft_consensus.cc:2243] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.740638  2017 raft_consensus.cc:2272] T 94318f741f4143469cf9140cb1be3c4c P eb49d92feeb14382b3baa49d696b6141 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.743321  2017 tablet_replica.cc:333] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.748134  2017 raft_consensus.cc:2243] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.749043  2017 raft_consensus.cc:2272] T c34244f67d5045c49554e8a2ce27891d P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.752219  2017 tablet_replica.cc:333] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.755290  2017 raft_consensus.cc:2243] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.759028  2017 raft_consensus.cc:2272] T afca51be89bf4a7681690f9913aa6f82 P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.762085  2017 tablet_replica.cc:333] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.772060  2017 raft_consensus.cc:2243] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.773293  2017 raft_consensus.cc:2272] T b9471f19ecb64571bc899936c896d99f P eb49d92feeb14382b3baa49d696b6141 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.776152  2017 tablet_replica.cc:333] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.776989  2017 raft_consensus.cc:2243] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:26.777740  2017 raft_consensus.cc:2272] T 132b388f4bf24fd482334847aadc601a P eb49d92feeb14382b3baa49d696b6141 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.780663  2017 tablet_replica.cc:333] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.786780  2017 raft_consensus.cc:2243] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.788089  2017 raft_consensus.cc:2272] T 51ff9b5ea5944e51914ded65407b153b P eb49d92feeb14382b3baa49d696b6141 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.791159  2017 tablet_replica.cc:333] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.807960  2017 raft_consensus.cc:2243] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.809392  2017 raft_consensus.cc:2272] T e974711b37af4153b756b212bffc5915 P eb49d92feeb14382b3baa49d696b6141 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:26.812399  2017 tablet_replica.cc:333] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141: stopping tablet replica
I20260709 12:15:26.813604  2017 raft_consensus.cc:2243] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:15:26.814939  2017 raft_consensus.cc:2272] T 7a515efb7c674e9997a33098bc2d7002 P eb49d92feeb14382b3baa49d696b6141 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:27.010448  3895 consensus_peers.cc:597] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:27.104416  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:27.105819  7969 raft_consensus.cc:493] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:27.106400  7969 raft_consensus.cc:515] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:27.110136  7969 leader_election.cc:290] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853)
W20260709 12:15:27.120143  3895 leader_election.cc:336] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:27.142518  3895 consensus_peers.cc:597] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:27.167689  3895 consensus_peers.cc:597] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:27.227380  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:27.242882  7969 raft_consensus.cc:493] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:27.245210  7969 raft_consensus.cc:515] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:27.248492  7969 leader_election.cc:290] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:27.255777  3896 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
W20260709 12:15:27.268076  3895 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:27.268608  3895 leader_election.cc:304] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:27.269403  7969 raft_consensus.cc:2749] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:27.293259  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:15:27.300243  3895 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:27.301491  3895 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:27.302212  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:27.302940  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:15:27.303872  3895 leader_election.cc:336] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:27.304348  3895 leader_election.cc:304] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, 7ac63b674f204bc4805ab989f8c965d3
I20260709 12:15:27.305202  7969 raft_consensus.cc:2749] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:27.306376  3895 leader_election.cc:336] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:27.322914  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:27.373608  7969 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:27.374259  7969 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:15:27.387037  3896 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
I20260709 12:15:27.389616  7969 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:27.401435  3895 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:27.402016  3895 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:27.402851  7969 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:27.404691  3895 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:27.407689  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:27.449942  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:27.451078  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:15:27.522367  3895 consensus_peers.cc:597] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:27.538195  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:27.566990  7969 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:27.567812  7969 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:27.573904  7969 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:27.583056  3896 leader_election.cc:336] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
W20260709 12:15:27.608529  3895 leader_election.cc:336] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:27.611740  3895 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
W20260709 12:15:27.612919  3895 consensus_peers.cc:597] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:27.613418  7974 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:15:27.617687  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:27.621145  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:27.621701  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:27.636508  3895 consensus_peers.cc:597] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:27.651006  3895 consensus_peers.cc:597] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:27.657262  3895 consensus_peers.cc:597] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:27.674260  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:27.683702  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:27.690469  3895 consensus_peers.cc:597] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:27.694449  7974 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:27.695132  7974 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:27.698171  7974 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:27.704025  3896 leader_election.cc:336] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
W20260709 12:15:27.713034  3895 leader_election.cc:336] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:27.713662  3895 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:27.714488  7974 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:27.715592  3895 leader_election.cc:336] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:27.809051  7974 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:27.809692  7974 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:15:27.817401  3896 leader_election.cc:336] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
I20260709 12:15:27.818359  7974 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:27.832020  3895 leader_election.cc:336] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:27.832581  3895 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:27.833480  7974 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:27.849206  7969 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:27.849778  7969 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:27.852447  7969 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:27.858337  3896 leader_election.cc:336] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
W20260709 12:15:27.866664  3895 leader_election.cc:336] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:27.867285  3895 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:27.868180  7969 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:27.905197  7969 raft_consensus.cc:493] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:27.905817  7969 raft_consensus.cc:515] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:27.909734  7974 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:27.910383  7974 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:27.912536  7974 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:27.918293  3896 leader_election.cc:336] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
W20260709 12:15:27.919613  3896 leader_election.cc:336] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
I20260709 12:15:27.919013  7969 leader_election.cc:290] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:27.927397  3122 debug-util.cc:398] Leaking SignalData structure 0x7b080011afc0 after lost signal to thread 2020
W20260709 12:15:27.928632  3122 debug-util.cc:398] Leaking SignalData structure 0x7b080038b740 after lost signal to thread 3125
W20260709 12:15:27.929243  3122 debug-util.cc:398] Leaking SignalData structure 0x7b080028c5e0 after lost signal to thread 3366
W20260709 12:15:27.930459  3122 debug-util.cc:398] Leaking SignalData structure 0x7b0800040dc0 after lost signal to thread 3956
W20260709 12:15:27.939698  3895 leader_election.cc:336] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:27.940326  3895 leader_election.cc:304] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:27.941181  7969 raft_consensus.cc:2749] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:27.942348  3895 leader_election.cc:336] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:27.942839  3895 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:27.943651  7969 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:27.945187  7969 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:27.945706  7969 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:27.949473  7969 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:27.954946  3896 leader_election.cc:336] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
W20260709 12:15:27.971640  3895 leader_election.cc:336] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:27.972219  3895 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:27.973019  7969 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:28.025269  7969 raft_consensus.cc:493] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:28.026374  7969 raft_consensus.cc:515] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:15:28.025794  2017 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3363)
I20260709 12:15:28.029313  7969 leader_election.cc:290] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:28.037741  3896 leader_election.cc:336] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
I20260709 12:15:28.042420  7969 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:28.043025  7969 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:28.048250  7969 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:28.080427  3896 leader_election.cc:336] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
W20260709 12:15:28.115331  3895 leader_election.cc:336] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:28.116762  3895 leader_election.cc:304] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:28.119148  7969 raft_consensus.cc:2749] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:28.121578  3895 leader_election.cc:336] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:28.122073  3895 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:28.122848  7969 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:28.142050  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:28.144042  7969 raft_consensus.cc:493] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:28.144606  7969 raft_consensus.cc:515] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:28.146849  7969 leader_election.cc:290] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:28.155550  3896 leader_election.cc:336] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
W20260709 12:15:28.175763  3895 leader_election.cc:336] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:28.176357  3895 leader_election.cc:304] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:28.177143  7969 raft_consensus.cc:2749] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:28.278402  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:15:28.466398  3896 consensus_peers.cc:597] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:28.551687  3896 consensus_peers.cc:597] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:28.622043  3896 consensus_peers.cc:597] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:28.641055  3895 consensus_peers.cc:597] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:15:28.681756  3896 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:28.725875  3896 consensus_peers.cc:597] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:28.726560  3896 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:28.758963  3895 consensus_peers.cc:597] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:15:28.873375  3896 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:28.935885  3895 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:15:28.939805  3896 consensus_peers.cc:597] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:28.990434  3896 consensus_peers.cc:597] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:29.012033  3895 consensus_peers.cc:597] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:15:29.027611  2017 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 3363)
W20260709 12:15:29.055968  3896 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:29.086809  3895 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111) [suppressed 638 similar messages]
W20260709 12:15:29.121285  3896 consensus_peers.cc:597] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:29.151384  3895 consensus_peers.cc:597] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:15:29.153744  3895 consensus_peers.cc:597] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:15:29.152853  3896 consensus_peers.cc:597] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:29.161674  3896 consensus_peers.cc:597] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:29.284189  3895 consensus_peers.cc:597] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:15:29.326419  3896 consensus_peers.cc:597] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Couldn't send request to peer eb49d92feeb14382b3baa49d696b6141. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:29.352567  3895 consensus_peers.cc:597] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:15:29.396436  3895 consensus_peers.cc:597] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:29.470067  7969 raft_consensus.cc:493] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:29.470645  7969 raft_consensus.cc:515] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:29.472761  7969 leader_election.cc:290] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:29.479280  3896 leader_election.cc:336] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
I20260709 12:15:29.487764  7969 raft_consensus.cc:493] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:29.488467  7969 raft_consensus.cc:515] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:29.491379  7969 leader_election.cc:290] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:29.496538  3896 leader_election.cc:336] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
W20260709 12:15:29.497735  3895 leader_election.cc:336] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:29.498261  3895 leader_election.cc:304] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:29.499037  7969 raft_consensus.cc:2749] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:15:29.506079  3895 consensus_peers.cc:597] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:29.514878  7969 raft_consensus.cc:493] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:29.515408  7969 raft_consensus.cc:515] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:29.517665  7969 leader_election.cc:290] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:29.524461  3896 leader_election.cc:336] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
W20260709 12:15:29.531339  3895 leader_election.cc:336] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:29.531896  3895 leader_election.cc:304] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:29.532677  7969 raft_consensus.cc:2749] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:29.541790  3895 leader_election.cc:336] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:29.547086  3895 leader_election.cc:336] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:29.547641  3895 leader_election.cc:304] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:29.548406  7969 raft_consensus.cc:2749] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:29.556805  3895 consensus_peers.cc:597] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:15:29.557739  3895 consensus_peers.cc:597] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:29.576794  7969 raft_consensus.cc:493] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1ef05c9d901046dca7fe0e638cc693b9)
I20260709 12:15:29.577459  7969 raft_consensus.cc:515] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } attrs { replace: true } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:15:29.586835  3896 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
I20260709 12:15:29.591902  7969 leader_election.cc:290] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
I20260709 12:15:29.605166  7969 raft_consensus.cc:493] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:29.605823  7969 raft_consensus.cc:515] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:29.608201  7969 leader_election.cc:290] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:29.613085  3896 leader_election.cc:336] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
I20260709 12:15:29.631939  7969 raft_consensus.cc:493] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:29.632519  7969 raft_consensus.cc:515] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } attrs { replace: true } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
W20260709 12:15:29.636771  3895 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:29.637257  3895 leader_election.cc:304] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:29.638646  7961 raft_consensus.cc:2749] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:29.639014  3895 leader_election.cc:336] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
W20260709 12:15:29.640146  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:29.645388  7969 leader_election.cc:290] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:29.650370  3896 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
W20260709 12:15:29.654758  3895 leader_election.cc:336] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:29.655293  3895 leader_election.cc:304] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:29.656078  7969 raft_consensus.cc:2749] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:29.657083  3895 consensus_peers.cc:597] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:15:29.658268  3895 consensus_peers.cc:597] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:29.676848  3895 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:29.677501  3895 leader_election.cc:304] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:29.678403  7961 raft_consensus.cc:2749] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:29.679628  3895 leader_election.cc:336] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
W20260709 12:15:29.690348  3895 consensus_peers.cc:597] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:15:29.706820  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:29.720363  3895 consensus_peers.cc:597] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Couldn't send request to peer 7ac63b674f204bc4805ab989f8c965d3. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:15:29.728888  2017 tablet_server.cc:196] TabletServer@127.1.248.67:0 shutdown complete.
I20260709 12:15:29.748459  7961 raft_consensus.cc:493] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:29.749061  7961 raft_consensus.cc:515] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1ef05c9d901046dca7fe0e638cc693b9" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 38853 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:29.751009  7961 leader_election.cc:290] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:29.756726  3896 leader_election.cc:336] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
W20260709 12:15:29.762943  3895 leader_election.cc:336] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111)
I20260709 12:15:29.763684  3895 leader_election.cc:304] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 1ef05c9d901046dca7fe0e638cc693b9, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:29.764645  7961 raft_consensus.cc:2749] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:29.771667  3895 consensus_peers.cc:597] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:29.805431  7961 raft_consensus.cc:493] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:29.805934  7961 raft_consensus.cc:515] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:29.808405  7961 leader_election.cc:290] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:29.816859  3896 leader_election.cc:336] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
W20260709 12:15:29.828446  3895 consensus_peers.cc:597] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:29.829187  3895 leader_election.cc:336] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:29.829664  3895 leader_election.cc:304] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:29.830475  7961 raft_consensus.cc:2749] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:29.876434  7961 raft_consensus.cc:493] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb49d92feeb14382b3baa49d696b6141)
I20260709 12:15:29.876928  7961 raft_consensus.cc:515] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7ac63b674f204bc4805ab989f8c965d3" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 44889 } } peers { permanent_uuid: "eb49d92feeb14382b3baa49d696b6141" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 35301 } } peers { permanent_uuid: "6f0cdd57c5934921829c205d32b2b8a5" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 43599 } attrs { promote: false } }
I20260709 12:15:29.878856  7961 leader_election.cc:290] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889), eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301)
W20260709 12:15:29.885005  3896 leader_election.cc:336] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer eb49d92feeb14382b3baa49d696b6141 (127.1.248.67:35301): Network error: Client connection negotiation failed: client connection to 127.1.248.67:35301: connect: Connection refused (error 111)
I20260709 12:15:29.887482  2017 tablet_server.cc:179] TabletServer@127.1.248.68:0 shutting down...
W20260709 12:15:29.896000  3895 consensus_peers.cc:597] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:29.896812  3895 leader_election.cc:336] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:29.897287  3895 leader_election.cc:304] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0cdd57c5934921829c205d32b2b8a5; no voters: 7ac63b674f204bc4805ab989f8c965d3, eb49d92feeb14382b3baa49d696b6141
I20260709 12:15:29.898025  7961 raft_consensus.cc:2749] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:29.932925  3895 consensus_peers.cc:597] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:29.952134  3895 consensus_peers.cc:597] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 -> Peer 1ef05c9d901046dca7fe0e638cc693b9 (127.1.248.66:38853): Couldn't send request to peer 1ef05c9d901046dca7fe0e638cc693b9. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:38853: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:29.955623  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:29.956591  2017 tablet_replica.cc:333] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:29.957808  2017 raft_consensus.cc:2243] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:29.958639  2017 raft_consensus.cc:2272] T 0d98324eb9764f8e9470a5c111b82bb1 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:29.962373  2017 tablet_replica.cc:333] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:29.963351  2017 raft_consensus.cc:2243] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:15:29.964944  2017 raft_consensus.cc:2272] T a85351bf981e43bea61620452a2c7b3a P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:29.967175  2017 tablet_replica.cc:333] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:29.967867  2017 raft_consensus.cc:2243] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:29.968896  2017 raft_consensus.cc:2272] T 72176593f52b48c28602984ef9c8ee6b P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:29.971517  2017 tablet_replica.cc:333] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:29.972129  2017 raft_consensus.cc:2243] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:15:29.972973  2017 raft_consensus.cc:2272] T 5e285af011d44cfc91bcd6499aa4c9f8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:29.975277  2017 tablet_replica.cc:333] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:29.975876  2017 raft_consensus.cc:2243] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:29.976377  2017 raft_consensus.cc:2272] T b974e8909e0b47e2bd4e0d28fbafe975 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:29.978360  2017 tablet_replica.cc:333] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:29.978958  2017 raft_consensus.cc:2243] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:29.979538  2017 raft_consensus.cc:2272] T cab3ecc4f0b34068a804b174b02b9a16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:29.981534  2017 tablet_replica.cc:333] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:29.982086  2017 raft_consensus.cc:2243] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:15:29.983026  2017 raft_consensus.cc:2272] T b9471f19ecb64571bc899936c896d99f P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:29.986763  2017 tablet_replica.cc:333] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:29.987671  2017 raft_consensus.cc:2243] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:15:29.988768  2017 raft_consensus.cc:2272] T 214d209d2c0940c1a4c43e368fff9e23 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:29.990943  2017 tablet_replica.cc:333] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:29.991583  2017 raft_consensus.cc:2243] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:15:29.992405  2017 raft_consensus.cc:2272] T f0fc559f70f94ad8b2da50624147942a P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:29.994556  2017 tablet_replica.cc:333] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:29.995113  2017 raft_consensus.cc:2243] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:29.995666  2017 raft_consensus.cc:2272] T ea1a64c911894ce08c1622f9307ed513 P 6f0cdd57c5934921829c205d32b2b8a5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:29.997641  2017 tablet_replica.cc:333] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:29.998245  2017 raft_consensus.cc:2243] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:15:29.999251  2017 raft_consensus.cc:2272] T eb7809b208b14a549539330993804c34 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.001688  2017 tablet_replica.cc:333] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.002557  2017 raft_consensus.cc:2243] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.003468  2017 raft_consensus.cc:2272] T 53307990662b42ecae5100eb9bdb80b6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.006318  2017 tablet_replica.cc:333] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.007200  2017 raft_consensus.cc:2243] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.008881  2017 raft_consensus.cc:2272] T 9ec2274893aa4cc087f9d4af8119b1ea P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.012012  2017 tablet_replica.cc:333] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.012883  2017 raft_consensus.cc:2243] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.014061  2017 raft_consensus.cc:2272] T ebb8348062364c7c878da1d2999c325b P 6f0cdd57c5934921829c205d32b2b8a5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.016755  2017 tablet_replica.cc:333] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.017448  2017 raft_consensus.cc:2243] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.018368  2017 raft_consensus.cc:2272] T 21406a1677884f049da5c65f8f2ed5ff P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.020582  2017 tablet_replica.cc:333] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.021184  2017 raft_consensus.cc:2243] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.022058  2017 raft_consensus.cc:2272] T 8c298faf2e6b4619a5c83569e86043e8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.024139  2017 tablet_replica.cc:333] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.024724  2017 raft_consensus.cc:2243] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:30.025280  2017 raft_consensus.cc:2272] T 4d7af9c2d6334c6f84aed4586a66d701 P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.027511  2017 tablet_replica.cc:333] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.028131  2017 raft_consensus.cc:2243] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.029081  2017 raft_consensus.cc:2272] T 8939008df61a42b5ab6d01a5cc782e16 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.031281  2017 tablet_replica.cc:333] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.031888  2017 raft_consensus.cc:2243] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.032738  2017 raft_consensus.cc:2272] T 5a33bf1d7b914771971f31da16c86c31 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.034713  2017 tablet_replica.cc:333] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.035307  2017 raft_consensus.cc:2243] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:30.036005  2017 raft_consensus.cc:2272] T 8dd9302593554fbabfffed2fd5ca4443 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.038484  2017 tablet_replica.cc:333] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.039089  2017 raft_consensus.cc:2243] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.040138  2017 raft_consensus.cc:2272] T 49089e729c0f4f37b66d40abf2e3cfe6 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.042284  2017 tablet_replica.cc:333] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.042900  2017 raft_consensus.cc:2243] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.043939  2017 raft_consensus.cc:2272] T fb103e3ac0ca481bace4eb01f0725ae8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.046141  2017 tablet_replica.cc:333] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.047799  2017 raft_consensus.cc:2243] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:30.048345  2017 raft_consensus.cc:2272] T c85f3b72388e43eb9b3f81e8f5ba7385 P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.050442  2017 tablet_replica.cc:333] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.051059  2017 raft_consensus.cc:2243] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:30.051676  2017 raft_consensus.cc:2272] T f904cee1d1e04a36bc93a9dcf405d9a8 P 6f0cdd57c5934921829c205d32b2b8a5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.053759  2017 tablet_replica.cc:333] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.054311  2017 raft_consensus.cc:2243] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.055259  2017 raft_consensus.cc:2272] T 4338ede94a794c41ba16cba6ac585f9a P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.057653  2017 tablet_replica.cc:333] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.060331  2017 raft_consensus.cc:2243] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:30.061165  2017 raft_consensus.cc:2272] T 57c6fad3865d45a1b0c364058f3550b4 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.063697  2017 tablet_replica.cc:333] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.064349  2017 raft_consensus.cc:2243] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:30.064864  2017 raft_consensus.cc:2272] T aa54c541b3454731ad51d4012eb0ad72 P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.067178  2017 tablet_replica.cc:333] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.067898  2017 raft_consensus.cc:2243] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.068827  2017 raft_consensus.cc:2272] T 9ee459e79aec45909d356d039c69e72c P 6f0cdd57c5934921829c205d32b2b8a5 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.070578  2017 tablet_replica.cc:333] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.071117  2017 raft_consensus.cc:2243] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.072042  2017 raft_consensus.cc:2272] T 9796736c241b42c283a7f6a433742bed P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.073949  2017 tablet_replica.cc:333] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.074522  2017 raft_consensus.cc:2243] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.075320  2017 raft_consensus.cc:2272] T 09cb299c977a476ab873860cf7e2a44c P 6f0cdd57c5934921829c205d32b2b8a5 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.077139  2017 tablet_replica.cc:333] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.077688  2017 raft_consensus.cc:2243] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.078516  2017 raft_consensus.cc:2272] T a10fd7fda53e4a8ea272336588c66980 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.080384  2017 tablet_replica.cc:333] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.080924  2017 raft_consensus.cc:2243] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:30.081521  2017 raft_consensus.cc:2272] T c333bd40d0a34c96bb74838b3ea8986c P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.083761  2017 tablet_replica.cc:333] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.084309  2017 raft_consensus.cc:2243] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.085186  2017 raft_consensus.cc:2272] T acb4310417b348518d7accdf0538e249 P 6f0cdd57c5934921829c205d32b2b8a5 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.087272  2017 tablet_replica.cc:333] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.087988  2017 raft_consensus.cc:2243] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:30.088584  2017 raft_consensus.cc:2272] T 8e46c8b6a4494f6d8742bb7ef609d94c P 6f0cdd57c5934921829c205d32b2b8a5 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.090822  2017 tablet_replica.cc:333] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.091361  2017 raft_consensus.cc:2243] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.092239  2017 raft_consensus.cc:2272] T c79ed88d91bd49d4a95c3eb59fb97a63 P 6f0cdd57c5934921829c205d32b2b8a5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.094216  2017 tablet_replica.cc:333] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.094765  2017 raft_consensus.cc:2243] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:30.095340  2017 raft_consensus.cc:2272] T c7482671d98f47899c1d11f810abadb7 P 6f0cdd57c5934921829c205d32b2b8a5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.098302  2017 tablet_replica.cc:333] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.099030  2017 raft_consensus.cc:2243] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:30.099681  2017 raft_consensus.cc:2272] T 51ff9b5ea5944e51914ded65407b153b P 6f0cdd57c5934921829c205d32b2b8a5 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.101733  2017 tablet_replica.cc:333] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5: stopping tablet replica
I20260709 12:15:30.102218  2017 raft_consensus.cc:2243] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.103070  2017 raft_consensus.cc:2272] T 17a639dfba9c4cd98fcc0e73a3de49f9 P 6f0cdd57c5934921829c205d32b2b8a5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.543005  2017 tablet_server.cc:196] TabletServer@127.1.248.68:0 shutdown complete.
I20260709 12:15:30.609738  2017 master.cc:562] Master@127.1.248.126:35191 shutting down...
W20260709 12:15:30.643818  3139 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:15:30.644160  3139 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:15:30.644393  3139 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:15:38.380595  3075 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111) [suppressed 117 similar messages]
W20260709 12:15:38.385998  3075 catalog_manager.cc:4755] TS 7ac63b674f204bc4805ab989f8c965d3 (127.1.248.65:44889): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 57c6fad3865d45a1b0c364058f3550b4: Network error: Client connection negotiation failed: client connection to 127.1.248.65:44889: connect: Connection refused (error 111)
I20260709 12:15:39.374640  2017 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:39.375752  2017 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.376156  2017 tablet_replica.cc:333] T 00000000000000000000000000000000 P a718949aeb634dbb80222dbb0804b0c4: stopping tablet replica
I20260709 12:15:39.521979  2017 master.cc:584] Master@127.1.248.126:35191 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (169207 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:15:39.649786  2017 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.248.126:46043
I20260709 12:15:39.651015  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:39.656848  7980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:39.657294  7981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:39.658121  7983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:39.660240  2017 server_base.cc:1061] running on GCE node
I20260709 12:15:39.662757  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:39.662937  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:39.663139  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599339663106 us; error 0 us; skew 500 ppm
I20260709 12:15:39.663725  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:39.666145  2017 webserver.cc:533] Webserver started at http://127.1.248.126:34361/ using document root <none> and password file <none>
I20260709 12:15:39.666659  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:39.666855  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:39.667143  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:39.668601  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/master-0-root/instance:
uuid: "de43d4a3f3f646a889a53bee10415e84"
format_stamp: "Formatted at 2026-07-09 12:15:39 on dist-test-slave-z9f9"
I20260709 12:15:39.673208  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:15:39.676622  7988 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:39.677351  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:15:39.677657  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/master-0-root
uuid: "de43d4a3f3f646a889a53bee10415e84"
format_stamp: "Formatted at 2026-07-09 12:15:39 on dist-test-slave-z9f9"
I20260709 12:15:39.677935  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:39.698760  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:39.700106  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:39.739828  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.126:46043
I20260709 12:15:39.739939  8039 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.126:46043 every 8 connection(s)
I20260709 12:15:39.744134  8040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:39.755264  8040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84: Bootstrap starting.
I20260709 12:15:39.760350  8040 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.764750  8040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84: No bootstrap required, opened a new log
I20260709 12:15:39.766968  8040 raft_consensus.cc:359] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de43d4a3f3f646a889a53bee10415e84" member_type: VOTER }
I20260709 12:15:39.767400  8040 raft_consensus.cc:385] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.767669  8040 raft_consensus.cc:740] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de43d4a3f3f646a889a53bee10415e84, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.768280  8040 consensus_queue.cc:260] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de43d4a3f3f646a889a53bee10415e84" member_type: VOTER }
I20260709 12:15:39.768705  8040 raft_consensus.cc:399] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:39.768914  8040 raft_consensus.cc:493] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:39.769129  8040 raft_consensus.cc:3060] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.773566  8040 raft_consensus.cc:515] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de43d4a3f3f646a889a53bee10415e84" member_type: VOTER }
I20260709 12:15:39.774173  8040 leader_election.cc:304] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de43d4a3f3f646a889a53bee10415e84; no voters: 
I20260709 12:15:39.775236  8040 leader_election.cc:290] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:39.775691  8043 raft_consensus.cc:2804] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:39.777064  8043 raft_consensus.cc:697] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [term 1 LEADER]: Becoming Leader. State: Replica: de43d4a3f3f646a889a53bee10415e84, State: Running, Role: LEADER
I20260709 12:15:39.777762  8043 consensus_queue.cc:237] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de43d4a3f3f646a889a53bee10415e84" member_type: VOTER }
I20260709 12:15:39.778235  8040 sys_catalog.cc:565] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:39.784220  8045 sys_catalog.cc:455] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader de43d4a3f3f646a889a53bee10415e84. Latest consensus state: current_term: 1 leader_uuid: "de43d4a3f3f646a889a53bee10415e84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de43d4a3f3f646a889a53bee10415e84" member_type: VOTER } }
I20260709 12:15:39.784610  8044 sys_catalog.cc:455] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de43d4a3f3f646a889a53bee10415e84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de43d4a3f3f646a889a53bee10415e84" member_type: VOTER } }
I20260709 12:15:39.784960  8045 sys_catalog.cc:458] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:39.785146  8044 sys_catalog.cc:458] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:39.787079  8050 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:39.792038  8050 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:39.795966  2017 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:39.801232  8050 catalog_manager.cc:1383] Generated new cluster ID: 3f5b0d74ffc74379a847ad9605588315
I20260709 12:15:39.801528  8050 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:39.815313  8050 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:39.816674  8050 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:39.843320  8050 catalog_manager.cc:6070] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84: Generated new TSK 0
I20260709 12:15:39.843988  8050 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:39.862972  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:39.869371  8061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:39.870371  8062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:39.873382  8064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:39.874351  2017 server_base.cc:1061] running on GCE node
I20260709 12:15:39.876248  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:39.876438  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:39.876650  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599339876615 us; error 0 us; skew 500 ppm
I20260709 12:15:39.877214  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:39.880020  2017 webserver.cc:533] Webserver started at http://127.1.248.65:41917/ using document root <none> and password file <none>
I20260709 12:15:39.880529  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:39.880686  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:39.881004  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:39.882264  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/instance:
uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
format_stamp: "Formatted at 2026-07-09 12:15:39 on dist-test-slave-z9f9"
I20260709 12:15:39.886940  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:15:39.890615  8069 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:39.891548  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:15:39.891870  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-0-root
uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
format_stamp: "Formatted at 2026-07-09 12:15:39 on dist-test-slave-z9f9"
I20260709 12:15:39.892158  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:39.902757  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:39.904021  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:39.905555  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:39.907904  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:39.908128  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:39.908360  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:39.908553  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:39.949093  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.65:34153
I20260709 12:15:39.949275  8131 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.65:34153 every 8 connection(s)
I20260709 12:15:39.954243  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:39.962867  8136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:39.963451  8137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:39.968325  8140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:39.968566  2017 server_base.cc:1061] running on GCE node
I20260709 12:15:39.968624  8132 heartbeater.cc:344] Connected to a master server at 127.1.248.126:46043
I20260709 12:15:39.969264  8132 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:39.970073  8132 heartbeater.cc:507] Master 127.1.248.126:46043 requested a full tablet report, sending...
I20260709 12:15:39.971052  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:39.971346  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:39.971613  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599339971582 us; error 0 us; skew 500 ppm
I20260709 12:15:39.972268  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:39.972384  8005 ts_manager.cc:194] Registered new tserver with Master: ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:39.974668  8005 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36696
I20260709 12:15:39.975063  2017 webserver.cc:533] Webserver started at http://127.1.248.66:40457/ using document root <none> and password file <none>
I20260709 12:15:39.975684  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:39.975898  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:39.976215  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:39.977514  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/instance:
uuid: "b02838a902c44ea49d8d94181285b20e"
format_stamp: "Formatted at 2026-07-09 12:15:39 on dist-test-slave-z9f9"
I20260709 12:15:39.982333  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:15:39.985934  8144 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:39.986724  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:15:39.987040  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-1-root
uuid: "b02838a902c44ea49d8d94181285b20e"
format_stamp: "Formatted at 2026-07-09 12:15:39 on dist-test-slave-z9f9"
I20260709 12:15:39.987327  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:40.004789  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:40.006091  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:40.007791  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:40.010547  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:40.010929  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:40.011233  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:40.011410  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:40.053390  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.66:42019
I20260709 12:15:40.053514  8206 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.66:42019 every 8 connection(s)
I20260709 12:15:40.058588  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:40.066370  8210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:40.067226  8211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:40.069921  8213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:40.070016  2017 server_base.cc:1061] running on GCE node
I20260709 12:15:40.071174  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:40.071483  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:40.071707  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599340071687 us; error 0 us; skew 500 ppm
I20260709 12:15:40.072311  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:40.072875  8207 heartbeater.cc:344] Connected to a master server at 127.1.248.126:46043
I20260709 12:15:40.073272  8207 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:40.074149  8207 heartbeater.cc:507] Master 127.1.248.126:46043 requested a full tablet report, sending...
I20260709 12:15:40.074998  2017 webserver.cc:533] Webserver started at http://127.1.248.67:44347/ using document root <none> and password file <none>
I20260709 12:15:40.075744  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:40.075994  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:40.076247  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:40.076581  8005 ts_manager.cc:194] Registered new tserver with Master: b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:40.077411  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/instance:
uuid: "66af1447f2c64ebda5448a760d5d7718"
format_stamp: "Formatted at 2026-07-09 12:15:40 on dist-test-slave-z9f9"
I20260709 12:15:40.078011  8005 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36698
I20260709 12:15:40.082451  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:15:40.086004  8218 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:40.086776  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:15:40.087055  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-2-root
uuid: "66af1447f2c64ebda5448a760d5d7718"
format_stamp: "Formatted at 2026-07-09 12:15:40 on dist-test-slave-z9f9"
I20260709 12:15:40.087307  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:40.100855  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:40.102068  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:40.103579  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:40.105786  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:40.106009  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:40.106264  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:40.106451  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:40.149818  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.67:40315
I20260709 12:15:40.149928  8280 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.67:40315 every 8 connection(s)
I20260709 12:15:40.155055  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:40.162459  8284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:40.164288  8285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:40.165704  2017 server_base.cc:1061] running on GCE node
W20260709 12:15:40.166374  8287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:40.167624  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:15:40.167871  8281 heartbeater.cc:344] Connected to a master server at 127.1.248.126:46043
W20260709 12:15:40.167910  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:40.168524  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599340168502 us; error 0 us; skew 500 ppm
I20260709 12:15:40.168524  8281 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:40.169281  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:40.169592  8281 heartbeater.cc:507] Master 127.1.248.126:46043 requested a full tablet report, sending...
I20260709 12:15:40.172216  8005 ts_manager.cc:194] Registered new tserver with Master: 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:40.172251  2017 webserver.cc:533] Webserver started at http://127.1.248.68:35789/ using document root <none> and password file <none>
I20260709 12:15:40.172919  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:40.173166  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:40.173475  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:40.173753  8005 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36712
I20260709 12:15:40.175200  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-3-root/instance:
uuid: "9058059c81534bc4b58c5329d5734dcc"
format_stamp: "Formatted at 2026-07-09 12:15:40 on dist-test-slave-z9f9"
I20260709 12:15:40.180243  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:15:40.183753  8292 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:40.184574  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:15:40.184881  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-3-root
uuid: "9058059c81534bc4b58c5329d5734dcc"
format_stamp: "Formatted at 2026-07-09 12:15:40 on dist-test-slave-z9f9"
I20260709 12:15:40.185194  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:40.201396  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:40.202744  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:40.204356  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:40.206707  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:40.206948  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:40.207194  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:40.207371  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:40.248972  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.68:44023
I20260709 12:15:40.249073  8354 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.68:44023 every 8 connection(s)
I20260709 12:15:40.263449  8355 heartbeater.cc:344] Connected to a master server at 127.1.248.126:46043
I20260709 12:15:40.263917  8355 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:40.264698  8355 heartbeater.cc:507] Master 127.1.248.126:46043 requested a full tablet report, sending...
I20260709 12:15:40.266686  8005 ts_manager.cc:194] Registered new tserver with Master: 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:40.267372  2017 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015034619s
I20260709 12:15:40.268168  8005 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36718
I20260709 12:15:40.297217  8005 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36726:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:15:40.542408  8097 tablet_service.cc:1511] Processing CreateTablet for tablet 7014425193644424abe3ad50857b4051 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:15:40.543251  8095 tablet_service.cc:1511] Processing CreateTablet for tablet acd20020a2924e31be0f16636e76efa7 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:15:40.544153  8097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7014425193644424abe3ad50857b4051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.544936  8095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd20020a2924e31be0f16636e76efa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.548913  8096 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbe350f2e414cbf85acf51562f960ad (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:15:40.550966  8096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbe350f2e414cbf85acf51562f960ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.552335  8094 tablet_service.cc:1511] Processing CreateTablet for tablet 14a6107537934605a85ad9af15618125 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:15:40.553812  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a6107537934605a85ad9af15618125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.557425  8093 tablet_service.cc:1511] Processing CreateTablet for tablet a9c3e4c9802147f59a86d193db6f981a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:15:40.558866  8093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c3e4c9802147f59a86d193db6f981a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.569205  8092 tablet_service.cc:1511] Processing CreateTablet for tablet 4586406114304e5a9209b76096a2f1ba (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:15:40.570690  8092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4586406114304e5a9209b76096a2f1ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.576937  8091 tablet_service.cc:1511] Processing CreateTablet for tablet 544e8410d33f4f21851df79c3d646d76 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:15:40.578332  8091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 544e8410d33f4f21851df79c3d646d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.580574  8172 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbe350f2e414cbf85acf51562f960ad (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:15:40.582037  8172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbe350f2e414cbf85acf51562f960ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.583685  8168 tablet_service.cc:1511] Processing CreateTablet for tablet a9c3e4c9802147f59a86d193db6f981a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:15:40.584630  8171 tablet_service.cc:1511] Processing CreateTablet for tablet acd20020a2924e31be0f16636e76efa7 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:15:40.597595  8246 tablet_service.cc:1511] Processing CreateTablet for tablet 7014425193644424abe3ad50857b4051 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:15:40.599133  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7014425193644424abe3ad50857b4051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.600557  8169 tablet_service.cc:1511] Processing CreateTablet for tablet 14a6107537934605a85ad9af15618125 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:15:40.604655  8089 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf040fefc954e70b0098614c1c1a09c (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:15:40.606066  8089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf040fefc954e70b0098614c1c1a09c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.608620  8088 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfe39df11664509bf085d1f7cc21724 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:15:40.610003  8088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfe39df11664509bf085d1f7cc21724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.611727  8090 tablet_service.cc:1511] Processing CreateTablet for tablet e6fc1fe247f341ed91a83cf61e4529f3 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:15:40.612432  8170 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8ee678c5a84a93befee23e8e48c8ea (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:15:40.613148  8090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fc1fe247f341ed91a83cf61e4529f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.616272  8167 tablet_service.cc:1511] Processing CreateTablet for tablet e54e3337256948f3b81b2ac605542399 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:15:40.618750  8166 tablet_service.cc:1511] Processing CreateTablet for tablet 544e8410d33f4f21851df79c3d646d76 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:15:40.621259  8165 tablet_service.cc:1511] Processing CreateTablet for tablet e6fc1fe247f341ed91a83cf61e4529f3 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:15:40.622714  8168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c3e4c9802147f59a86d193db6f981a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.628243  8171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd20020a2924e31be0f16636e76efa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.628680  8316 tablet_service.cc:1511] Processing CreateTablet for tablet 4586406114304e5a9209b76096a2f1ba (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:15:40.629124  8320 tablet_service.cc:1511] Processing CreateTablet for tablet 7014425193644424abe3ad50857b4051 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:15:40.630153  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4586406114304e5a9209b76096a2f1ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.630981  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7014425193644424abe3ad50857b4051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.631805  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8ee678c5a84a93befee23e8e48c8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.632513  8315 tablet_service.cc:1511] Processing CreateTablet for tablet e54e3337256948f3b81b2ac605542399 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:15:40.633126  8319 tablet_service.cc:1511] Processing CreateTablet for tablet acd20020a2924e31be0f16636e76efa7 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:15:40.633950  8315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54e3337256948f3b81b2ac605542399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.634934  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd20020a2924e31be0f16636e76efa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.634797  8317 tablet_service.cc:1511] Processing CreateTablet for tablet a9c3e4c9802147f59a86d193db6f981a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:15:40.636586  8167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54e3337256948f3b81b2ac605542399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.637135  8318 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8ee678c5a84a93befee23e8e48c8ea (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:15:40.639889  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a6107537934605a85ad9af15618125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.641019  8314 tablet_service.cc:1511] Processing CreateTablet for tablet e6fc1fe247f341ed91a83cf61e4529f3 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:15:40.643704  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 544e8410d33f4f21851df79c3d646d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.644757  8318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8ee678c5a84a93befee23e8e48c8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.645731  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fc1fe247f341ed91a83cf61e4529f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.646337  8312 tablet_service.cc:1511] Processing CreateTablet for tablet 8c617ad97f8c44009de3d3d47311ad6a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:15:40.649338  8313 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf040fefc954e70b0098614c1c1a09c (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:15:40.650674  8165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fc1fe247f341ed91a83cf61e4529f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.656711  8311 tablet_service.cc:1511] Processing CreateTablet for tablet 6da9a7d0425b4dd09d6615567d1fc738 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:15:40.659097  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c3e4c9802147f59a86d193db6f981a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.663792  8311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da9a7d0425b4dd09d6615567d1fc738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.670012  8245 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbe350f2e414cbf85acf51562f960ad (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:15:40.671231  8313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf040fefc954e70b0098614c1c1a09c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.671399  8245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbe350f2e414cbf85acf51562f960ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.673311  8312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c617ad97f8c44009de3d3d47311ad6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.672664  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8ee678c5a84a93befee23e8e48c8ea (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:15:40.680936  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8ee678c5a84a93befee23e8e48c8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.671198  8097 tablet_service.cc:1511] Processing CreateTablet for tablet 6da9a7d0425b4dd09d6615567d1fc738 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:15:40.691268  8243 tablet_service.cc:1511] Processing CreateTablet for tablet 14a6107537934605a85ad9af15618125 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:15:40.692381  8097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da9a7d0425b4dd09d6615567d1fc738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.692644  8243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a6107537934605a85ad9af15618125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.694672  8242 tablet_service.cc:1511] Processing CreateTablet for tablet 4586406114304e5a9209b76096a2f1ba (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:15:40.696648  8241 tablet_service.cc:1511] Processing CreateTablet for tablet e54e3337256948f3b81b2ac605542399 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:15:40.698035  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54e3337256948f3b81b2ac605542399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.700716  8240 tablet_service.cc:1511] Processing CreateTablet for tablet 544e8410d33f4f21851df79c3d646d76 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:15:40.702173  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 544e8410d33f4f21851df79c3d646d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.704221  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4586406114304e5a9209b76096a2f1ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.752413  8371 tablet_bootstrap.cc:492] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:40.752833  8096 tablet_service.cc:1511] Processing CreateTablet for tablet 9895082ba16e461b8ca83550f065f98c (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:15:40.757339  8164 tablet_service.cc:1511] Processing CreateTablet for tablet 8c617ad97f8c44009de3d3d47311ad6a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:15:40.759027  8164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c617ad97f8c44009de3d3d47311ad6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.759119  8239 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf040fefc954e70b0098614c1c1a09c (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:15:40.763896  8239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf040fefc954e70b0098614c1c1a09c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.764720  8238 tablet_service.cc:1511] Processing CreateTablet for tablet 8c617ad97f8c44009de3d3d47311ad6a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:15:40.766335  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c617ad97f8c44009de3d3d47311ad6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.787145  8163 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfe39df11664509bf085d1f7cc21724 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:15:40.788627  8163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfe39df11664509bf085d1f7cc21724. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:40.791625  8053 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:40.805261  8319 tablet_service.cc:1511] Processing CreateTablet for tablet 9895082ba16e461b8ca83550f065f98c (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:15:40.817862  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9895082ba16e461b8ca83550f065f98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.806882  8372 tablet_bootstrap.cc:492] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:40.808722  8374 tablet_bootstrap.cc:492] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:40.814957  8096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9895082ba16e461b8ca83550f065f98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.810096  8165 tablet_service.cc:1511] Processing CreateTablet for tablet 6da9a7d0425b4dd09d6615567d1fc738 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:15:40.832213  8165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da9a7d0425b4dd09d6615567d1fc738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.835323  8170 tablet_service.cc:1511] Processing CreateTablet for tablet 74d6768968ae4371bbc6973eaf2851d7 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:15:40.836663  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d6768968ae4371bbc6973eaf2851d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.846971  8374 tablet_bootstrap.cc:654] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:40.846896  8245 tablet_service.cc:1511] Processing CreateTablet for tablet 9895082ba16e461b8ca83550f065f98c (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:15:40.856619  8245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9895082ba16e461b8ca83550f065f98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.850133  8238 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfe39df11664509bf085d1f7cc21724 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:15:40.858400  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfe39df11664509bf085d1f7cc21724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.860160  8373 tablet_bootstrap.cc:492] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:40.875039  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 74d6768968ae4371bbc6973eaf2851d7 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:15:40.877085  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d6768968ae4371bbc6973eaf2851d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.881661  8371 tablet_bootstrap.cc:654] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:40.888769  8318 tablet_service.cc:1511] Processing CreateTablet for tablet 74d6768968ae4371bbc6973eaf2851d7 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:15:40.890385  8318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d6768968ae4371bbc6973eaf2851d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.889995  8317 tablet_service.cc:1511] Processing CreateTablet for tablet 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:15:40.891350  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.896374  8372 tablet_bootstrap.cc:654] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:40.896934  8374 tablet_bootstrap.cc:492] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:40.897447  8374 ts_tablet_manager.cc:1403] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.000s
I20260709 12:15:40.900499  8090 tablet_service.cc:1511] Processing CreateTablet for tablet 97e9145ea32c46a686276c9ecfb4ee19 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:15:40.901859  8090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e9145ea32c46a686276c9ecfb4ee19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.909106  8374 raft_consensus.cc:359] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:40.909898  8374 raft_consensus.cc:385] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:40.910218  8374 raft_consensus.cc:740] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:40.914665  8166 tablet_service.cc:1511] Processing CreateTablet for tablet 97e9145ea32c46a686276c9ecfb4ee19 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:15:40.919087  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e9145ea32c46a686276c9ecfb4ee19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.915735  8374 consensus_queue.cc:260] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:40.921434  8240 tablet_service.cc:1511] Processing CreateTablet for tablet 97e9145ea32c46a686276c9ecfb4ee19 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:15:40.931695  8373 tablet_bootstrap.cc:654] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:40.932274  8094 tablet_service.cc:1511] Processing CreateTablet for tablet 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:15:40.941715  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.943697  8372 tablet_bootstrap.cc:492] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:40.944227  8372 ts_tablet_manager.cc:1403] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.138s	user 0.015s	sys 0.003s
I20260709 12:15:40.941747  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e9145ea32c46a686276c9ecfb4ee19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.966113  8371 tablet_bootstrap.cc:492] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:40.966725  8371 ts_tablet_manager.cc:1403] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.215s	user 0.006s	sys 0.012s
I20260709 12:15:40.954281  8372 raft_consensus.cc:359] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:40.967765  8372 raft_consensus.cc:385] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:40.968364  8372 raft_consensus.cc:740] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:40.969584  8372 consensus_queue.cc:260] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:40.970116  8371 raft_consensus.cc:359] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:40.981128  8132 heartbeater.cc:499] Master 127.1.248.126:46043 was elected leader, sending a full tablet report...
I20260709 12:15:40.971315  8371 raft_consensus.cc:385] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:40.993901  8281 heartbeater.cc:499] Master 127.1.248.126:46043 was elected leader, sending a full tablet report...
I20260709 12:15:40.993899  8378 raft_consensus.cc:493] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.996186  8378 raft_consensus.cc:515] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:40.996507  8163 tablet_service.cc:1511] Processing CreateTablet for tablet 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:15:40.997509  8170 tablet_service.cc:1511] Processing CreateTablet for tablet 471683504fd94afab642c0a780a8833c (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:15:40.998061  8163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.998935  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 471683504fd94afab642c0a780a8833c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:40.991715  8371 raft_consensus.cc:740] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.006901  8090 tablet_service.cc:1511] Processing CreateTablet for tablet 6d552c1db4b14ac89628e14ac27582ba (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:15:41.007488  8317 tablet_service.cc:1511] Processing CreateTablet for tablet 471683504fd94afab642c0a780a8833c (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:15:41.008463  8090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d552c1db4b14ac89628e14ac27582ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.008997  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 471683504fd94afab642c0a780a8833c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.013649  8243 tablet_service.cc:1511] Processing CreateTablet for tablet 471683504fd94afab642c0a780a8833c (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:15:41.015092  8243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 471683504fd94afab642c0a780a8833c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.016053  8096 tablet_service.cc:1511] Processing CreateTablet for tablet d6dee16badf54437bc48a2f623d62066 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:15:41.017330  8096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6dee16badf54437bc48a2f623d62066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.020308  8374 ts_tablet_manager.cc:1434] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.122s	user 0.006s	sys 0.015s
I20260709 12:15:41.023085  8374 tablet_bootstrap.cc:492] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:41.025866  8372 ts_tablet_manager.cc:1434] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.081s	user 0.012s	sys 0.003s
I20260709 12:15:41.026660  8355 heartbeater.cc:499] Master 127.1.248.126:46043 was elected leader, sending a full tablet report...
I20260709 12:15:41.027248  8164 tablet_service.cc:1511] Processing CreateTablet for tablet 6d552c1db4b14ac89628e14ac27582ba (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:15:41.028573  8164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d552c1db4b14ac89628e14ac27582ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.046468  8311 tablet_service.cc:1511] Processing CreateTablet for tablet d6dee16badf54437bc48a2f623d62066 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:15:41.047953  8378 leader_election.cc:290] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:41.048224  8374 tablet_bootstrap.cc:654] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.048115  8311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6dee16badf54437bc48a2f623d62066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.049266  8238 tablet_service.cc:1511] Processing CreateTablet for tablet d6dee16badf54437bc48a2f623d62066 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:15:41.050558  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6dee16badf54437bc48a2f623d62066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.036566  8371 consensus_queue.cc:260] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:41.057487  8245 tablet_service.cc:1511] Processing CreateTablet for tablet 6d552c1db4b14ac89628e14ac27582ba (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:15:41.059228  8245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d552c1db4b14ac89628e14ac27582ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.064670  8372 tablet_bootstrap.cc:492] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:41.065910  8320 tablet_service.cc:1511] Processing CreateTablet for tablet eb422c1b757045358366d25d227e95ec (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:15:41.067870  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb422c1b757045358366d25d227e95ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.080658  8207 heartbeater.cc:499] Master 127.1.248.126:46043 was elected leader, sending a full tablet report...
I20260709 12:15:41.101244  8094 tablet_service.cc:1511] Processing CreateTablet for tablet eb422c1b757045358366d25d227e95ec (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:15:41.102691  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb422c1b757045358366d25d227e95ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.111073  8372 tablet_bootstrap.cc:654] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.112134  8318 tablet_service.cc:1511] Processing CreateTablet for tablet 2d02767f53ba4da998190270c72317fb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:15:41.115563  8165 tablet_service.cc:1511] Processing CreateTablet for tablet eb422c1b757045358366d25d227e95ec (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:15:41.124634  8165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb422c1b757045358366d25d227e95ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.127298  8318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d02767f53ba4da998190270c72317fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.141170  8088 tablet_service.cc:1511] Processing CreateTablet for tablet 2d02767f53ba4da998190270c72317fb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:15:41.142789  8088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d02767f53ba4da998190270c72317fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.146166  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 2d02767f53ba4da998190270c72317fb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:15:41.142566  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54e3337256948f3b81b2ac605542399" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:41.147595  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d02767f53ba4da998190270c72317fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:41.148788  8222 leader_election.cc:343] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:41.154690  8282 tablet.cc:2406] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:41.155064  8166 tablet_service.cc:1511] Processing CreateTablet for tablet ac5c04cc27ba4d1dbb26c919321fbfa9 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:15:41.156558  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac5c04cc27ba4d1dbb26c919321fbfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.173048  8374 tablet_bootstrap.cc:492] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:41.191103  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54e3337256948f3b81b2ac605542399" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:41.193427  8219 leader_election.cc:343] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.193928  8219 leader_election.cc:304] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:41.195677  8378 raft_consensus.cc:2749] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:41.205866  8371 ts_tablet_manager.cc:1434] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.239s	user 0.015s	sys 0.019s
I20260709 12:15:41.207122  8371 tablet_bootstrap.cc:492] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:41.207830  8373 tablet_bootstrap.cc:492] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:41.208359  8373 ts_tablet_manager.cc:1403] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.349s	user 0.017s	sys 0.020s
I20260709 12:15:41.213696  8240 tablet_service.cc:1511] Processing CreateTablet for tablet ac5c04cc27ba4d1dbb26c919321fbfa9 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:15:41.215086  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac5c04cc27ba4d1dbb26c919321fbfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.215797  8090 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7f51cbe52e4c4c99fc31b081f4372a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:15:41.222579  8384 raft_consensus.cc:493] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.223057  8170 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7f51cbe52e4c4c99fc31b081f4372a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:15:41.223184  8384 raft_consensus.cc:515] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:41.224539  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7f51cbe52e4c4c99fc31b081f4372a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.224530  8245 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7f51cbe52e4c4c99fc31b081f4372a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:15:41.225869  8384 leader_election.cc:290] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:41.226306  8245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7f51cbe52e4c4c99fc31b081f4372a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.228904  8311 tablet_service.cc:1511] Processing CreateTablet for tablet ac5c04cc27ba4d1dbb26c919321fbfa9 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:15:41.230252  8311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac5c04cc27ba4d1dbb26c919321fbfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.231571  8374 ts_tablet_manager.cc:1403] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.162s	user 0.044s	sys 0.024s
I20260709 12:15:41.233003  8317 tablet_service.cc:1511] Processing CreateTablet for tablet cc189c974f5542a682c54f9bde0483a1 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:15:41.234298  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc189c974f5542a682c54f9bde0483a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.237329  8319 tablet_service.cc:1511] Processing CreateTablet for tablet a85f56f39a20454d8ddeffad93e935a8 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:15:41.238440  8239 tablet_service.cc:1511] Processing CreateTablet for tablet 19bbb2e8c1a44e4183322858438fa0b4 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:15:41.238848  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85f56f39a20454d8ddeffad93e935a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.239727  8239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19bbb2e8c1a44e4183322858438fa0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.240857  8242 tablet_service.cc:1511] Processing CreateTablet for tablet a85f56f39a20454d8ddeffad93e935a8 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:15:41.242277  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85f56f39a20454d8ddeffad93e935a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.245216  8312 tablet_service.cc:1511] Processing CreateTablet for tablet 19bbb2e8c1a44e4183322858438fa0b4 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:15:41.246644  8312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19bbb2e8c1a44e4183322858438fa0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.245860  8164 tablet_service.cc:1511] Processing CreateTablet for tablet 19bbb2e8c1a44e4183322858438fa0b4 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:15:41.247884  8090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7f51cbe52e4c4c99fc31b081f4372a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.248171  8164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19bbb2e8c1a44e4183322858438fa0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.249501  8313 tablet_service.cc:1511] Processing CreateTablet for tablet 64f48f739c824c7f8ba5295113a92212 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:15:41.250707  8313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f48f739c824c7f8ba5295113a92212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.255816  8163 tablet_service.cc:1511] Processing CreateTablet for tablet cc189c974f5542a682c54f9bde0483a1 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:15:41.262158  8169 tablet_service.cc:1511] Processing CreateTablet for tablet 64f48f739c824c7f8ba5295113a92212 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:15:41.262326  8246 tablet_service.cc:1511] Processing CreateTablet for tablet 1c8e6e90970441fdad02bb1119456dea (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:15:41.258409  8171 tablet_service.cc:1511] Processing CreateTablet for tablet 6c24a2a517f14bd4a4c0887718468265 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:15:41.263764  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c8e6e90970441fdad02bb1119456dea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.273463  8167 tablet_service.cc:1511] Processing CreateTablet for tablet 325569f077184e418663d6e5e3f6fd3b (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:15:41.273509  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 325569f077184e418663d6e5e3f6fd3b (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:15:41.275687  8163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc189c974f5542a682c54f9bde0483a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.276024  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325569f077184e418663d6e5e3f6fd3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.278205  8167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325569f077184e418663d6e5e3f6fd3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.280371  8243 tablet_service.cc:1511] Processing CreateTablet for tablet 6c24a2a517f14bd4a4c0887718468265 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:15:41.280833  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f48f739c824c7f8ba5295113a92212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.281088  8237 tablet_service.cc:1511] Processing CreateTablet for tablet 3cff31edfc694b9b94b47e932c3940f9 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:15:41.281699  8243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c24a2a517f14bd4a4c0887718468265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.282526  8237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cff31edfc694b9b94b47e932c3940f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.234992  8374 raft_consensus.cc:359] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:41.284310  8374 raft_consensus.cc:385] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.284762  8374 raft_consensus.cc:740] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.285760  8372 tablet_bootstrap.cc:492] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:41.286353  8372 ts_tablet_manager.cc:1403] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.242s	user 0.015s	sys 0.023s
I20260709 12:15:41.285866  8374 consensus_queue.cc:260] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:41.289054  8171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c24a2a517f14bd4a4c0887718468265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.301591  8315 tablet_service.cc:1511] Processing CreateTablet for tablet 325569f077184e418663d6e5e3f6fd3b (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:15:41.303210  8315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325569f077184e418663d6e5e3f6fd3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.302831  8372 raft_consensus.cc:359] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:41.303761  8372 raft_consensus.cc:385] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.307554  8314 tablet_service.cc:1511] Processing CreateTablet for tablet 78aedf68b2244597bed9a1046869df3e (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:15:41.308902  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78aedf68b2244597bed9a1046869df3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.307560  8372 raft_consensus.cc:740] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.316462  8372 consensus_queue.cc:260] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:41.324784  8372 ts_tablet_manager.cc:1434] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.004s
I20260709 12:15:41.325524  8371 tablet_bootstrap.cc:654] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.325898  8372 tablet_bootstrap.cc:492] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:41.312333  8374 ts_tablet_manager.cc:1434] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 12:15:41.312026  8165 tablet_service.cc:1511] Processing CreateTablet for tablet 3cff31edfc694b9b94b47e932c3940f9 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:15:41.329443  8320 tablet_service.cc:1511] Processing CreateTablet for tablet 1c8e6e90970441fdad02bb1119456dea (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:15:41.268368  8373 raft_consensus.cc:359] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:41.340391  8373 raft_consensus.cc:385] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.348784  8166 tablet_service.cc:1511] Processing CreateTablet for tablet 78aedf68b2244597bed9a1046869df3e (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:15:41.341575  8165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cff31edfc694b9b94b47e932c3940f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.342190  8380 raft_consensus.cc:493] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.353446  8380 raft_consensus.cc:515] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:41.346015  8373 raft_consensus.cc:740] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.354717  8373 consensus_queue.cc:260] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:41.330307  8374 tablet_bootstrap.cc:492] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:41.340811  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c8e6e90970441fdad02bb1119456dea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.357929  8380 leader_election.cc:290] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:41.372498  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78aedf68b2244597bed9a1046869df3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.370359  8378 raft_consensus.cc:493] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.393329  8380 raft_consensus.cc:493] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.399391  8380 raft_consensus.cc:515] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:41.402488  8380 leader_election.cc:290] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:41.418076  8374 tablet_bootstrap.cc:654] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.424088  8373 ts_tablet_manager.cc:1434] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.215s	user 0.014s	sys 0.012s
I20260709 12:15:41.425200  8373 tablet_bootstrap.cc:492] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:41.429091  8393 raft_consensus.cc:493] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.429620  8393 raft_consensus.cc:515] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:41.441365  8237 tablet_service.cc:1511] Processing CreateTablet for tablet 97dbd2f663574037a43ecf0219ef1c48 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:15:41.442880  8237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dbd2f663574037a43ecf0219ef1c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.394544  8378 raft_consensus.cc:515] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:41.436161  8393 leader_election.cc:290] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:41.455039  8378 leader_election.cc:290] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:41.456081  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:41.456833  8182 raft_consensus.cc:2468] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:41.458287  8222 leader_election.cc:304] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:41.459745  8163 tablet_service.cc:1511] Processing CreateTablet for tablet 1c09223f8a6c4f7fb844bce6937e86f4 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:15:41.465620  8378 raft_consensus.cc:2804] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:41.466056  8378 raft_consensus.cc:493] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.466395  8378 raft_consensus.cc:3060] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.475895  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 1c09223f8a6c4f7fb844bce6937e86f4 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:15:41.477335  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c09223f8a6c4f7fb844bce6937e86f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.471397  8096 tablet_service.cc:1511] Processing CreateTablet for tablet cc189c974f5542a682c54f9bde0483a1 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:15:41.484855  8096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc189c974f5542a682c54f9bde0483a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.484977  8372 tablet_bootstrap.cc:654] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.496865  8240 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9383c8a3a24a0ba2d5b8d5e1006a50 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:15:41.498353  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9383c8a3a24a0ba2d5b8d5e1006a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.495110  8167 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9383c8a3a24a0ba2d5b8d5e1006a50 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:15:41.499936  8163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c09223f8a6c4f7fb844bce6937e86f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.500898  8167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9383c8a3a24a0ba2d5b8d5e1006a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.499329  8373 tablet_bootstrap.cc:654] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.524549  8088 tablet_service.cc:1511] Processing CreateTablet for tablet a85f56f39a20454d8ddeffad93e935a8 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:15:41.526098  8088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85f56f39a20454d8ddeffad93e935a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.526185  8378 raft_consensus.cc:515] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:41.541109  8371 tablet_bootstrap.cc:492] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:41.541816  8371 ts_tablet_manager.cc:1403] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.335s	user 0.018s	sys 0.005s
I20260709 12:15:41.546840  8371 raft_consensus.cc:359] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:41.568460  8090 tablet_service.cc:1511] Processing CreateTablet for tablet 6c24a2a517f14bd4a4c0887718468265 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:15:41.570071  8090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c24a2a517f14bd4a4c0887718468265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.570885  8378 leader_election.cc:290] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:41.570834  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:41.571785  8182 raft_consensus.cc:3060] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.573541  8242 tablet_service.cc:1511] Processing CreateTablet for tablet c92346b4a0134497acbb92c4f885a4fb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:15:41.575030  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c92346b4a0134497acbb92c4f885a4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.575706  8374 tablet_bootstrap.cc:492] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:41.576345  8374 ts_tablet_manager.cc:1403] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.246s	user 0.011s	sys 0.012s
I20260709 12:15:41.579912  8182 raft_consensus.cc:2468] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:41.580246  8374 raft_consensus.cc:359] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:41.581154  8374 raft_consensus.cc:385] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.581327  8222 leader_election.cc:304] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:41.581557  8374 raft_consensus.cc:740] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.582744  8374 consensus_queue.cc:260] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:41.584844  8169 tablet_service.cc:1511] Processing CreateTablet for tablet f0b09c2f447345459284f96e85c1af52 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:15:41.586905  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b09c2f447345459284f96e85c1af52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.588869  8378 raft_consensus.cc:2804] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:41.600700  8094 tablet_service.cc:1511] Processing CreateTablet for tablet 64f48f739c824c7f8ba5295113a92212 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:15:41.602155  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f48f739c824c7f8ba5295113a92212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.563303  8371 raft_consensus.cc:385] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.612526  8171 tablet_service.cc:1511] Processing CreateTablet for tablet b546c0cac1bd49e787e00b8c1d8e9eea (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:15:41.613880  8171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b546c0cac1bd49e787e00b8c1d8e9eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.617274  8089 tablet_service.cc:1511] Processing CreateTablet for tablet 3cff31edfc694b9b94b47e932c3940f9 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:15:41.618286  8092 tablet_service.cc:1511] Processing CreateTablet for tablet 1c8e6e90970441fdad02bb1119456dea (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:15:41.620548  8095 tablet_service.cc:1511] Processing CreateTablet for tablet 78aedf68b2244597bed9a1046869df3e (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:15:41.622596  8093 tablet_service.cc:1511] Processing CreateTablet for tablet 97dbd2f663574037a43ecf0219ef1c48 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:15:41.618672  8089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cff31edfc694b9b94b47e932c3940f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.625792  8311 tablet_service.cc:1511] Processing CreateTablet for tablet 1c09223f8a6c4f7fb844bce6937e86f4 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:15:41.626070  8091 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9383c8a3a24a0ba2d5b8d5e1006a50 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:15:41.611330  8371 raft_consensus.cc:740] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.632004  8246 tablet_service.cc:1511] Processing CreateTablet for tablet b546c0cac1bd49e787e00b8c1d8e9eea (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:15:41.633291  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b546c0cac1bd49e787e00b8c1d8e9eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.635754  8093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dbd2f663574037a43ecf0219ef1c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.636358  8311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c09223f8a6c4f7fb844bce6937e86f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.637140  8319 tablet_service.cc:1511] Processing CreateTablet for tablet c92346b4a0134497acbb92c4f885a4fb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:15:41.638000  8091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9383c8a3a24a0ba2d5b8d5e1006a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.638451  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c92346b4a0134497acbb92c4f885a4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.641325  8097 tablet_service.cc:1511] Processing CreateTablet for tablet c92346b4a0134497acbb92c4f885a4fb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:15:41.641583  8315 tablet_service.cc:1511] Processing CreateTablet for tablet f0b09c2f447345459284f96e85c1af52 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:15:41.642753  8097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c92346b4a0134497acbb92c4f885a4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.643445  8092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c8e6e90970441fdad02bb1119456dea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.643836  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd20020a2924e31be0f16636e76efa7" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:41.645166  8095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78aedf68b2244597bed9a1046869df3e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:41.646226  8296 leader_election.cc:343] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.642753  8315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b09c2f447345459284f96e85c1af52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.631356  8371 consensus_queue.cc:260] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:41.650281  8088 tablet_service.cc:1511] Processing CreateTablet for tablet f0b09c2f447345459284f96e85c1af52 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:15:41.661521  8371 ts_tablet_manager.cc:1434] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.118s	user 0.009s	sys 0.000s
I20260709 12:15:41.662142  8317 tablet_service.cc:1511] Processing CreateTablet for tablet b546c0cac1bd49e787e00b8c1d8e9eea (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:15:41.669493  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586406114304e5a9209b76096a2f1ba" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:41.677512  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b546c0cac1bd49e787e00b8c1d8e9eea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:41.678579  8296 leader_election.cc:343] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.679361  8166 tablet_service.cc:1511] Processing CreateTablet for tablet ed7d8ef97f464b0db4ddc179e9202157 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:15:41.680755  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7d8ef97f464b0db4ddc179e9202157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.685810  8088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b09c2f447345459284f96e85c1af52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.700953  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:41.706391  8372 tablet_bootstrap.cc:492] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:41.706971  8372 ts_tablet_manager.cc:1403] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.381s	user 0.030s	sys 0.004s
I20260709 12:15:41.707235  8320 tablet_service.cc:1511] Processing CreateTablet for tablet 97dbd2f663574037a43ecf0219ef1c48 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:15:41.708724  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dbd2f663574037a43ecf0219ef1c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.711933  8372 raft_consensus.cc:359] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:41.712939  8372 raft_consensus.cc:385] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.713330  8372 raft_consensus.cc:740] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.714280  8372 consensus_queue.cc:260] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:41.667053  8378 raft_consensus.cc:697] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:41.720431  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:41.721406  8182 raft_consensus.cc:2393] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in current term 1: Already voted for candidate 66af1447f2c64ebda5448a760d5d7718 in this term.
I20260709 12:15:41.729312  8378 consensus_queue.cc:237] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:41.732076  8374 ts_tablet_manager.cc:1434] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.155s	user 0.011s	sys 0.017s
I20260709 12:15:41.733237  8374 tablet_bootstrap.cc:492] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:41.733568  8372 ts_tablet_manager.cc:1434] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:15:41.736719  8372 tablet_bootstrap.cc:492] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:41.744244  8237 tablet_service.cc:1511] Processing CreateTablet for tablet ed7d8ef97f464b0db4ddc179e9202157 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:15:41.744684  8313 tablet_service.cc:1511] Processing CreateTablet for tablet 7f68e739edae4a70821a0646a5db9431 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:15:41.745651  8237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7d8ef97f464b0db4ddc179e9202157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.746057  8313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f68e739edae4a70821a0646a5db9431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.749047  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:41.758878  8380 raft_consensus.cc:493] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.759495  8380 raft_consensus.cc:515] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:41.761701  8380 leader_election.cc:290] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:41.763502  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:41.763548  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:41.763502  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd20020a2924e31be0f16636e76efa7" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:41.764488  8107 raft_consensus.cc:2468] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:41.763878  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c3e4c9802147f59a86d193db6f981a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:41.765447  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
W20260709 12:15:41.765971  8293 leader_election.cc:343] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.766119  8106 raft_consensus.cc:3060] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:41.766479  8296 leader_election.cc:343] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.766739  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586406114304e5a9209b76096a2f1ba" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:41.766481  8293 leader_election.cc:304] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
W20260709 12:15:41.769513  8293 leader_election.cc:343] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.769919  8293 leader_election.cc:304] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:41.770963  8380 raft_consensus.cc:2749] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:41.771672  8380 raft_consensus.cc:2749] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:41.772115  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c3e4c9802147f59a86d193db6f981a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:41.774647  8145 leader_election.cc:304] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:41.775657  8390 raft_consensus.cc:2749] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:41.776737  8106 raft_consensus.cc:2468] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:41.781433  8373 tablet_bootstrap.cc:492] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:41.782471  8371 tablet_bootstrap.cc:492] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:41.783375  8091 tablet_service.cc:1511] Processing CreateTablet for tablet 7f68e739edae4a70821a0646a5db9431 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:15:41.794533  8053 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:41.800093  8373 ts_tablet_manager.cc:1403] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.374s	user 0.028s	sys 0.015s
I20260709 12:15:41.817354  8373 raft_consensus.cc:359] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:41.818120  8373 raft_consensus.cc:385] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.818418  8373 raft_consensus.cc:740] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.818603  8073 leader_election.cc:304] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:41.819796  8091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f68e739edae4a70821a0646a5db9431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.819917  8384 raft_consensus.cc:2749] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:41.821717  8004 catalog_manager.cc:5697] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:41.802264  8374 tablet_bootstrap.cc:654] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.833765  8167 tablet_service.cc:1511] Processing CreateTablet for tablet 7f68e739edae4a70821a0646a5db9431 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:15:41.835808  8167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f68e739edae4a70821a0646a5db9431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.839744  8094 tablet_service.cc:1511] Processing CreateTablet for tablet 385f9fa3d1004f2f820b3f26592cbd1a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:15:41.841089  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385f9fa3d1004f2f820b3f26592cbd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.845515  8169 tablet_service.cc:1511] Processing CreateTablet for tablet c6d0c551bc6b4d279dbcf6d09ea8d741 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:15:41.846354  8240 tablet_service.cc:1511] Processing CreateTablet for tablet c6d0c551bc6b4d279dbcf6d09ea8d741 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:15:41.846854  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d0c551bc6b4d279dbcf6d09ea8d741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.847656  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d0c551bc6b4d279dbcf6d09ea8d741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.849539  8092 tablet_service.cc:1511] Processing CreateTablet for tablet ae828d825348490eb62b74680a762deb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:15:41.850878  8092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae828d825348490eb62b74680a762deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.787289  8096 tablet_service.cc:1511] Processing CreateTablet for tablet ed7d8ef97f464b0db4ddc179e9202157 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:15:41.857370  8096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7d8ef97f464b0db4ddc179e9202157. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:41.860672  8293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:34153, user_credentials={real_user=slave}} blocked reactor thread for 91191.9us
W20260709 12:15:41.862913  8293 leader_election.cc:343] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.864486  8315 tablet_service.cc:1511] Processing CreateTablet for tablet c6d0c551bc6b4d279dbcf6d09ea8d741 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:15:41.864595  8163 tablet_service.cc:1511] Processing CreateTablet for tablet ae828d825348490eb62b74680a762deb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:15:41.865772  8371 tablet_bootstrap.cc:654] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.866168  8163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae828d825348490eb62b74680a762deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.865368  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 385f9fa3d1004f2f820b3f26592cbd1a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:15:41.869628  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385f9fa3d1004f2f820b3f26592cbd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.863405  8293 leader_election.cc:304] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:41.871822  8242 tablet_service.cc:1511] Processing CreateTablet for tablet ae828d825348490eb62b74680a762deb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:15:41.872644  8380 raft_consensus.cc:2749] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:41.876852  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae828d825348490eb62b74680a762deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.876627  8243 tablet_service.cc:1511] Processing CreateTablet for tablet 642643c6b8a74401860aad4b969f9131 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:15:41.877964  8243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 642643c6b8a74401860aad4b969f9131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.878981  8089 tablet_service.cc:1511] Processing CreateTablet for tablet 8d921491df994357a386e8d378ccfd09 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:15:41.880443  8089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d921491df994357a386e8d378ccfd09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.880468  8097 tablet_service.cc:1511] Processing CreateTablet for tablet 642643c6b8a74401860aad4b969f9131 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:15:41.881875  8097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 642643c6b8a74401860aad4b969f9131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.883203  8239 tablet_service.cc:1511] Processing CreateTablet for tablet b2eac4b35b3646478eb5d30222e9ec59 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:15:41.884341  8171 tablet_service.cc:1511] Processing CreateTablet for tablet 8d921491df994357a386e8d378ccfd09 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:15:41.884426  8166 tablet_service.cc:1511] Processing CreateTablet for tablet b2eac4b35b3646478eb5d30222e9ec59 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:15:41.884449  8239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2eac4b35b3646478eb5d30222e9ec59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.887094  8319 tablet_service.cc:1511] Processing CreateTablet for tablet 642643c6b8a74401860aad4b969f9131 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:15:41.887800  8314 tablet_service.cc:1511] Processing CreateTablet for tablet b2eac4b35b3646478eb5d30222e9ec59 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:15:41.892012  8171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d921491df994357a386e8d378ccfd09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.893747  8090 tablet_service.cc:1511] Processing CreateTablet for tablet da3dcd2b92f84d1899b354f41bc21714 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:15:41.894891  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2eac4b35b3646478eb5d30222e9ec59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.894997  8090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3dcd2b92f84d1899b354f41bc21714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.819231  8373 consensus_queue.cc:260] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:41.901561  8373 ts_tablet_manager.cc:1434] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.087s	user 0.003s	sys 0.003s
I20260709 12:15:41.902629  8373 tablet_bootstrap.cc:492] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:41.905941  8311 tablet_service.cc:1511] Processing CreateTablet for tablet 8d921491df994357a386e8d378ccfd09 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:15:41.885934  8372 tablet_bootstrap.cc:654] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.884289  8317 tablet_service.cc:1511] Processing CreateTablet for tablet 385f9fa3d1004f2f820b3f26592cbd1a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:15:41.913225  8170 tablet_service.cc:1511] Processing CreateTablet for tablet da3dcd2b92f84d1899b354f41bc21714 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:15:41.914326  8378 raft_consensus.cc:493] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.914574  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3dcd2b92f84d1899b354f41bc21714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.914855  8378 raft_consensus.cc:515] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:41.919472  8315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d0c551bc6b4d279dbcf6d09ea8d741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.924221  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c617ad97f8c44009de3d3d47311ad6a" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:41.925802  8222 leader_election.cc:343] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.941699  8374 tablet_bootstrap.cc:492] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:41.942289  8374 ts_tablet_manager.cc:1403] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.209s	user 0.014s	sys 0.004s
I20260709 12:15:41.943822  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2eac4b35b3646478eb5d30222e9ec59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.945135  8378 leader_election.cc:290] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:41.944973  8311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d921491df994357a386e8d378ccfd09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.945583  8374 raft_consensus.cc:359] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:41.946357  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c617ad97f8c44009de3d3d47311ad6a" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:41.948036  8219 leader_election.cc:343] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.948505  8219 leader_election.cc:304] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:41.949630  8378 raft_consensus.cc:2749] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:41.946558  8374 raft_consensus.cc:385] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.951785  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385f9fa3d1004f2f820b3f26592cbd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.951752  8374 raft_consensus.cc:740] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.952860  8374 consensus_queue.cc:260] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:41.955500  8374 ts_tablet_manager.cc:1434] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 12:15:41.956530  8374 tablet_bootstrap.cc:492] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:41.965493  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 642643c6b8a74401860aad4b969f9131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.966863  8246 tablet_service.cc:1511] Processing CreateTablet for tablet da3dcd2b92f84d1899b354f41bc21714 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:15:41.968245  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3dcd2b92f84d1899b354f41bc21714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.977350  8373 tablet_bootstrap.cc:654] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.991097  8320 tablet_service.cc:1511] Processing CreateTablet for tablet 4df02ba9540747b5a8c99951df903897 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:15:41.992760  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df02ba9540747b5a8c99951df903897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.007707  8088 tablet_service.cc:1511] Processing CreateTablet for tablet 4df02ba9540747b5a8c99951df903897 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:15:42.009186  8088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df02ba9540747b5a8c99951df903897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.014084  8374 tablet_bootstrap.cc:654] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.047525  8166 tablet_service.cc:1511] Processing CreateTablet for tablet 4df02ba9540747b5a8c99951df903897 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:15:42.049853  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df02ba9540747b5a8c99951df903897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.071223  8371 tablet_bootstrap.cc:492] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:42.072079  8371 ts_tablet_manager.cc:1403] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.290s	user 0.024s	sys 0.026s
I20260709 12:15:42.075290  8372 tablet_bootstrap.cc:492] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:42.075884  8372 ts_tablet_manager.cc:1403] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.339s	user 0.018s	sys 0.031s
I20260709 12:15:42.077710  8373 tablet_bootstrap.cc:492] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:42.078256  8373 ts_tablet_manager.cc:1403] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.176s	user 0.005s	sys 0.017s
I20260709 12:15:42.082293  8373 raft_consensus.cc:359] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.083029  8373 raft_consensus.cc:385] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.083320  8373 raft_consensus.cc:740] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.089177  8372 raft_consensus.cc:359] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.091329  8374 tablet_bootstrap.cc:492] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:42.101816  8374 ts_tablet_manager.cc:1403] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.145s	user 0.014s	sys 0.007s
I20260709 12:15:42.091912  8373 consensus_queue.cc:260] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.104645  8373 ts_tablet_manager.cc:1434] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:15:42.105144  8374 raft_consensus.cc:359] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.105701  8373 tablet_bootstrap.cc:492] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:42.105947  8374 raft_consensus.cc:385] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.106285  8374 raft_consensus.cc:740] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.091913  8319 tablet_service.cc:1511] Processing CreateTablet for tablet 879b385c0a08435a943ff307ac8fb275 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:15:42.108287  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879b385c0a08435a943ff307ac8fb275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.112644  8390 raft_consensus.cc:493] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.113247  8384 raft_consensus.cc:493] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.113183  8390 raft_consensus.cc:515] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.113780  8384 raft_consensus.cc:515] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.115974  8384 leader_election.cc:290] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:42.116705  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7014425193644424abe3ad50857b4051" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:42.117444  8256 raft_consensus.cc:2468] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:42.120990  8073 leader_election.cc:304] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:42.123049  8372 raft_consensus.cc:385] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.116490  8371 raft_consensus.cc:359] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.123229  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8ee678c5a84a93befee23e8e48c8ea" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:42.124022  8384 raft_consensus.cc:2804] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.126799  8166 tablet_service.cc:1511] Processing CreateTablet for tablet 7f64ebcb5be64da88badd16aa178cd4a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:15:42.123057  8390 leader_election.cc:290] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
W20260709 12:15:42.133368  8148 leader_election.cc:343] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.132200  8384 raft_consensus.cc:493] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.134210  8384 raft_consensus.cc:3060] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.137859  8374 consensus_queue.cc:260] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.132246  8371 raft_consensus.cc:385] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.139765  8371 raft_consensus.cc:740] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.094398  8093 tablet_service.cc:1511] Processing CreateTablet for tablet 879b385c0a08435a943ff307ac8fb275 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:15:42.099998  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 879b385c0a08435a943ff307ac8fb275 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:15:42.144213  8384 raft_consensus.cc:515] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.140235  8373 tablet_bootstrap.cc:654] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.146106  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f64ebcb5be64da88badd16aa178cd4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.146456  8374 ts_tablet_manager.cc:1434] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:15:42.147563  8374 tablet_bootstrap.cc:492] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:42.144750  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879b385c0a08435a943ff307ac8fb275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.147312  8371 consensus_queue.cc:260] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.151738  8311 tablet_service.cc:1511] Processing CreateTablet for tablet 7f64ebcb5be64da88badd16aa178cd4a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:15:42.155994  8093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879b385c0a08435a943ff307ac8fb275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.156847  8384 leader_election.cc:290] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:42.157697  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7014425193644424abe3ad50857b4051" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:42.158298  8256 raft_consensus.cc:3060] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.132356  8372 raft_consensus.cc:740] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.163897  8390 raft_consensus.cc:493] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.167757  8311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f64ebcb5be64da88badd16aa178cd4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.168356  8390 raft_consensus.cc:515] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.170619  8390 leader_election.cc:290] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:42.169962  8372 consensus_queue.cc:260] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.171676  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fc1fe247f341ed91a83cf61e4529f3" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:42.175017  8091 tablet_service.cc:1511] Processing CreateTablet for tablet 008c85279d534f24a2dd08e7bbd167cb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:15:42.176784  8091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008c85279d534f24a2dd08e7bbd167cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.176680  8246 tablet_service.cc:1511] Processing CreateTablet for tablet 7f64ebcb5be64da88badd16aa178cd4a (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:15:42.177980  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f64ebcb5be64da88badd16aa178cd4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.178228  8256 raft_consensus.cc:2468] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:42.183547  8073 leader_election.cc:304] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:42.184854  8315 tablet_service.cc:1511] Processing CreateTablet for tablet 676232727c4f42c28fd5608fbeb3f634 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 12:15:42.185719  8145 leader_election.cc:343] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.186187  8315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 676232727c4f42c28fd5608fbeb3f634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.185966  8094 tablet_service.cc:1511] Processing CreateTablet for tablet 710d05d6f10242a7b13561b37f5eae08 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:15:42.187199  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710d05d6f10242a7b13561b37f5eae08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.185070  8384 raft_consensus.cc:2804] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.187790  8384 raft_consensus.cc:697] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:42.187937  8372 ts_tablet_manager.cc:1434] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.112s	user 0.004s	sys 0.005s
I20260709 12:15:42.188653  8384 consensus_queue.cc:237] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.189597  8372 tablet_bootstrap.cc:492] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:42.185179  8371 ts_tablet_manager.cc:1434] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.113s	user 0.004s	sys 0.004s
I20260709 12:15:42.200374  8089 tablet_service.cc:1511] Processing CreateTablet for tablet 676232727c4f42c28fd5608fbeb3f634 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:15:42.202064  8166 tablet_service.cc:1511] Processing CreateTablet for tablet 008c85279d534f24a2dd08e7bbd167cb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:15:42.203315  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008c85279d534f24a2dd08e7bbd167cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.213300  8089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 676232727c4f42c28fd5608fbeb3f634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.215726  8170 tablet_service.cc:1511] Processing CreateTablet for tablet 710d05d6f10242a7b13561b37f5eae08 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:15:42.216567  8371 tablet_bootstrap.cc:492] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:42.216400  8240 tablet_service.cc:1511] Processing CreateTablet for tablet 008c85279d534f24a2dd08e7bbd167cb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:15:42.217082  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710d05d6f10242a7b13561b37f5eae08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.216192  8317 tablet_service.cc:1511] Processing CreateTablet for tablet 710d05d6f10242a7b13561b37f5eae08 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:15:42.217693  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008c85279d534f24a2dd08e7bbd167cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.218355  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710d05d6f10242a7b13561b37f5eae08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.239640  8314 tablet_service.cc:1511] Processing CreateTablet for tablet 2041e92a156540d1854b8b4cccdb3ee8 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:15:42.240228  8373 tablet_bootstrap.cc:492] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:42.240811  8373 ts_tablet_manager.cc:1403] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.019s
I20260709 12:15:42.241057  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2041e92a156540d1854b8b4cccdb3ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.235255  8378 raft_consensus.cc:493] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.246690  8242 tablet_service.cc:1511] Processing CreateTablet for tablet 676232727c4f42c28fd5608fbeb3f634 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:15:42.246901  8378 raft_consensus.cc:515] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.248066  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 676232727c4f42c28fd5608fbeb3f634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.247891  8096 tablet_service.cc:1511] Processing CreateTablet for tablet 279bf9ef43054f1e83e60ed4dd074176 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:15:42.249200  8096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 279bf9ef43054f1e83e60ed4dd074176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.249253  8378 leader_election.cc:290] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:42.250381  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544e8410d33f4f21851df79c3d646d76" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:42.252033  8222 leader_election.cc:343] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.252024  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544e8410d33f4f21851df79c3d646d76" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
W20260709 12:15:42.254175  8219 leader_election.cc:343] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.254635  8219 leader_election.cc:304] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:42.257273  8004 catalog_manager.cc:5697] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.263659  8378 raft_consensus.cc:2749] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:42.272065  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7014425193644424abe3ad50857b4051" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:42.274204  8070 leader_election.cc:343] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.275419  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7014425193644424abe3ad50857b4051" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
W20260709 12:15:42.277040  8070 leader_election.cc:343] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.276858  8373 raft_consensus.cc:359] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.277691  8373 raft_consensus.cc:385] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.278020  8373 raft_consensus.cc:740] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.278765  8371 tablet_bootstrap.cc:654] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.282892  8374 tablet_bootstrap.cc:654] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.299923  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fc1fe247f341ed91a83cf61e4529f3" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:42.300580  8372 tablet_bootstrap.cc:654] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.300763  8329 raft_consensus.cc:2468] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:42.299129  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8ee678c5a84a93befee23e8e48c8ea" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:42.303160  8145 leader_election.cc:304] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:42.278812  8373 consensus_queue.cc:260] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.304386  8390 raft_consensus.cc:2804] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.304849  8390 raft_consensus.cc:493] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.305203  8390 raft_consensus.cc:3060] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.299830  8170 tablet_service.cc:1511] Processing CreateTablet for tablet 2041e92a156540d1854b8b4cccdb3ee8 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:15:42.305511  8239 tablet_service.cc:1511] Processing CreateTablet for tablet 2041e92a156540d1854b8b4cccdb3ee8 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:15:42.308794  8239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2041e92a156540d1854b8b4cccdb3ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.312165  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2041e92a156540d1854b8b4cccdb3ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.313582  8390 raft_consensus.cc:515] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
W20260709 12:15:42.304389  8145 leader_election.cc:343] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.315887  8145 leader_election.cc:304] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:42.317926  8166 tablet_service.cc:1511] Processing CreateTablet for tablet 279bf9ef43054f1e83e60ed4dd074176 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:15:42.318360  8384 raft_consensus.cc:493] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.334179  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 279bf9ef43054f1e83e60ed4dd074176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.349073  8384 raft_consensus.cc:515] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.359364  8374 tablet_bootstrap.cc:492] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:42.360013  8374 ts_tablet_manager.cc:1403] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.213s	user 0.019s	sys 0.002s
I20260709 12:15:42.360163  8384 leader_election.cc:290] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:42.361922  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd20020a2924e31be0f16636e76efa7" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:42.362655  8330 raft_consensus.cc:2468] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:42.364043  8070 leader_election.cc:304] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:42.364902  8384 raft_consensus.cc:2804] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.365286  8384 raft_consensus.cc:493] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.365633  8384 raft_consensus.cc:3060] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.367143  8374 raft_consensus.cc:359] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.368198  8374 raft_consensus.cc:385] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.368664  8374 raft_consensus.cc:740] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.369719  8374 consensus_queue.cc:260] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.379263  8390 leader_election.cc:290] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:42.380136  8390 raft_consensus.cc:2749] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:42.339134  8378 consensus_queue.cc:1048] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
I20260709 12:15:42.385160  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 279bf9ef43054f1e83e60ed4dd074176 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:15:42.393107  8171 tablet_service.cc:1511] Processing CreateTablet for tablet c8349f261931413588e7bbd0421e52fb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:15:42.394472  8171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8349f261931413588e7bbd0421e52fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.398350  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 279bf9ef43054f1e83e60ed4dd074176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.413895  8429 consensus_queue.cc:1048] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:42.410748  8319 tablet_service.cc:1511] Processing CreateTablet for tablet c8349f261931413588e7bbd0421e52fb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:15:42.419204  8242 tablet_service.cc:1511] Processing CreateTablet for tablet e76a73968afd4c25951776edaf3da243 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:15:42.421180  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8349f261931413588e7bbd0421e52fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.421327  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76a73968afd4c25951776edaf3da243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.391924  8094 tablet_service.cc:1511] Processing CreateTablet for tablet c8349f261931413588e7bbd0421e52fb (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:15:42.424604  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8349f261931413588e7bbd0421e52fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.425261  8373 ts_tablet_manager.cc:1434] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.184s	user 0.038s	sys 0.066s
I20260709 12:15:42.426507  8373 tablet_bootstrap.cc:492] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:42.426654  8384 raft_consensus.cc:515] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.432886  8314 tablet_service.cc:1511] Processing CreateTablet for tablet e76a73968afd4c25951776edaf3da243 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:15:42.443552  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76a73968afd4c25951776edaf3da243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:42.443933  8089 tablet_service.cc:1511] Processing CreateTablet for tablet e76a73968afd4c25951776edaf3da243 (DEFAULT_TABLE table=test-workload [id=96312a3860314324a92695dee874239a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:15:42.445446  8089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76a73968afd4c25951776edaf3da243. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:42.437446  8145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:44023, user_credentials={real_user=slave}} blocked reactor thread for 133099us
I20260709 12:15:42.446777  8373 tablet_bootstrap.cc:654] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.448042  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fc1fe247f341ed91a83cf61e4529f3" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:42.448488  8372 tablet_bootstrap.cc:492] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:42.448625  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fc1fe247f341ed91a83cf61e4529f3" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:42.444141  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd20020a2924e31be0f16636e76efa7" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:42.449733  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd20020a2924e31be0f16636e76efa7" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:42.450338  8330 raft_consensus.cc:3060] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.451378  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd20020a2924e31be0f16636e76efa7" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:42.448652  8329 raft_consensus.cc:3060] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.449018  8372 ts_tablet_manager.cc:1403] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.260s	user 0.022s	sys 0.050s
W20260709 12:15:42.454077  8073 leader_election.cc:343] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:42.454816  8145 leader_election.cc:343] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.463352  8372 raft_consensus.cc:359] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.464427  8372 raft_consensus.cc:385] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.440269  8384 leader_election.cc:290] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
W20260709 12:15:42.471827  8073 leader_election.cc:343] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.464807  8372 raft_consensus.cc:740] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.479593  8427 raft_consensus.cc:493] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.490880  8427 raft_consensus.cc:515] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.493196  8427 leader_election.cc:290] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:42.494338  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c3e4c9802147f59a86d193db6f981a" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:42.486480  8329 raft_consensus.cc:2468] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:42.495302  8328 raft_consensus.cc:2468] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:42.495589  8330 raft_consensus.cc:2468] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:42.519549  8145 leader_election.cc:304] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:42.519953  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c3e4c9802147f59a86d193db6f981a" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:42.521271  8070 leader_election.cc:304] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:42.521412  8145 leader_election.cc:304] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:42.522689  8427 raft_consensus.cc:2804] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:15:42.523021  8145 leader_election.cc:343] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.523360  8427 raft_consensus.cc:697] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:42.524564  8427 consensus_queue.cc:237] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.516319  8372 consensus_queue.cc:260] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.527601  8384 raft_consensus.cc:2804] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.528184  8384 raft_consensus.cc:697] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:42.529011  8384 consensus_queue.cc:237] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.527652  8390 raft_consensus.cc:2804] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.531535  8390 raft_consensus.cc:493] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.531728  8373 tablet_bootstrap.cc:492] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:42.531945  8390 raft_consensus.cc:3060] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.532593  8373 ts_tablet_manager.cc:1403] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.106s	user 0.034s	sys 0.039s
I20260709 12:15:42.543391  8373 raft_consensus.cc:359] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.544451  8373 raft_consensus.cc:385] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.544855  8373 raft_consensus.cc:740] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.545893  8373 consensus_queue.cc:260] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.548352  8374 ts_tablet_manager.cc:1434] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.188s	user 0.005s	sys 0.018s
I20260709 12:15:42.550177  8373 ts_tablet_manager.cc:1434] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 12:15:42.550508  8372 ts_tablet_manager.cc:1434] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.006s
I20260709 12:15:42.551646  8372 tablet_bootstrap.cc:492] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:42.551647  8373 tablet_bootstrap.cc:492] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:42.562580  8373 tablet_bootstrap.cc:654] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.567718  8374 tablet_bootstrap.cc:492] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:42.576673  8374 tablet_bootstrap.cc:654] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:42.589277  8070 consensus_peers.cc:597] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 -> Peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Couldn't send request to peer 9058059c81534bc4b58c5329d5734dcc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.602023  8429 raft_consensus.cc:493] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.602844  8429 raft_consensus.cc:515] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.609822  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8ee678c5a84a93befee23e8e48c8ea" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:42.610810  8182 raft_consensus.cc:2468] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:42.612919  8372 tablet_bootstrap.cc:654] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.612648  8222 leader_election.cc:304] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:42.614163  8390 raft_consensus.cc:515] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.617808  8378 raft_consensus.cc:2804] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.619130  8378 raft_consensus.cc:493] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.621627  8378 raft_consensus.cc:3060] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.626824  8390 leader_election.cc:290] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:42.629482  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c3e4c9802147f59a86d193db6f981a" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:42.631322  8374 tablet_bootstrap.cc:492] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:42.632022  8374 ts_tablet_manager.cc:1403] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.027s
I20260709 12:15:42.632529  8429 leader_election.cc:290] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
W20260709 12:15:42.632923  8145 leader_election.cc:343] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.632180  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c3e4c9802147f59a86d193db6f981a" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:42.634275  8330 raft_consensus.cc:3060] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.634196  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8ee678c5a84a93befee23e8e48c8ea" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:42.634977  8328 raft_consensus.cc:2468] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:42.635324  8374 raft_consensus.cc:359] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.637287  8003 catalog_manager.cc:5697] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:42.641185  8378 raft_consensus.cc:515] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.644237  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8ee678c5a84a93befee23e8e48c8ea" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:42.644872  8182 raft_consensus.cc:3060] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.646534  8330 raft_consensus.cc:2468] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:42.636096  8374 raft_consensus.cc:385] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.647810  8374 raft_consensus.cc:740] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.648828  8374 consensus_queue.cc:260] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.652119  8374 ts_tablet_manager.cc:1434] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:15:42.654122  8145 leader_election.cc:304] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:42.653991  8182 raft_consensus.cc:2468] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:42.655304  8371 tablet_bootstrap.cc:492] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:42.655450  8390 raft_consensus.cc:2804] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.655936  8371 ts_tablet_manager.cc:1403] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.440s	user 0.021s	sys 0.038s
I20260709 12:15:42.655934  8222 leader_election.cc:304] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:42.657078  8429 raft_consensus.cc:2804] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.657454  8374 tablet_bootstrap.cc:492] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:42.657544  8429 raft_consensus.cc:697] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:42.658660  8429 consensus_queue.cc:237] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.659490  8371 raft_consensus.cc:359] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.661623  8373 tablet_bootstrap.cc:492] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:42.662223  8373 ts_tablet_manager.cc:1403] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.005s
I20260709 12:15:42.660323  8371 raft_consensus.cc:385] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.664342  8371 raft_consensus.cc:740] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.665158  8371 consensus_queue.cc:260] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.656200  8390 raft_consensus.cc:697] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:42.666383  8378 leader_election.cc:290] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:42.666582  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8ee678c5a84a93befee23e8e48c8ea" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:42.667351  8330 raft_consensus.cc:3060] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.668798  8378 raft_consensus.cc:493] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.669417  8378 raft_consensus.cc:515] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.672194  8374 tablet_bootstrap.cc:654] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.673468  8390 consensus_queue.cc:237] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.674422  8002 catalog_manager.cc:5697] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:42.675154  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:42.676766  8219 leader_election.cc:343] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.676993  8371 ts_tablet_manager.cc:1434] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.005s
I20260709 12:15:42.677887  8378 leader_election.cc:290] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:42.678122  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:42.678140  8371 tablet_bootstrap.cc:492] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
W20260709 12:15:42.679749  8219 leader_election.cc:343] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.680276  8219 leader_election.cc:304] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:42.681589  8378 raft_consensus.cc:2749] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:42.684398  8330 raft_consensus.cc:2468] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:42.688520  8371 tablet_bootstrap.cc:654] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.689483  8373 raft_consensus.cc:359] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.691308  8373 raft_consensus.cc:385] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.691711  8373 raft_consensus.cc:740] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.692770  8373 consensus_queue.cc:260] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.695848  8372 tablet_bootstrap.cc:492] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:42.700356  8372 ts_tablet_manager.cc:1403] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.149s	user 0.021s	sys 0.012s
I20260709 12:15:42.703964  8372 raft_consensus.cc:359] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.704825  8372 raft_consensus.cc:385] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.705174  8372 raft_consensus.cc:740] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.707260  8002 catalog_manager.cc:5697] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.707890  8372 consensus_queue.cc:260] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.706961  8373 ts_tablet_manager.cc:1434] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:15:42.702466  8003 catalog_manager.cc:5697] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:42.710055  8373 tablet_bootstrap.cc:492] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:42.716938  8372 ts_tablet_manager.cc:1434] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:15:42.722050  8372 tablet_bootstrap.cc:492] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:42.729493  8373 tablet_bootstrap.cc:654] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.736760  8372 tablet_bootstrap.cc:654] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.748338  8374 tablet_bootstrap.cc:492] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:42.748849  8374 ts_tablet_manager.cc:1403] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.092s	user 0.027s	sys 0.014s
I20260709 12:15:42.750281  8371 tablet_bootstrap.cc:492] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:42.750808  8371 ts_tablet_manager.cc:1403] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.073s	user 0.030s	sys 0.030s
I20260709 12:15:42.751844  8372 tablet_bootstrap.cc:492] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:42.751818  8374 raft_consensus.cc:359] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.752517  8372 ts_tablet_manager.cc:1403] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.000s
I20260709 12:15:42.752628  8374 raft_consensus.cc:385] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.753027  8374 raft_consensus.cc:740] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.753750  8374 consensus_queue.cc:260] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.753975  8371 raft_consensus.cc:359] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.754727  8371 raft_consensus.cc:385] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.755038  8371 raft_consensus.cc:740] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.756062  8374 ts_tablet_manager.cc:1434] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:42.755805  8371 consensus_queue.cc:260] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.756274  8372 raft_consensus.cc:359] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.757068  8372 raft_consensus.cc:385] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.757396  8372 raft_consensus.cc:740] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.758225  8371 ts_tablet_manager.cc:1434] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:15:42.758123  8372 consensus_queue.cc:260] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.759344  8371 tablet_bootstrap.cc:492] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:42.764129  8372 ts_tablet_manager.cc:1434] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:15:42.765488  8372 tablet_bootstrap.cc:492] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:42.766980  8371 tablet_bootstrap.cc:654] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.771864  8374 tablet_bootstrap.cc:492] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:42.778102  8372 tablet_bootstrap.cc:654] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.779110  8371 tablet_bootstrap.cc:492] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:42.779671  8371 ts_tablet_manager.cc:1403] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 12:15:42.781343  8373 tablet_bootstrap.cc:492] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:42.781747  8374 tablet_bootstrap.cc:654] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.782167  8373 ts_tablet_manager.cc:1403] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.072s	user 0.019s	sys 0.005s
I20260709 12:15:42.782773  8371 raft_consensus.cc:359] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.783705  8371 raft_consensus.cc:385] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.784020  8371 raft_consensus.cc:740] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.785110  8371 consensus_queue.cc:260] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.788623  8371 ts_tablet_manager.cc:1434] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:42.790122  8371 tablet_bootstrap.cc:492] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:42.792457  8409 raft_consensus.cc:493] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.790940  8373 raft_consensus.cc:359] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.793301  8373 raft_consensus.cc:385] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.792968  8409 raft_consensus.cc:515] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.795038  8372 tablet_bootstrap.cc:492] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:42.797005  8409 leader_election.cc:290] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:42.800360  8371 tablet_bootstrap.cc:654] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.799607  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54e3337256948f3b81b2ac605542399" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:42.800359  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54e3337256948f3b81b2ac605542399" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:42.801141  8182 raft_consensus.cc:2468] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:42.801363  8256 raft_consensus.cc:2468] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
W20260709 12:15:42.801888  8053 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:42.802683  8373 raft_consensus.cc:740] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.802491  8296 leader_election.cc:304] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:42.803730  8373 consensus_queue.cc:260] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.804262  8409 raft_consensus.cc:2804] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.804703  8409 raft_consensus.cc:493] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.805058  8409 raft_consensus.cc:3060] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.806802  8374 tablet_bootstrap.cc:492] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:42.807267  8374 ts_tablet_manager.cc:1403] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.009s
I20260709 12:15:42.811298  8384 consensus_queue.cc:1048] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:42.812489  8409 raft_consensus.cc:515] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.812924  8374 raft_consensus.cc:359] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.813583  8374 raft_consensus.cc:385] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.813866  8374 raft_consensus.cc:740] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.814561  8374 consensus_queue.cc:260] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.815237  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54e3337256948f3b81b2ac605542399" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:42.815609  8373 ts_tablet_manager.cc:1434] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:15:42.815843  8182 raft_consensus.cc:3060] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.816546  8374 ts_tablet_manager.cc:1434] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:42.817502  8374 tablet_bootstrap.cc:492] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:42.823962  8373 tablet_bootstrap.cc:492] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:42.795547  8372 ts_tablet_manager.cc:1403] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.007s
I20260709 12:15:42.837395  8372 raft_consensus.cc:359] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.838151  8372 raft_consensus.cc:385] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.838429  8372 raft_consensus.cc:740] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.825132  8182 raft_consensus.cc:2468] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:42.829453  8374 tablet_bootstrap.cc:654] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.830569  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54e3337256948f3b81b2ac605542399" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:42.842031  8255 raft_consensus.cc:3060] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.839221  8372 consensus_queue.cc:260] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.831285  8409 leader_election.cc:290] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:42.851828  8296 leader_election.cc:304] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:42.855329  8371 tablet_bootstrap.cc:492] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:42.855996  8371 ts_tablet_manager.cc:1403] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.066s	user 0.026s	sys 0.015s
I20260709 12:15:42.855360  8409 raft_consensus.cc:2804] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.858618  8409 raft_consensus.cc:697] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:42.859135  8371 raft_consensus.cc:359] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.859500  8409 consensus_queue.cc:237] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.860006  8371 raft_consensus.cc:385] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.860422  8371 raft_consensus.cc:740] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.861403  8371 consensus_queue.cc:260] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.864391  8371 ts_tablet_manager.cc:1434] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:42.865586  8371 tablet_bootstrap.cc:492] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:42.871479  8373 tablet_bootstrap.cc:654] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.871897  8371 tablet_bootstrap.cc:654] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.875905  8255 raft_consensus.cc:2468] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:42.881281  8374 tablet_bootstrap.cc:492] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:42.881913  8374 ts_tablet_manager.cc:1403] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.011s
I20260709 12:15:42.882818  8390 raft_consensus.cc:493] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.883327  8390 raft_consensus.cc:515] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.885424  8374 raft_consensus.cc:359] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.886381  8374 raft_consensus.cc:385] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.887010  8390 leader_election.cc:290] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:42.887797  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544e8410d33f4f21851df79c3d646d76" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:42.886729  8374 raft_consensus.cc:740] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.888506  8102 raft_consensus.cc:2468] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:42.887830  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544e8410d33f4f21851df79c3d646d76" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:42.889815  8145 leader_election.cc:304] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:42.889411  8374 consensus_queue.cc:260] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.890535  8255 raft_consensus.cc:2468] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:42.890928  8390 raft_consensus.cc:2804] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.891317  8390 raft_consensus.cc:493] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.891834  8390 raft_consensus.cc:3060] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.895318  8423 raft_consensus.cc:493] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.895759  8372 ts_tablet_manager.cc:1434] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.061s	user 0.016s	sys 0.006s
I20260709 12:15:42.896368  8371 tablet_bootstrap.cc:492] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:42.895881  8423 raft_consensus.cc:515] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.898437  8423 leader_election.cc:290] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:42.898948  8374 ts_tablet_manager.cc:1434] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 12:15:42.899741  8371 ts_tablet_manager.cc:1403] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.008s
I20260709 12:15:42.900038  8372 tablet_bootstrap.cc:492] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:42.899928  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:42.901201  8374 tablet_bootstrap.cc:492] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:42.901651  8330 raft_consensus.cc:2468] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:42.903362  8070 leader_election.cc:304] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:42.904381  8423 raft_consensus.cc:2804] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.904548  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:42.904783  8423 raft_consensus.cc:493] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.905133  8423 raft_consensus.cc:3060] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.905247  8255 raft_consensus.cc:2468] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:42.906325  8371 raft_consensus.cc:359] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.907048  8371 raft_consensus.cc:385] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.907321  8371 raft_consensus.cc:740] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.908046  8371 consensus_queue.cc:260] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.910005  8371 ts_tablet_manager.cc:1434] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:15:42.910226  8374 tablet_bootstrap.cc:654] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.911026  8371 tablet_bootstrap.cc:492] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:42.912176  8457 raft_consensus.cc:493] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.912703  8457 raft_consensus.cc:515] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:42.915676  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c617ad97f8c44009de3d3d47311ad6a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:42.917158  8296 leader_election.cc:343] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.918764  8182 raft_consensus.cc:3060] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.919540  8372 tablet_bootstrap.cc:654] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.926709  8390 raft_consensus.cc:515] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.927416  8371 tablet_bootstrap.cc:654] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.941304  8390 leader_election.cc:290] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:42.942659  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544e8410d33f4f21851df79c3d646d76" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:42.943296  8256 raft_consensus.cc:3060] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.943652  8378 raft_consensus.cc:493] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.944140  8378 raft_consensus.cc:515] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.946220  8378 leader_election.cc:290] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
W20260709 12:15:42.928207  8145 consensus_peers.cc:597] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.947445  8384 raft_consensus.cc:493] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.947734  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfe39df11664509bf085d1f7cc21724" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:42.947944  8384 raft_consensus.cc:515] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
W20260709 12:15:42.949494  8222 leader_election.cc:343] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.949827  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544e8410d33f4f21851df79c3d646d76" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:42.950167  8384 leader_election.cc:290] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:42.950438  8102 raft_consensus.cc:3060] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.950698  8384 consensus_queue.cc:1048] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:42.929035  8373 tablet_bootstrap.cc:492] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:42.952169  8373 ts_tablet_manager.cc:1403] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.001s
I20260709 12:15:42.955832  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfe39df11664509bf085d1f7cc21724" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:42.956641  8371 tablet_bootstrap.cc:492] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:42.957288  8371 ts_tablet_manager.cc:1403] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.014s
I20260709 12:15:42.960886  8371 raft_consensus.cc:359] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.961790  8371 raft_consensus.cc:385] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.961864  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c3e4c9802147f59a86d193db6f981a" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:42.962237  8371 raft_consensus.cc:740] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.962921  8330 raft_consensus.cc:2393] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in current term 1: Already voted for candidate b02838a902c44ea49d8d94181285b20e in this term.
I20260709 12:15:42.963251  8371 consensus_queue.cc:260] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
W20260709 12:15:42.964339  8219 leader_election.cc:343] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.964983  8219 leader_election.cc:304] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:42.966102  8371 ts_tablet_manager.cc:1434] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:42.932636  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c617ad97f8c44009de3d3d47311ad6a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:42.968106  8255 raft_consensus.cc:2468] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:42.955137  8373 raft_consensus.cc:359] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.969167  8373 raft_consensus.cc:385] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.969434  8373 raft_consensus.cc:740] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.969578  8296 leader_election.cc:304] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:42.970170  8371 tablet_bootstrap.cc:492] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:42.970158  8373 consensus_queue.cc:260] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.960878  8256 raft_consensus.cc:2468] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:42.935549  8372 tablet_bootstrap.cc:492] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:42.967406  8102 raft_consensus.cc:2468] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:42.972538  8372 ts_tablet_manager.cc:1403] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.001s
I20260709 12:15:42.973636  8148 leader_election.cc:304] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:42.975623  8427 raft_consensus.cc:2804] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.976269  8427 raft_consensus.cc:697] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:42.916272  8423 raft_consensus.cc:515] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:42.933656  8457 leader_election.cc:290] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:42.976557  8372 raft_consensus.cc:359] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.971547  8409 raft_consensus.cc:2804] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.977201  8427 consensus_queue.cc:237] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:42.977538  8372 raft_consensus.cc:385] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.977617  8409 raft_consensus.cc:493] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.978116  8372 raft_consensus.cc:740] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.978209  8409 raft_consensus.cc:3060] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.979141  8372 consensus_queue.cc:260] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:42.982246  8372 ts_tablet_manager.cc:1434] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:15:42.983536  8372 tablet_bootstrap.cc:492] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:42.987540  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c3e4c9802147f59a86d193db6f981a" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:42.991096  8372 tablet_bootstrap.cc:654] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.994910  8426 consensus_queue.cc:1048] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:42.997638  8371 tablet_bootstrap.cc:654] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.968252  8378 raft_consensus.cc:2749] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.000878  8423 leader_election.cc:290] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:43.002425  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:43.003087  8328 raft_consensus.cc:3060] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.997520  8073 leader_election.cc:304] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:43.007761  8463 raft_consensus.cc:3060] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.008373  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:43.009168  8256 raft_consensus.cc:3060] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.013758  8373 ts_tablet_manager.cc:1434] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.003s
I20260709 12:15:43.015244  8373 tablet_bootstrap.cc:492] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:43.022408  8409 raft_consensus.cc:515] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.027024  8374 tablet_bootstrap.cc:492] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:43.027287  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c617ad97f8c44009de3d3d47311ad6a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:43.019479  8384 raft_consensus.cc:493] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.027590  8374 ts_tablet_manager.cc:1403] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.127s	user 0.053s	sys 0.035s
W20260709 12:15:43.028846  8296 leader_election.cc:343] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.028560  8384 raft_consensus.cc:515] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.030390  8423 consensus_queue.cc:1048] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.031123  8384 leader_election.cc:290] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:43.031798  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fc1fe247f341ed91a83cf61e4529f3" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:43.031797  8374 raft_consensus.cc:359] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.032917  8374 raft_consensus.cc:385] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.033265  8374 raft_consensus.cc:740] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.034008  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c617ad97f8c44009de3d3d47311ad6a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:43.033936  8374 consensus_queue.cc:260] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.034605  8255 raft_consensus.cc:3060] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.034870  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fc1fe247f341ed91a83cf61e4529f3" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:43.036067  8374 ts_tablet_manager.cc:1434] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:43.036489  8073 leader_election.cc:304] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:43.037215  8374 tablet_bootstrap.cc:492] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:43.018921  8328 raft_consensus.cc:2468] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:43.013823  8371 tablet_bootstrap.cc:492] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:43.043089  8371 ts_tablet_manager.cc:1403] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.003s
I20260709 12:15:43.042563  8255 raft_consensus.cc:2468] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:43.044020  8374 tablet_bootstrap.cc:654] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.044150  8070 leader_election.cc:304] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:43.044407  8296 leader_election.cc:304] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:43.045172  8423 raft_consensus.cc:2749] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.045240  8457 raft_consensus.cc:2804] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:43.045897  8457 raft_consensus.cc:697] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:43.045979  8423 raft_consensus.cc:2804] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:43.046478  8423 raft_consensus.cc:697] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:43.046797  8457 consensus_queue.cc:237] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.047289  8423 consensus_queue.cc:237] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.019282  8463 raft_consensus.cc:2749] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.052836  8409 leader_election.cc:290] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:43.028524  8004 catalog_manager.cc:5697] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 1 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:43.059947  8256 raft_consensus.cc:2468] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:43.082311  8371 raft_consensus.cc:359] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.083098  8371 raft_consensus.cc:385] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.082444  8005 catalog_manager.cc:5697] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.084168  8003 catalog_manager.cc:5697] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:43.083387  8371 raft_consensus.cc:740] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.101758  8459 raft_consensus.cc:493] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.105543  8459 raft_consensus.cc:515] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.108688  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:43.109352  8102 raft_consensus.cc:2468] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:43.109611  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:43.110683  8293 leader_election.cc:304] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:43.111034  8459 leader_election.cc:290] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:43.111604  8409 raft_consensus.cc:2804] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:43.111974  8409 raft_consensus.cc:493] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.112334  8409 raft_consensus.cc:3060] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.112107  8371 consensus_queue.cc:260] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.114519  8371 ts_tablet_manager.cc:1434] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:15:43.115453  8371 tablet_bootstrap.cc:492] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
W20260709 12:15:43.115760  8296 leader_election.cc:343] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.121845  8371 tablet_bootstrap.cc:654] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.125753  8373 tablet_bootstrap.cc:654] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.125983  8372 tablet_bootstrap.cc:492] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:43.126458  8372 ts_tablet_manager.cc:1403] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.143s	user 0.030s	sys 0.032s
I20260709 12:15:43.129786  8409 raft_consensus.cc:515] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.130142  8372 raft_consensus.cc:359] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.134907  8372 raft_consensus.cc:385] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.135200  8372 raft_consensus.cc:740] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.135857  8372 consensus_queue.cc:260] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.132642  8374 tablet_bootstrap.cc:492] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:43.137539  8374 ts_tablet_manager.cc:1403] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.101s	user 0.037s	sys 0.011s
I20260709 12:15:43.137966  8372 ts_tablet_manager.cc:1434] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:15:43.138978  8372 tablet_bootstrap.cc:492] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:43.139824  8378 raft_consensus.cc:493] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.140601  8374 raft_consensus.cc:359] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.141355  8374 raft_consensus.cc:385] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.140471  8378 raft_consensus.cc:515] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.141645  8374 raft_consensus.cc:740] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.142616  8374 consensus_queue.cc:260] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.144562  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a6107537934605a85ad9af15618125" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:43.144793  8378 leader_election.cc:290] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:43.145279  8102 raft_consensus.cc:2468] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:43.147034  8219 leader_election.cc:304] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:43.148056  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a6107537934605a85ad9af15618125" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:43.148816  8182 raft_consensus.cc:2468] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:43.150583  8409 leader_election.cc:290] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:43.152145  8374 ts_tablet_manager.cc:1434] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:15:43.152690  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:43.153380  8106 raft_consensus.cc:3060] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.153416  8374 tablet_bootstrap.cc:492] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:43.153820  8427 consensus_queue.cc:1048] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.160014  8433 raft_consensus.cc:2804] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:43.160466  8433 raft_consensus.cc:493] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.160799  8433 raft_consensus.cc:3060] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.144881  8372 tablet_bootstrap.cc:654] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.169099  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:43.169770  8433 raft_consensus.cc:515] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:15:43.171711  8296 leader_election.cc:343] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.177062  8433 leader_election.cc:290] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:43.178803  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a6107537934605a85ad9af15618125" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:43.179621  8182 raft_consensus.cc:3060] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.183341  8373 tablet_bootstrap.cc:492] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:43.184052  8373 ts_tablet_manager.cc:1403] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.169s	user 0.011s	sys 0.004s
I20260709 12:15:43.180420  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a6107537934605a85ad9af15618125" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:43.188134  8102 raft_consensus.cc:3060] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.189263  8106 raft_consensus.cc:2468] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:43.190824  8293 leader_election.cc:304] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:43.175788  8374 tablet_bootstrap.cc:654] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.191856  8409 raft_consensus.cc:2804] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:43.192572  8409 raft_consensus.cc:697] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:43.193441  8409 consensus_queue.cc:237] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.195873  8102 raft_consensus.cc:2468] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:43.197141  8219 leader_election.cc:304] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:43.198083  8433 raft_consensus.cc:2804] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:43.199733  8433 raft_consensus.cc:697] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:43.200604  8433 consensus_queue.cc:237] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.212175  8378 consensus_queue.cc:1048] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.190918  8182 raft_consensus.cc:2468] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:43.220546  8371 tablet_bootstrap.cc:492] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:43.222291  8371 ts_tablet_manager.cc:1403] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.009s
I20260709 12:15:43.221089  8373 raft_consensus.cc:359] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.223193  8373 raft_consensus.cc:385] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.223670  8373 raft_consensus.cc:740] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.224617  8373 consensus_queue.cc:260] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.226084  8378 raft_consensus.cc:493] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.226626  8378 raft_consensus.cc:515] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.228847  8378 leader_election.cc:290] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:43.230669  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586406114304e5a9209b76096a2f1ba" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:43.231825  8330 raft_consensus.cc:2468] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:43.232185  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586406114304e5a9209b76096a2f1ba" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:43.232872  8106 raft_consensus.cc:2468] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:43.233870  8433 consensus_queue.cc:1048] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.236409  8373 ts_tablet_manager.cc:1434] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:15:43.236883  8219 leader_election.cc:304] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:43.237942  8373 tablet_bootstrap.cc:492] T 8c617ad97f8c44009de3d3d47311ad6a P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:43.238332  8433 raft_consensus.cc:2804] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:43.238770  8433 raft_consensus.cc:493] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.239132  8433 raft_consensus.cc:3060] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.242759  8003 catalog_manager.cc:5697] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 1 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:43.253526  8426 consensus_queue.cc:1048] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:43.262837  8373 tablet_bootstrap.cc:654] T 8c617ad97f8c44009de3d3d47311ad6a P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.265786  8371 raft_consensus.cc:359] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.266594  8371 raft_consensus.cc:385] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.266856  8371 raft_consensus.cc:740] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.267652  8371 consensus_queue.cc:260] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.267647  8002 catalog_manager.cc:5697] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:43.270493  8371 ts_tablet_manager.cc:1434] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 12:15:43.271536  8371 tablet_bootstrap.cc:492] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:43.274163  8433 raft_consensus.cc:515] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.281491  8433 leader_election.cc:290] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:43.282641  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586406114304e5a9209b76096a2f1ba" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:43.283200  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586406114304e5a9209b76096a2f1ba" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:43.283186  8328 raft_consensus.cc:3060] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.283392  8409 consensus_queue.cc:1048] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:43.283952  8105 raft_consensus.cc:3060] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.291383  8328 raft_consensus.cc:2468] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:43.292026  8105 raft_consensus.cc:2468] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:43.292868  8219 leader_election.cc:304] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:43.293686  8378 raft_consensus.cc:493] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.294174  8378 raft_consensus.cc:515] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.295622  8371 tablet_bootstrap.cc:654] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.296044  8484 raft_consensus.cc:2804] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:43.296416  8378 leader_election.cc:290] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:43.296730  8484 raft_consensus.cc:697] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:43.297106  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:43.297897  8484 consensus_queue.cc:237] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.298343  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:43.298591  8219 leader_election.cc:343] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:43.299882  8222 leader_election.cc:343] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.300371  8222 leader_election.cc:304] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:43.301669  8378 raft_consensus.cc:2749] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.304936  8374 tablet_bootstrap.cc:492] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:43.305474  8374 ts_tablet_manager.cc:1403] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.152s	user 0.018s	sys 0.000s
I20260709 12:15:43.307212  8372 tablet_bootstrap.cc:492] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:43.308224  8372 ts_tablet_manager.cc:1403] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.169s	user 0.046s	sys 0.027s
I20260709 12:15:43.308434  8374 raft_consensus.cc:359] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.310395  8374 raft_consensus.cc:385] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.310737  8374 raft_consensus.cc:740] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.311625  8374 consensus_queue.cc:260] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.309590  8371 tablet_bootstrap.cc:492] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:43.312842  8371 ts_tablet_manager.cc:1403] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.002s
I20260709 12:15:43.313923  8374 ts_tablet_manager.cc:1434] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:43.318181  8374 tablet_bootstrap.cc:492] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:43.323748  8457 consensus_queue.cc:1048] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.325450  8373 tablet_bootstrap.cc:492] T 8c617ad97f8c44009de3d3d47311ad6a P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:43.325984  8373 ts_tablet_manager.cc:1403] T 8c617ad97f8c44009de3d3d47311ad6a P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.088s	user 0.016s	sys 0.000s
I20260709 12:15:43.328927  8373 raft_consensus.cc:359] T 8c617ad97f8c44009de3d3d47311ad6a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.329825  8373 raft_consensus.cc:385] T 8c617ad97f8c44009de3d3d47311ad6a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.330221  8373 raft_consensus.cc:740] T 8c617ad97f8c44009de3d3d47311ad6a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.331113  8373 consensus_queue.cc:260] T 8c617ad97f8c44009de3d3d47311ad6a P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.316780  8372 raft_consensus.cc:359] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.315718  8371 raft_consensus.cc:359] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.332289  8371 raft_consensus.cc:385] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.332585  8371 raft_consensus.cc:740] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.333257  8371 consensus_queue.cc:260] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.335253  8371 ts_tablet_manager.cc:1434] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 12:15:43.336180  8371 tablet_bootstrap.cc:492] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:43.337884  8373 ts_tablet_manager.cc:1434] T 8c617ad97f8c44009de3d3d47311ad6a P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:15:43.338903  8373 tablet_bootstrap.cc:492] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:43.339588  8372 raft_consensus.cc:385] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.339892  8372 raft_consensus.cc:740] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.340418  8374 tablet_bootstrap.cc:654] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.341603  8372 consensus_queue.cc:260] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.345257  8373 tablet_bootstrap.cc:654] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.345327  8372 ts_tablet_manager.cc:1434] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.001s
I20260709 12:15:43.346413  8372 tablet_bootstrap.cc:492] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:43.352025  8374 tablet_bootstrap.cc:492] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:43.352682  8374 ts_tablet_manager.cc:1403] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.010s
I20260709 12:15:43.353605  8105 raft_consensus.cc:3060] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.356269  8374 raft_consensus.cc:359] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.356988  8374 raft_consensus.cc:385] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.357250  8374 raft_consensus.cc:740] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.358318  8371 tablet_bootstrap.cc:654] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.357924  8374 consensus_queue.cc:260] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.366954  8390 consensus_queue.cc:1048] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.366776  8005 catalog_manager.cc:5697] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 1 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.368063  8372 tablet_bootstrap.cc:654] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.364853  8374 ts_tablet_manager.cc:1434] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:15:43.371081  8374 tablet_bootstrap.cc:492] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:43.379876  8374 tablet_bootstrap.cc:654] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.387377  8373 tablet_bootstrap.cc:492] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:43.387920  8373 ts_tablet_manager.cc:1403] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.008s
I20260709 12:15:43.391228  8373 raft_consensus.cc:359] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.391932  8373 raft_consensus.cc:385] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.392203  8373 raft_consensus.cc:740] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.392865  8373 consensus_queue.cc:260] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.395466  8373 ts_tablet_manager.cc:1434] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:15:43.396409  8373 tablet_bootstrap.cc:492] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:43.397065  8004 catalog_manager.cc:5697] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.407316  8372 tablet_bootstrap.cc:492] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:43.408054  8372 ts_tablet_manager.cc:1403] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.018s
I20260709 12:15:43.411064  8371 tablet_bootstrap.cc:492] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:43.411594  8371 ts_tablet_manager.cc:1403] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.018s
I20260709 12:15:43.413033  8373 tablet_bootstrap.cc:654] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.413869  8484 raft_consensus.cc:493] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.414420  8484 raft_consensus.cc:515] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.414644  8371 raft_consensus.cc:359] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.415457  8371 raft_consensus.cc:385] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.415817  8371 raft_consensus.cc:740] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.416625  8484 leader_election.cc:290] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:43.416662  8371 consensus_queue.cc:260] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.418274  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d552c1db4b14ac89628e14ac27582ba" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:43.419176  8371 ts_tablet_manager.cc:1434] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 12:15:43.419723  8222 leader_election.cc:343] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.420147  8371 tablet_bootstrap.cc:492] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:43.420574  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d552c1db4b14ac89628e14ac27582ba" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
W20260709 12:15:43.422194  8219 leader_election.cc:343] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.422690  8219 leader_election.cc:304] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:43.423884  8484 raft_consensus.cc:2749] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.430605  8372 raft_consensus.cc:359] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.431361  8372 raft_consensus.cc:385] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.431635  8371 tablet_bootstrap.cc:654] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.431680  8372 raft_consensus.cc:740] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.432603  8372 consensus_queue.cc:260] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.433256  8390 consensus_queue.cc:1048] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.436630  8372 ts_tablet_manager.cc:1434] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 12:15:43.438186  8372 tablet_bootstrap.cc:492] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:43.439162  8182 raft_consensus.cc:3060] T 8c617ad97f8c44009de3d3d47311ad6a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.441934  8374 tablet_bootstrap.cc:492] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:43.442435  8374 ts_tablet_manager.cc:1403] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.008s
I20260709 12:15:43.445350  8374 raft_consensus.cc:359] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.445997  8374 raft_consensus.cc:385] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.446241  8374 raft_consensus.cc:740] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.447263  8373 tablet_bootstrap.cc:492] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:43.447948  8373 ts_tablet_manager.cc:1403] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.052s	user 0.004s	sys 0.010s
I20260709 12:15:43.446939  8374 consensus_queue.cc:260] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.451773  8373 raft_consensus.cc:359] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.452744  8373 raft_consensus.cc:385] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.452523  8457 consensus_queue.cc:1048] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:43.453126  8373 raft_consensus.cc:740] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.454133  8373 consensus_queue.cc:260] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.451792  8374 ts_tablet_manager.cc:1434] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:15:43.461153  8374 tablet_bootstrap.cc:492] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:43.463513  8372 tablet_bootstrap.cc:654] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.476347  8423 consensus_queue.cc:1048] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:43.493022  8373 ts_tablet_manager.cc:1434] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.003s
I20260709 12:15:43.503962  8373 tablet_bootstrap.cc:492] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:43.505486  8469 raft_consensus.cc:493] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.506938  8463 consensus_queue.cc:1048] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.510470  8469 raft_consensus.cc:515] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.513258  8426 raft_consensus.cc:493] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.513810  8426 raft_consensus.cc:515] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.514313  8457 raft_consensus.cc:493] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.515502  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895082ba16e461b8ca83550f065f98c" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:43.515300  8457 raft_consensus.cc:515] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.516366  8426 leader_election.cc:290] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:43.516453  8255 raft_consensus.cc:2468] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:43.517570  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895082ba16e461b8ca83550f065f98c" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:43.517807  8457 leader_election.cc:290] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:43.518462  8328 raft_consensus.cc:2468] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:43.519394  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7014425193644424abe3ad50857b4051" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:43.520435  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7014425193644424abe3ad50857b4051" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:43.521844  8073 leader_election.cc:304] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:43.522956  8463 raft_consensus.cc:2804] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:43.523535  8463 raft_consensus.cc:493] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.523936  8463 raft_consensus.cc:3060] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.523862  8293 leader_election.cc:304] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:43.527480  8457 raft_consensus.cc:2749] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.528056  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfe39df11664509bf085d1f7cc21724" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:43.529003  8255 raft_consensus.cc:2468] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:43.530655  8148 leader_election.cc:304] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:43.533143  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfe39df11664509bf085d1f7cc21724" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:43.534013  8106 raft_consensus.cc:2468] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:43.516415  8469 leader_election.cc:290] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:43.535135  8426 raft_consensus.cc:2804] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:43.538714  8426 raft_consensus.cc:493] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.539577  8426 raft_consensus.cc:3060] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.541594  8328 raft_consensus.cc:3060] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.552208  8373 tablet_bootstrap.cc:654] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.579229  8371 tablet_bootstrap.cc:492] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:43.580039  8371 ts_tablet_manager.cc:1403] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.160s	user 0.028s	sys 0.020s
I20260709 12:15:43.585204  8372 tablet_bootstrap.cc:492] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:43.585906  8372 ts_tablet_manager.cc:1403] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.148s	user 0.021s	sys 0.019s
I20260709 12:15:43.596498  8429 raft_consensus.cc:493] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.597254  8429 raft_consensus.cc:515] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.598574  8372 raft_consensus.cc:359] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.599567  8372 raft_consensus.cc:385] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.564445  8484 raft_consensus.cc:493] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.556975  8457 consensus_queue.cc:1048] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:15:43.601222  8484 raft_consensus.cc:515] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.603989  8484 leader_election.cc:290] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:43.608366  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "471683504fd94afab642c0a780a8833c" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:43.610586  8222 leader_election.cc:343] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.611752  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "471683504fd94afab642c0a780a8833c" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:43.613752  8219 leader_election.cc:343] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.614410  8219 leader_election.cc:304] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:43.615286  8409 raft_consensus.cc:493] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.599995  8372 raft_consensus.cc:740] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.615836  8433 raft_consensus.cc:2749] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.616039  8409 raft_consensus.cc:515] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.616501  8372 consensus_queue.cc:260] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.619324  8372 ts_tablet_manager.cc:1434] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:15:43.619729  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fee3a59c3aa4cc7aa1c7bbf41e4c0c8" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:43.620293  8372 tablet_bootstrap.cc:492] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:43.623206  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fee3a59c3aa4cc7aa1c7bbf41e4c0c8" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:43.628495  8296 leader_election.cc:343] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.630177  8429 leader_election.cc:290] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:43.586175  8371 raft_consensus.cc:359] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.595181  8374 tablet_bootstrap.cc:654] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.632273  8371 raft_consensus.cc:385] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.632772  8371 raft_consensus.cc:740] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.633729  8371 consensus_queue.cc:260] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.627144  8180 raft_consensus.cc:3060] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.635725  8106 raft_consensus.cc:2468] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:43.636158  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6768968ae4371bbc6973eaf2851d7" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:43.643849  8371 ts_tablet_manager.cc:1434] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 12:15:43.640012  8409 leader_election.cc:290] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:43.646637  8371 tablet_bootstrap.cc:492] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:43.655457  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6768968ae4371bbc6973eaf2851d7" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:43.656193  8329 raft_consensus.cc:2468] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:43.660436  8293 leader_election.cc:304] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:43.663450  8219 leader_election.cc:304] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:43.664448  8433 raft_consensus.cc:2804] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:43.664839  8433 raft_consensus.cc:493] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.665162  8433 raft_consensus.cc:3060] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.679096  8459 raft_consensus.cc:2804] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:43.679608  8459 raft_consensus.cc:493] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.680054  8459 raft_consensus.cc:3060] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.648497  8182 raft_consensus.cc:2468] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:43.686483  8463 raft_consensus.cc:515] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.696410  8426 raft_consensus.cc:515] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.699477  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfe39df11664509bf085d1f7cc21724" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:43.700754  8106 raft_consensus.cc:3060] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.700788  8459 raft_consensus.cc:515] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.702301  8374 tablet_bootstrap.cc:492] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:43.702792  8374 ts_tablet_manager.cc:1403] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.246s	user 0.015s	sys 0.000s
I20260709 12:15:43.699235  8433 raft_consensus.cc:515] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.703958  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fee3a59c3aa4cc7aa1c7bbf41e4c0c8" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:43.704567  8105 raft_consensus.cc:3060] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.705487  8433 leader_election.cc:290] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:43.707342  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895082ba16e461b8ca83550f065f98c" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:43.707528  8426 leader_election.cc:290] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:43.708009  8254 raft_consensus.cc:3060] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.708222  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6768968ae4371bbc6973eaf2851d7" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:43.708817  8329 raft_consensus.cc:3060] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.709156  8371 tablet_bootstrap.cc:654] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.712014  8374 raft_consensus.cc:359] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.712939  8374 raft_consensus.cc:385] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.713155  8374 raft_consensus.cc:740] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.713706  8374 consensus_queue.cc:260] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.716648  8459 leader_election.cc:290] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:43.717165  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6768968ae4371bbc6973eaf2851d7" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:43.717751  8182 raft_consensus.cc:3060] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.704701  8463 leader_election.cc:290] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:43.719506  8372 tablet_bootstrap.cc:654] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.721411  8373 tablet_bootstrap.cc:492] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:43.721838  8373 ts_tablet_manager.cc:1403] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.218s	user 0.022s	sys 0.006s
I20260709 12:15:43.714426  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895082ba16e461b8ca83550f065f98c" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:43.722620  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfe39df11664509bf085d1f7cc21724" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:43.723069  8327 raft_consensus.cc:3060] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.726147  8426 raft_consensus.cc:493] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.726373  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fee3a59c3aa4cc7aa1c7bbf41e4c0c8" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:43.720021  8469 raft_consensus.cc:493] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.726660  8426 raft_consensus.cc:515] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.727231  8469 raft_consensus.cc:515] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.729116  8374 ts_tablet_manager.cc:1434] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 12:15:43.730391  8374 tablet_bootstrap.cc:492] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:43.730441  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:43.729179  8426 leader_election.cc:290] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:43.733656  8373 raft_consensus.cc:359] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.734282  8373 raft_consensus.cc:385] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.734669  8373 raft_consensus.cc:740] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.723531  8256 raft_consensus.cc:3060] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:43.738482  8296 leader_election.cc:343] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.741843  8182 raft_consensus.cc:2468] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:43.744194  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:43.745217  8106 raft_consensus.cc:2468] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:43.745137  8102 raft_consensus.cc:2468] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:43.746160  8222 leader_election.cc:304] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:43.729156  8469 leader_election.cc:290] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:43.747001  8429 raft_consensus.cc:2804] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:43.747512  8429 raft_consensus.cc:697] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:43.748343  8429 consensus_queue.cc:237] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.749130  8457 consensus_queue.cc:1048] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.749420  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:43.749769  8145 leader_election.cc:304] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:43.750059  8255 raft_consensus.cc:2468] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:43.750900  8426 raft_consensus.cc:2804] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:43.751302  8426 raft_consensus.cc:493] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.751664  8426 raft_consensus.cc:3060] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.753247  8329 raft_consensus.cc:2468] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:43.734349  8105 raft_consensus.cc:2468] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:43.755028  8409 consensus_queue.cc:1048] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.755367  8254 raft_consensus.cc:2468] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:43.758210  8293 leader_election.cc:304] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:43.765763  8073 leader_election.cc:304] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:43.763887  8433 consensus_queue.cc:1048] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:15:43.785594  8423 raft_consensus.cc:2804] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:43.786052  8423 raft_consensus.cc:493] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.758855  8426 raft_consensus.cc:515] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.786428  8423 raft_consensus.cc:3060] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.788009  8426 leader_election.cc:290] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:43.788079  8181 raft_consensus.cc:1240] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Rejecting Update request from peer 9058059c81534bc4b58c5329d5734dcc for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:15:43.789773  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:43.777001  8327 raft_consensus.cc:2468] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:43.735373  8373 consensus_queue.cc:260] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.799731  8507 raft_consensus.cc:2804] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:43.800580  8457 consensus_queue.cc:1059] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.801450  8457 raft_consensus.cc:3055] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.801538  8073 leader_election.cc:304] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:43.804605  8507 raft_consensus.cc:697] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:43.805581  8507 consensus_queue.cc:237] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.805912  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:43.814793  8374 tablet_bootstrap.cc:654] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.801842  8457 raft_consensus.cc:740] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:43.819193  8463 raft_consensus.cc:2804] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:43.821456  8463 raft_consensus.cc:697] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:43.822362  8463 consensus_queue.cc:237] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.823889  8457 consensus_queue.cc:260] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:43.825115  8457 raft_consensus.cc:3060] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.804303  8182 raft_consensus.cc:2468] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:43.829943  8433 consensus_queue.cc:1048] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.818234  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:43.833271  8423 raft_consensus.cc:515] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.838217  8373 ts_tablet_manager.cc:1434] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.001s
I20260709 12:15:43.839612  8373 tablet_bootstrap.cc:492] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:43.748350  8256 raft_consensus.cc:2468] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:43.836938  8145 leader_election.cc:304] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:43.848003  8426 raft_consensus.cc:2804] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:43.848498  8426 raft_consensus.cc:697] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:43.849351  8426 consensus_queue.cc:237] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.855301  8484 consensus_queue.cc:1048] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:43.858233  8423 leader_election.cc:290] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:43.859331  8373 tablet_bootstrap.cc:654] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.864634  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:43.866101  8181 raft_consensus.cc:3060] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.872853  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:43.873538  8256 raft_consensus.cc:3060] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.874912  8371 tablet_bootstrap.cc:492] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:43.875406  8371 ts_tablet_manager.cc:1403] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.229s	user 0.051s	sys 0.031s
I20260709 12:15:43.882977  8371 raft_consensus.cc:359] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.888568  8371 raft_consensus.cc:385] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:43.876516  8053 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:43.888815  8371 raft_consensus.cc:740] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.891652  8002 catalog_manager.cc:5697] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 1 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.894110  8256 raft_consensus.cc:2468] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:43.899582  8327 raft_consensus.cc:2410] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b02838a902c44ea49d8d94181285b20e for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:15:43.909914  8371 consensus_queue.cc:260] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.916200  8073 leader_election.cc:304] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:43.917495  8463 raft_consensus.cc:2804] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:43.918360  8371 ts_tablet_manager.cc:1434] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.004s
I20260709 12:15:43.919401  8371 tablet_bootstrap.cc:492] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:43.919564  8463 raft_consensus.cc:697] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:43.920548  8463 consensus_queue.cc:237] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.932098  8145 leader_election.cc:304] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:43.933871  8390 raft_consensus.cc:2749] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.939091  8181 raft_consensus.cc:2468] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:43.945917  8371 tablet_bootstrap.cc:654] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.950461  8372 tablet_bootstrap.cc:492] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:43.951162  8372 ts_tablet_manager.cc:1403] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.331s	user 0.012s	sys 0.007s
I20260709 12:15:43.947811  8429 consensus_queue.cc:1048] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:15:43.955900  8374 tablet_bootstrap.cc:492] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:43.956434  8374 ts_tablet_manager.cc:1403] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.226s	user 0.018s	sys 0.008s
I20260709 12:15:43.970281  8374 raft_consensus.cc:359] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.972059  8374 raft_consensus.cc:385] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.972481  8374 raft_consensus.cc:740] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.974113  8373 tablet_bootstrap.cc:492] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:43.974852  8373 ts_tablet_manager.cc:1403] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.136s	user 0.017s	sys 0.001s
I20260709 12:15:43.982513  8373 raft_consensus.cc:359] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.983397  8373 raft_consensus.cc:385] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.984760  8374 consensus_queue.cc:260] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:43.985695  8373 raft_consensus.cc:740] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.986888  8373 consensus_queue.cc:260] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:43.981441  8372 raft_consensus.cc:359] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.988330  8372 raft_consensus.cc:385] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.988888  8372 raft_consensus.cc:740] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.991132  8374 ts_tablet_manager.cc:1434] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.003s
I20260709 12:15:43.990592  8372 consensus_queue.cc:260] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:43.992300  8374 tablet_bootstrap.cc:492] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:43.992915  8372 ts_tablet_manager.cc:1434] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:15:43.993721  8372 tablet_bootstrap.cc:492] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:43.998441  8373 ts_tablet_manager.cc:1434] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:15:43.999945  8373 tablet_bootstrap.cc:492] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:44.004910  8374 tablet_bootstrap.cc:654] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.007133  8373 tablet_bootstrap.cc:654] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.011148  8372 tablet_bootstrap.cc:654] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.012938  8005 catalog_manager.cc:5697] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.016717  8371 tablet_bootstrap.cc:492] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:44.019786  8371 ts_tablet_manager.cc:1403] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.017s
I20260709 12:15:44.020862  8373 tablet_bootstrap.cc:492] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:44.021322  8373 ts_tablet_manager.cc:1403] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 12:15:44.022519  8371 raft_consensus.cc:359] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.023324  8371 raft_consensus.cc:385] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.023664  8371 raft_consensus.cc:740] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.024048  8373 raft_consensus.cc:359] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.024855  8373 raft_consensus.cc:385] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.024418  8371 consensus_queue.cc:260] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.025141  8373 raft_consensus.cc:740] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.025810  8373 consensus_queue.cc:260] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.026671  8371 ts_tablet_manager.cc:1434] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:15:44.027623  8371 tablet_bootstrap.cc:492] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:44.028007  8373 ts_tablet_manager.cc:1434] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:15:44.028910  8373 tablet_bootstrap.cc:492] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:44.033318  8371 tablet_bootstrap.cc:654] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.034884  8429 raft_consensus.cc:493] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.035444  8429 raft_consensus.cc:515] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.038129  8004 catalog_manager.cc:5697] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.041834  8429 leader_election.cc:290] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:44.035099  8003 catalog_manager.cc:5697] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.044241  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dee16badf54437bc48a2f623d62066" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:44.045892  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dee16badf54437bc48a2f623d62066" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:44.046509  8219 leader_election.cc:343] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:44.047586  8219 leader_election.cc:343] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.048012  8219 leader_election.cc:304] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:44.034519  8373 tablet_bootstrap.cc:654] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.049059  8429 raft_consensus.cc:2749] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.061446  8372 tablet_bootstrap.cc:492] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:44.061992  8372 ts_tablet_manager.cc:1403] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.068s	user 0.006s	sys 0.004s
I20260709 12:15:44.064704  8372 raft_consensus.cc:359] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.065392  8372 raft_consensus.cc:385] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.065676  8372 raft_consensus.cc:740] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.066450  8372 consensus_queue.cc:260] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.070990  8372 ts_tablet_manager.cc:1434] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:15:44.071973  8372 tablet_bootstrap.cc:492] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:44.072186  8005 catalog_manager.cc:5697] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.075001  8371 tablet_bootstrap.cc:492] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:44.077530  8372 tablet_bootstrap.cc:654] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.079710  8371 ts_tablet_manager.cc:1403] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.010s
I20260709 12:15:44.082605  8371 raft_consensus.cc:359] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.083189  8371 raft_consensus.cc:385] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.083416  8371 raft_consensus.cc:740] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.084910  8371 consensus_queue.cc:260] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.089677  8371 ts_tablet_manager.cc:1434] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:15:44.091526  8371 tablet_bootstrap.cc:492] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:44.096851  8374 tablet_bootstrap.cc:492] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:44.097123  8373 tablet_bootstrap.cc:492] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:44.097354  8374 ts_tablet_manager.cc:1403] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.105s	user 0.021s	sys 0.017s
I20260709 12:15:44.097544  8373 ts_tablet_manager.cc:1403] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.069s	user 0.019s	sys 0.004s
I20260709 12:15:44.095276  8372 tablet_bootstrap.cc:492] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:44.100848  8373 raft_consensus.cc:359] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.100204  8374 raft_consensus.cc:359] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.101624  8373 raft_consensus.cc:385] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.101749  8374 raft_consensus.cc:385] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.101974  8373 raft_consensus.cc:740] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.102173  8374 raft_consensus.cc:740] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.099685  8372 ts_tablet_manager.cc:1403] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 12:15:44.103024  8374 consensus_queue.cc:260] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.105342  8374 ts_tablet_manager.cc:1434] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:44.106388  8374 tablet_bootstrap.cc:492] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:44.097381  8371 tablet_bootstrap.cc:654] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.102694  8373 consensus_queue.cc:260] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.110116  8373 ts_tablet_manager.cc:1434] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:15:44.105796  8372 raft_consensus.cc:359] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.110767  8372 raft_consensus.cc:385] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.111451  8372 raft_consensus.cc:740] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.112149  8372 consensus_queue.cc:260] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.117614  8374 tablet_bootstrap.cc:654] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.118568  8371 tablet_bootstrap.cc:492] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:44.118656  8373 tablet_bootstrap.cc:492] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:44.119098  8371 ts_tablet_manager.cc:1403] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 12:15:44.122432  8371 raft_consensus.cc:359] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.123095  8371 raft_consensus.cc:385] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.123373  8371 raft_consensus.cc:740] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.124050  8371 consensus_queue.cc:260] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.126271  8372 ts_tablet_manager.cc:1434] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:15:44.128595  8372 tablet_bootstrap.cc:492] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:44.130901  8457 raft_consensus.cc:493] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.131409  8457 raft_consensus.cc:515] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.133160  8371 ts_tablet_manager.cc:1434] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:15:44.133530  8457 leader_election.cc:290] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:44.134161  8371 tablet_bootstrap.cc:492] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:44.135329  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dee16badf54437bc48a2f623d62066" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:44.136077  8102 raft_consensus.cc:2468] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:44.138192  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dee16badf54437bc48a2f623d62066" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:44.138844  8256 raft_consensus.cc:2468] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:44.140497  8371 tablet_bootstrap.cc:654] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.140555  8293 leader_election.cc:304] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:44.141549  8507 raft_consensus.cc:493] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.142022  8507 raft_consensus.cc:515] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.142531  8457 raft_consensus.cc:2804] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.142994  8457 raft_consensus.cc:493] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.143332  8457 raft_consensus.cc:3060] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.145306  8507 leader_election.cc:290] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:44.147354  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "471683504fd94afab642c0a780a8833c" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:44.148097  8182 raft_consensus.cc:2468] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:44.148200  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "471683504fd94afab642c0a780a8833c" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:44.148859  8256 raft_consensus.cc:2468] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:44.150111  8296 leader_election.cc:304] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:44.152902  8457 raft_consensus.cc:515] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.155081  8457 leader_election.cc:290] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:44.157009  8371 tablet_bootstrap.cc:492] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:44.157589  8371 ts_tablet_manager.cc:1403] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 12:15:44.157925  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dee16badf54437bc48a2f623d62066" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:44.158178  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dee16badf54437bc48a2f623d62066" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:44.158638  8256 raft_consensus.cc:3060] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.158761  8507 raft_consensus.cc:2804] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.159700  8507 raft_consensus.cc:493] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.159940  8390 raft_consensus.cc:493] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.160208  8507 raft_consensus.cc:3060] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.160218  8371 raft_consensus.cc:359] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.160514  8390 raft_consensus.cc:515] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.161248  8371 raft_consensus.cc:385] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.161697  8371 raft_consensus.cc:740] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.161386  8372 tablet_bootstrap.cc:654] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.162537  8371 consensus_queue.cc:260] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.163098  8390 leader_election.cc:290] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:44.164723  8371 ts_tablet_manager.cc:1434] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:15:44.173902  8371 tablet_bootstrap.cc:492] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:44.175256  8256 raft_consensus.cc:2468] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:44.160532  8373 tablet_bootstrap.cc:654] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.176679  8296 leader_election.cc:304] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:44.177572  8457 raft_consensus.cc:2804] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.178143  8457 raft_consensus.cc:697] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:44.168952  8374 tablet_bootstrap.cc:492] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:44.179028  8457 consensus_queue.cc:237] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.179663  8374 ts_tablet_manager.cc:1403] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.000s
I20260709 12:15:44.163841  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d552c1db4b14ac89628e14ac27582ba" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:44.180821  8105 raft_consensus.cc:2468] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:44.182643  8374 raft_consensus.cc:359] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.182823  8145 leader_election.cc:304] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:44.183475  8374 raft_consensus.cc:385] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.183933  8374 raft_consensus.cc:740] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.184119  8390 raft_consensus.cc:2804] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.184561  8390 raft_consensus.cc:493] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.184897  8390 raft_consensus.cc:3060] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.184870  8374 consensus_queue.cc:260] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.159345  8102 raft_consensus.cc:3060] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.165421  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d552c1db4b14ac89628e14ac27582ba" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:44.187930  8254 raft_consensus.cc:2468] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:44.192087  8374 ts_tablet_manager.cc:1434] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:15:44.193348  8374 tablet_bootstrap.cc:492] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:44.200330  8374 tablet_bootstrap.cc:654] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.201118  8371 tablet_bootstrap.cc:654] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.203325  8484 consensus_queue.cc:1048] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:44.204135  8390 raft_consensus.cc:515] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.206321  8390 leader_election.cc:290] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:44.207685  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d552c1db4b14ac89628e14ac27582ba" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:44.208405  8254 raft_consensus.cc:3060] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.210952  8373 tablet_bootstrap.cc:492] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:44.211524  8373 ts_tablet_manager.cc:1403] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.009s
I20260709 12:15:44.212404  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d552c1db4b14ac89628e14ac27582ba" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:44.213060  8105 raft_consensus.cc:3060] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.214399  8373 raft_consensus.cc:359] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.215073  8373 raft_consensus.cc:385] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.215327  8373 raft_consensus.cc:740] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.216061  8484 raft_consensus.cc:493] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.216251  8373 consensus_queue.cc:260] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.216554  8484 raft_consensus.cc:515] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.218655  8373 ts_tablet_manager.cc:1434] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:15:44.219542  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bbb2e8c1a44e4183322858438fa0b4" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:44.221151  8373 tablet_bootstrap.cc:492] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:44.220935  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bbb2e8c1a44e4183322858438fa0b4" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:44.221966  8222 leader_election.cc:343] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.222980  8484 leader_election.cc:290] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
W20260709 12:15:44.223623  8219 leader_election.cc:343] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.224339  8219 leader_election.cc:304] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:44.228027  8182 raft_consensus.cc:3060] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.228276  8373 tablet_bootstrap.cc:654] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.237213  8484 raft_consensus.cc:2749] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.239146  8004 catalog_manager.cc:5697] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 1 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.246068  8371 tablet_bootstrap.cc:492] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:44.263200  8254 raft_consensus.cc:2468] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:44.252404  8433 consensus_queue.cc:1048] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:15:44.265798  8148 leader_election.cc:304] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:44.266739  8390 raft_consensus.cc:2804] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.267217  8390 raft_consensus.cc:697] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:44.255900  8457 consensus_queue.cc:1048] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:15:44.268150  8390 consensus_queue.cc:237] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.252918  8373 tablet_bootstrap.cc:492] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:44.270694  8373 ts_tablet_manager.cc:1403] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.004s
I20260709 12:15:44.273675  8373 raft_consensus.cc:359] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.274348  8373 raft_consensus.cc:385] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.274606  8373 raft_consensus.cc:740] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.275318  8373 consensus_queue.cc:260] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.277458  8373 ts_tablet_manager.cc:1434] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:15:44.278385  8373 tablet_bootstrap.cc:492] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:44.243356  8105 raft_consensus.cc:2468] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:44.279712  8427 raft_consensus.cc:493] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.280408  8427 raft_consensus.cc:515] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.285197  8373 tablet_bootstrap.cc:654] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.293000  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5c04cc27ba4d1dbb26c919321fbfa9" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:44.295200  8145 leader_election.cc:343] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.295619  8433 raft_consensus.cc:493] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.258570  8102 raft_consensus.cc:2468] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:44.296240  8433 raft_consensus.cc:515] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.297550  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5c04cc27ba4d1dbb26c919321fbfa9" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:44.298435  8433 leader_election.cc:290] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:44.262492  8507 raft_consensus.cc:515] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.301390  8507 leader_election.cc:290] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:44.247341  8374 tablet_bootstrap.cc:492] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:44.303939  8374 ts_tablet_manager.cc:1403] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.006s
I20260709 12:15:44.305562  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "471683504fd94afab642c0a780a8833c" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:44.306226  8255 raft_consensus.cc:3060] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.263213  8371 ts_tablet_manager.cc:1403] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.090s	user 0.010s	sys 0.001s
I20260709 12:15:44.307337  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02767f53ba4da998190270c72317fb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:44.310623  8371 raft_consensus.cc:359] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.310969  8102 raft_consensus.cc:2468] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:44.310738  8469 consensus_queue.cc:1048] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:44.311821  8371 raft_consensus.cc:385] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.312165  8371 raft_consensus.cc:740] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.312880  8371 consensus_queue.cc:260] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
W20260709 12:15:44.313788  8148 leader_election.cc:343] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.314333  8148 leader_election.cc:304] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:44.314564  8371 ts_tablet_manager.cc:1434] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.001s
I20260709 12:15:44.306996  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02767f53ba4da998190270c72317fb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:44.306960  8374 raft_consensus.cc:359] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.315748  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "471683504fd94afab642c0a780a8833c" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:44.316403  8180 raft_consensus.cc:3060] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.316836  8219 leader_election.cc:304] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
W20260709 12:15:44.317857  8219 leader_election.cc:343] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.317909  8429 raft_consensus.cc:2804] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.318516  8429 raft_consensus.cc:493] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.315794  8374 raft_consensus.cc:385] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.319311  8374 raft_consensus.cc:740] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.320127  8374 consensus_queue.cc:260] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.318959  8429 raft_consensus.cc:3060] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.322758  8374 ts_tablet_manager.cc:1434] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:15:44.324455  8371 tablet_bootstrap.cc:492] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:44.324813  8427 leader_election.cc:290] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:44.325750  8427 raft_consensus.cc:2749] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.327765  8180 raft_consensus.cc:2468] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:44.330462  8371 tablet_bootstrap.cc:654] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.332473  8374 tablet_bootstrap.cc:492] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:44.338730  8457 consensus_queue.cc:1048] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:44.342557  8374 tablet_bootstrap.cc:654] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.342926  8372 tablet_bootstrap.cc:492] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:44.343472  8372 ts_tablet_manager.cc:1403] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.215s	user 0.044s	sys 0.068s
I20260709 12:15:44.331347  8255 raft_consensus.cc:2468] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:44.346256  8372 raft_consensus.cc:359] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.347030  8372 raft_consensus.cc:385] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.347868  8296 leader_election.cc:304] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:44.349050  8507 raft_consensus.cc:2804] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.349618  8507 raft_consensus.cc:697] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:44.350577  8507 consensus_queue.cc:237] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.357532  8374 tablet_bootstrap.cc:492] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:44.358590  8469 raft_consensus.cc:493] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.359773  8374 ts_tablet_manager.cc:1403] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.005s
I20260709 12:15:44.347306  8372 raft_consensus.cc:740] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.359902  8469 raft_consensus.cc:515] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.362280  8372 consensus_queue.cc:260] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.363211  8469 leader_election.cc:290] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:44.365696  8374 raft_consensus.cc:359] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.366006  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb422c1b757045358366d25d227e95ec" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:44.366406  8374 raft_consensus.cc:385] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.366763  8374 raft_consensus.cc:740] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.363996  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb422c1b757045358366d25d227e95ec" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:44.370489  8374 consensus_queue.cc:260] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.377645  8372 ts_tablet_manager.cc:1434] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:15:44.378458  8372 tablet_bootstrap.cc:492] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:44.380172  8373 tablet_bootstrap.cc:492] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:44.380841  8373 ts_tablet_manager.cc:1403] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.009s
I20260709 12:15:44.366865  8181 raft_consensus.cc:2468] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:44.403240  8371 tablet_bootstrap.cc:492] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:44.416188  8371 ts_tablet_manager.cc:1403] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.016s
I20260709 12:15:44.404106  8374 ts_tablet_manager.cc:1434] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 12:15:44.417487  8374 tablet_bootstrap.cc:492] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:44.412972  8373 raft_consensus.cc:359] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.418696  8373 raft_consensus.cc:385] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.419016  8373 raft_consensus.cc:740] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.419715  8373 consensus_queue.cc:260] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.391296  8484 raft_consensus.cc:493] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.387252  8004 catalog_manager.cc:5697] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 1 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.377219  8327 raft_consensus.cc:2468] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:44.392040  8463 consensus_queue.cc:1048] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:15:44.408542  8390 consensus_queue.cc:1048] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:15:44.419344  8423 consensus_queue.cc:1048] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:15:44.428189  8373 ts_tablet_manager.cc:1434] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.001s
I20260709 12:15:44.422325  8484 raft_consensus.cc:515] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.434160  8373 tablet_bootstrap.cc:492] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:44.436254  8429 raft_consensus.cc:515] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.437271  8073 leader_election.cc:304] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:44.448225  8371 raft_consensus.cc:359] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.448928  8371 raft_consensus.cc:385] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.449193  8371 raft_consensus.cc:740] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.449812  8371 consensus_queue.cc:260] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.452296  8423 raft_consensus.cc:2804] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.452713  8423 raft_consensus.cc:493] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.453063  8423 raft_consensus.cc:3060] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.454424  8429 leader_election.cc:290] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:44.455139  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02767f53ba4da998190270c72317fb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:44.459165  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02767f53ba4da998190270c72317fb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:44.467655  8469 consensus_queue.cc:1048] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:44.468644  8372 tablet_bootstrap.cc:654] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.470798  8005 catalog_manager.cc:5697] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.459973  8102 raft_consensus.cc:3060] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.486500  8484 leader_election.cc:290] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:44.483911  8463 raft_consensus.cc:493] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.492684  8463 raft_consensus.cc:515] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:15:44.482611  8219 leader_election.cc:343] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.499610  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325569f077184e418663d6e5e3f6fd3b" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:44.502789  8371 ts_tablet_manager.cc:1434] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.086s	user 0.016s	sys 0.016s
I20260709 12:15:44.504076  8371 tablet_bootstrap.cc:492] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:44.470395  8390 consensus_queue.cc:1048] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:15:44.511032  8507 raft_consensus.cc:493] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.511577  8507 raft_consensus.cc:515] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
W20260709 12:15:44.506408  8550 log.cc:927] Time spent T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:15:44.510303  8219 leader_election.cc:343] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.512831  8463 leader_election.cc:290] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:44.521843  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:44.524192  8507 leader_election.cc:290] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:44.528164  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bbb2e8c1a44e4183322858438fa0b4" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:44.528831  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bbb2e8c1a44e4183322858438fa0b4" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:44.529498  8371 tablet_bootstrap.cc:654] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.529615  8254 raft_consensus.cc:2468] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:44.528860  8181 raft_consensus.cc:2468] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:44.530990  8296 leader_election.cc:304] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:44.531878  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325569f077184e418663d6e5e3f6fd3b" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:44.532464  8102 raft_consensus.cc:2468] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:44.532877  8507 raft_consensus.cc:2804] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.533253  8507 raft_consensus.cc:493] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.533587  8507 raft_consensus.cc:3060] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.533769  8219 leader_election.cc:304] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:44.534096  8372 tablet_bootstrap.cc:492] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:44.534631  8372 ts_tablet_manager.cc:1403] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.156s	user 0.023s	sys 0.008s
I20260709 12:15:44.535002  8433 raft_consensus.cc:2804] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.535599  8433 raft_consensus.cc:697] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:44.536482  8433 consensus_queue.cc:237] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.535290  8423 raft_consensus.cc:515] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.537446  8374 tablet_bootstrap.cc:654] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.537423  8372 raft_consensus.cc:359] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.539124  8372 raft_consensus.cc:385] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.539469  8372 raft_consensus.cc:740] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.540427  8372 consensus_queue.cc:260] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.543192  8372 ts_tablet_manager.cc:1434] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:44.544485  8372 tablet_bootstrap.cc:492] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
W20260709 12:15:44.552074  8222 leader_election.cc:343] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.552548  8222 leader_election.cc:304] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:44.553380  8507 raft_consensus.cc:515] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.553889  8484 raft_consensus.cc:2749] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:44.555115  8073 leader_election.cc:343] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.555269  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:44.558593  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bbb2e8c1a44e4183322858438fa0b4" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:44.559201  8181 raft_consensus.cc:3060] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:44.560768  8073 leader_election.cc:343] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.561262  8073 leader_election.cc:304] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:44.562839  8372 tablet_bootstrap.cc:654] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.593101  8469 raft_consensus.cc:2749] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.588646  8507 leader_election.cc:290] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
W20260709 12:15:44.612834  8073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:40315, user_credentials={real_user=slave}} blocked reactor thread for 52100.9us
I20260709 12:15:44.615067  8374 tablet_bootstrap.cc:492] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:44.615629  8374 ts_tablet_manager.cc:1403] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.198s	user 0.011s	sys 0.024s
I20260709 12:15:44.619712  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bbb2e8c1a44e4183322858438fa0b4" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:44.620568  8255 raft_consensus.cc:3060] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.621385  8181 raft_consensus.cc:2468] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:44.622730  8423 leader_election.cc:290] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:44.625058  8373 tablet_bootstrap.cc:654] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.632133  8296 leader_election.cc:304] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:44.633492  8371 tablet_bootstrap.cc:492] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:44.633592  8507 raft_consensus.cc:2804] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.634055  8371 ts_tablet_manager.cc:1403] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.015s
I20260709 12:15:44.635211  8507 raft_consensus.cc:697] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:44.636806  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb422c1b757045358366d25d227e95ec" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:44.637430  8182 raft_consensus.cc:3060] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.637709  8409 consensus_queue.cc:1048] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:44.636380  8507 consensus_queue.cc:237] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.648942  8373 tablet_bootstrap.cc:492] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:44.649560  8373 ts_tablet_manager.cc:1403] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.217s	user 0.011s	sys 0.006s
I20260709 12:15:44.650841  8372 tablet_bootstrap.cc:492] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:44.651557  8372 ts_tablet_manager.cc:1403] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.011s
I20260709 12:15:44.652688  8373 raft_consensus.cc:359] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.653475  8373 raft_consensus.cc:385] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.653810  8373 raft_consensus.cc:740] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.654523  8409 raft_consensus.cc:493] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.655102  8409 raft_consensus.cc:515] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.657816  8409 leader_election.cc:290] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:44.659382  8373 consensus_queue.cc:260] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.661375  8371 raft_consensus.cc:359] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.662168  8371 raft_consensus.cc:385] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.663918  8255 raft_consensus.cc:2468] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:44.662443  8371 raft_consensus.cc:740] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.664211  8374 raft_consensus.cc:359] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.666867  8374 raft_consensus.cc:385] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.667176  8374 raft_consensus.cc:740] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.667052  8371 consensus_queue.cc:260] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.667950  8374 consensus_queue.cc:260] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.668792  8371 ts_tablet_manager.cc:1434] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:15:44.669776  8371 tablet_bootstrap.cc:492] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:44.669677  8372 raft_consensus.cc:359] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.670333  8372 raft_consensus.cc:385] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.670588  8372 raft_consensus.cc:740] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.670725  8374 ts_tablet_manager.cc:1434] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 12:15:44.671198  8372 consensus_queue.cc:260] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.671799  8374 tablet_bootstrap.cc:492] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:44.673480  8372 ts_tablet_manager.cc:1434] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:15:44.674449  8372 tablet_bootstrap.cc:492] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:44.675053  8373 ts_tablet_manager.cc:1434] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:15:44.676118  8373 tablet_bootstrap.cc:492] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:44.678491  8374 tablet_bootstrap.cc:654] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.679375  8372 tablet_bootstrap.cc:654] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.681854  8373 tablet_bootstrap.cc:654] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.684108  8374 tablet_bootstrap.cc:492] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
W20260709 12:15:44.717226  8070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:44023, user_credentials={real_user=slave}} blocked reactor thread for 153476us
I20260709 12:15:44.730080  8004 catalog_manager.cc:5697] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 1 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.736588  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02767f53ba4da998190270c72317fb" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:44.738387  8102 raft_consensus.cc:2393] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9058059c81534bc4b58c5329d5734dcc in current term 1: Already voted for candidate 66af1447f2c64ebda5448a760d5d7718 in this term.
I20260709 12:15:44.748842  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02767f53ba4da998190270c72317fb" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:44.753654  8296 leader_election.cc:304] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:44.757907  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb422c1b757045358366d25d227e95ec" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:44.759019  8327 raft_consensus.cc:3060] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.785949  8374 ts_tablet_manager.cc:1403] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.004s
I20260709 12:15:44.793292  8567 raft_consensus.cc:493] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.794749  8433 raft_consensus.cc:493] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.795135  8569 raft_consensus.cc:493] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.795626  8433 raft_consensus.cc:515] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.796093  8569 raft_consensus.cc:515] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.798811  8433 leader_election.cc:290] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:44.799484  8507 raft_consensus.cc:3060] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.794382  8567 raft_consensus.cc:515] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.804469  8372 tablet_bootstrap.cc:492] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:44.805640  8372 ts_tablet_manager.cc:1403] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.131s	user 0.008s	sys 0.003s
I20260709 12:15:44.799295  8569 leader_election.cc:290] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:44.811028  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f51cbe52e4c4c99fc31b081f4372a" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:44.811641  8567 leader_election.cc:290] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
W20260709 12:15:44.815261  8222 leader_election.cc:343] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.815490  8372 raft_consensus.cc:359] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.816776  8372 raft_consensus.cc:385] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.817111  8372 raft_consensus.cc:740] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.817890  8372 consensus_queue.cc:260] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.819762  8371 tablet_bootstrap.cc:654] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.819224  8429 raft_consensus.cc:493] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.821218  8469 raft_consensus.cc:493] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.821779  8429 raft_consensus.cc:515] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.827520  8409 consensus_queue.cc:1048] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:15:44.829082  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85f56f39a20454d8ddeffad93e935a8" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:44.836241  8070 leader_election.cc:343] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.836512  8373 tablet_bootstrap.cc:492] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:44.837317  8373 ts_tablet_manager.cc:1403] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.161s	user 0.004s	sys 0.006s
I20260709 12:15:44.841420  8327 raft_consensus.cc:2468] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:44.843083  8070 leader_election.cc:304] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:44.845084  8429 leader_election.cc:290] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:44.846012  8569 raft_consensus.cc:2804] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.846701  8569 raft_consensus.cc:697] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:44.846989  8372 ts_tablet_manager.cc:1434] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.003s
I20260709 12:15:44.848124  8569 consensus_queue.cc:237] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.848712  8372 tablet_bootstrap.cc:492] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:44.822073  8469 raft_consensus.cc:515] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.874176  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f51cbe52e4c4c99fc31b081f4372a" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:44.875041  8105 raft_consensus.cc:2468] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:44.876078  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cff31edfc694b9b94b47e932c3940f9" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
W20260709 12:15:44.882100  8219 leader_election.cc:343] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.883411  8469 leader_election.cc:290] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:44.884665  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc189c974f5542a682c54f9bde0483a1" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:44.891420  8374 raft_consensus.cc:359] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.892339  8374 raft_consensus.cc:385] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.868234  8005 catalog_manager.cc:5697] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.891126  8390 raft_consensus.cc:493] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.892688  8374 raft_consensus.cc:740] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
W20260709 12:15:44.899199  8070 leader_election.cc:343] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.904270  8219 leader_election.cc:304] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:44.906613  8371 tablet_bootstrap.cc:492] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:44.908558  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cff31edfc694b9b94b47e932c3940f9" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:44.888813  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:40315, user_credentials={real_user=slave}} blocked reactor thread for 70016.6us
I20260709 12:15:44.917773  8578 raft_consensus.cc:2804] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.918322  8578 raft_consensus.cc:493] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.918715  8578 raft_consensus.cc:3060] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.919691  8390 raft_consensus.cc:515] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.924577  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc189c974f5542a682c54f9bde0483a1" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:44.926672  8145 leader_election.cc:343] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.927461  8390 leader_election.cc:290] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:44.929383  8507 raft_consensus.cc:2749] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.894024  8373 raft_consensus.cc:359] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.935503  8373 raft_consensus.cc:385] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.935933  8373 raft_consensus.cc:740] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.911523  8371 ts_tablet_manager.cc:1403] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.238s	user 0.013s	sys 0.009s
I20260709 12:15:44.931205  8374 consensus_queue.cc:260] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:44.940064  8371 raft_consensus.cc:359] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:44.940999  8371 raft_consensus.cc:385] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.941406  8371 raft_consensus.cc:740] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.942358  8371 consensus_queue.cc:260] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:15:44.944361  8576 log.cc:927] Time spent T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 12:15:44.951843  8373 consensus_queue.cc:260] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:44.953755  8373 ts_tablet_manager.cc:1434] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.116s	user 0.009s	sys 0.000s
I20260709 12:15:44.953920  8457 raft_consensus.cc:493] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.956050  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f51cbe52e4c4c99fc31b081f4372a" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:44.957099  8374 ts_tablet_manager.cc:1434] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.170s	user 0.010s	sys 0.000s
I20260709 12:15:44.968231  8374 tablet_bootstrap.cc:492] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:44.968231  8373 tablet_bootstrap.cc:492] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
W20260709 12:15:44.962054  8222 leader_election.cc:343] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.967567  8457 raft_consensus.cc:515] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:44.981720  8372 tablet_bootstrap.cc:654] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.985792  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
W20260709 12:15:44.987883  8293 leader_election.cc:343] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.988117  8182 raft_consensus.cc:2468] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:44.972991  8222 leader_election.cc:304] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:44.992681  8579 raft_consensus.cc:2749] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.994300  8579 consensus_queue.cc:1048] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:45.003870  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85f56f39a20454d8ddeffad93e935a8" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:45.007383  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f51cbe52e4c4c99fc31b081f4372a" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:45.011327  8457 leader_election.cc:290] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:45.015479  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc189c974f5542a682c54f9bde0483a1" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:45.016234  8102 raft_consensus.cc:2468] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
W20260709 12:15:45.018661  8073 leader_election.cc:343] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.019240  8073 leader_election.cc:304] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:45.020809  8555 raft_consensus.cc:2749] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:45.022027  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc189c974f5542a682c54f9bde0483a1" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:45.022887  8179 raft_consensus.cc:2468] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:45.016674  8578 raft_consensus.cc:515] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.024492  8255 raft_consensus.cc:2393] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in current term 1: Already voted for candidate 66af1447f2c64ebda5448a760d5d7718 in this term.
W20260709 12:15:45.024837  8053 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:45.024940  8589 consensus_queue.cc:1048] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.029193  8578 leader_election.cc:290] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:45.029274  8145 leader_election.cc:304] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:45.032703  8589 raft_consensus.cc:2804] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.033093  8589 raft_consensus.cc:493] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.033020  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f51cbe52e4c4c99fc31b081f4372a" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:45.033422  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7f51cbe52e4c4c99fc31b081f4372a" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:45.035601  8589 raft_consensus.cc:3060] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.035796  8102 raft_consensus.cc:3060] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:45.042176  8222 leader_election.cc:343] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.043817  8374 tablet_bootstrap.cc:654] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.044112  8457 raft_consensus.cc:493] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.044667  8457 raft_consensus.cc:515] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.046566  8507 consensus_queue.cc:1048] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:45.051337  8589 raft_consensus.cc:515] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.055546  8587 consensus_queue.cc:1048] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.055752  8589 leader_election.cc:290] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:45.056250  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aedf68b2244597bed9a1046869df3e" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
W20260709 12:15:45.057574  8293 leader_election.cc:343] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.060842  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc189c974f5542a682c54f9bde0483a1" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
W20260709 12:15:45.062211  8145 leader_election.cc:343] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.062209  8457 leader_election.cc:290] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:45.064455  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:45.068261  8073 leader_election.cc:343] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.068418  8102 raft_consensus.cc:2468] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:45.069769  8073 leader_election.cc:304] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:45.069952  8219 leader_election.cc:304] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:45.070559  8569 raft_consensus.cc:2804] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.070997  8569 raft_consensus.cc:493] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.071329  8569 raft_consensus.cc:3060] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.071718  8579 raft_consensus.cc:2804] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:45.041342  8371 ts_tablet_manager.cc:1434] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.000s
I20260709 12:15:45.072691  8579 raft_consensus.cc:697] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:45.073709  8371 tablet_bootstrap.cc:492] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:45.074286  8579 consensus_queue.cc:237] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.077452  8429 raft_consensus.cc:493] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.077951  8429 raft_consensus.cc:515] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.080266  8429 leader_election.cc:290] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:45.081179  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5c04cc27ba4d1dbb26c919321fbfa9" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:45.081990  8179 raft_consensus.cc:2468] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:45.082372  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5c04cc27ba4d1dbb26c919321fbfa9" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:45.084043  8222 leader_election.cc:304] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:45.085115  8429 raft_consensus.cc:2804] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.085290  8373 tablet_bootstrap.cc:654] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.085539  8429 raft_consensus.cc:493] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.085882  8429 raft_consensus.cc:3060] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:45.085865  8219 leader_election.cc:343] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.090233  8372 tablet_bootstrap.cc:492] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:45.090739  8372 ts_tablet_manager.cc:1403] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.242s	user 0.013s	sys 0.008s
I20260709 12:15:45.091702  8374 tablet_bootstrap.cc:492] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:45.092300  8374 ts_tablet_manager.cc:1403] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.000s
I20260709 12:15:45.093813  8372 raft_consensus.cc:359] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.094538  8372 raft_consensus.cc:385] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.094830  8372 raft_consensus.cc:740] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.095834  8374 raft_consensus.cc:359] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.096720  8374 raft_consensus.cc:385] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.097040  8374 raft_consensus.cc:740] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.097568  8372 consensus_queue.cc:260] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.097915  8374 consensus_queue.cc:260] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.098380  8457 consensus_queue.cc:1048] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:45.100147  8372 ts_tablet_manager.cc:1434] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 12:15:45.101424  8372 tablet_bootstrap.cc:492] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:45.103538  8374 ts_tablet_manager.cc:1434] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:15:45.105683  8374 tablet_bootstrap.cc:492] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
W20260709 12:15:45.112363  8296 leader_election.cc:343] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.112779  8429 raft_consensus.cc:515] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.115726  8429 leader_election.cc:290] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:45.116194  8569 raft_consensus.cc:515] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.113029  8296 leader_election.cc:304] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:45.118377  8569 leader_election.cc:290] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:45.118832  8457 raft_consensus.cc:2749] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:45.119267  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5c04cc27ba4d1dbb26c919321fbfa9" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:45.119611  8577 consensus_queue.cc:1048] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.120282  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc189c974f5542a682c54f9bde0483a1" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:45.121042  8327 raft_consensus.cc:3060] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:45.122074  8219 leader_election.cc:343] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.125048  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aedf68b2244597bed9a1046869df3e" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:45.140410  8372 tablet_bootstrap.cc:654] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.131271  8073 leader_election.cc:304] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:45.147604  8569 raft_consensus.cc:2749] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:45.140055  8296 leader_election.cc:343] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.161964  8569 raft_consensus.cc:493] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.162999  8569 raft_consensus.cc:515] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.164798  8371 tablet_bootstrap.cc:654] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.159008  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5c04cc27ba4d1dbb26c919321fbfa9" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:45.167991  8182 raft_consensus.cc:3060] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.170153  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc189c974f5542a682c54f9bde0483a1" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:45.170971  8102 raft_consensus.cc:2393] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b02838a902c44ea49d8d94181285b20e in current term 1: Already voted for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in this term.
I20260709 12:15:45.162020  8296 leader_election.cc:304] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:45.165773  8569 leader_election.cc:290] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:45.173038  8457 raft_consensus.cc:2749] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:45.175266  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9383c8a3a24a0ba2d5b8d5e1006a50" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:45.177983  8145 leader_election.cc:304] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:45.178269  8327 raft_consensus.cc:2468] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:45.176278  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9383c8a3a24a0ba2d5b8d5e1006a50" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:45.186048  8373 tablet_bootstrap.cc:492] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:45.186578  8373 ts_tablet_manager.cc:1403] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.219s	user 0.022s	sys 0.000s
I20260709 12:15:45.179982  8579 raft_consensus.cc:493] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.189353  8589 raft_consensus.cc:493] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.190341  8586 raft_consensus.cc:2749] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:45.189190  8070 leader_election.cc:304] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
W20260709 12:15:45.235100  8070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:44023, user_credentials={real_user=slave}} blocked reactor thread for 52500.2us
I20260709 12:15:45.234656  8005 catalog_manager.cc:5697] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.196719  8409 consensus_queue.cc:1048] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:45.237032  8589 raft_consensus.cc:515] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.237293  8457 consensus_queue.cc:1048] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:45.239343  8589 leader_election.cc:290] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:45.201737  8373 raft_consensus.cc:359] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.240033  8373 raft_consensus.cc:385] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.210824  8590 raft_consensus.cc:493] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:45.222415  8073 leader_election.cc:343] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.235203  8555 raft_consensus.cc:2804] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:45.191939  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc189c974f5542a682c54f9bde0483a1" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:45.194435  8182 raft_consensus.cc:2468] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:45.240370  8373 raft_consensus.cc:740] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.240140  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325569f077184e418663d6e5e3f6fd3b" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:45.241344  8555 raft_consensus.cc:697] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:45.241966  8579 raft_consensus.cc:515] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.243096  8555 consensus_queue.cc:237] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.243829  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325569f077184e418663d6e5e3f6fd3b" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:45.245079  8179 raft_consensus.cc:2393] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in current term 1: Already voted for candidate b02838a902c44ea49d8d94181285b20e in this term.
I20260709 12:15:45.246693  8374 tablet_bootstrap.cc:654] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.249158  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8e6e90970441fdad02bb1119456dea" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
W20260709 12:15:45.250828  8219 leader_election.cc:343] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.250871  8590 raft_consensus.cc:515] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.251775  8579 leader_election.cc:290] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:45.253336  8590 leader_election.cc:290] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:45.260303  8373 consensus_queue.cc:260] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.265251  8222 leader_election.cc:304] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:45.265628  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:45.266677  8429 raft_consensus.cc:2804] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:45.267205  8429 raft_consensus.cc:697] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:45.265276  8254 raft_consensus.cc:2468] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:45.267226  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8e6e90970441fdad02bb1119456dea" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:45.268360  8429 consensus_queue.cc:237] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
W20260709 12:15:45.270056  8219 leader_election.cc:343] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.270697  8219 leader_election.cc:304] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
W20260709 12:15:45.262243  8073 leader_election.cc:343] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.272042  8073 leader_election.cc:304] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:45.272521  8577 raft_consensus.cc:2749] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:45.273505  8373 ts_tablet_manager.cc:1434] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.000s
I20260709 12:15:45.274430  8148 leader_election.cc:304] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:45.274809  8373 tablet_bootstrap.cc:492] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:45.275631  8586 raft_consensus.cc:2804] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.276886  8586 raft_consensus.cc:493] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.277233  8586 raft_consensus.cc:3060] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.278384  8371 tablet_bootstrap.cc:492] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:45.278862  8371 ts_tablet_manager.cc:1403] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.205s	user 0.028s	sys 0.008s
I20260709 12:15:45.281047  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:45.281735  8180 raft_consensus.cc:2468] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 2.
I20260709 12:15:45.281996  8371 raft_consensus.cc:359] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.282712  8371 raft_consensus.cc:385] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.282975  8296 leader_election.cc:304] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:45.284396  8457 raft_consensus.cc:2804] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:45.284770  8457 raft_consensus.cc:493] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.285101  8457 raft_consensus.cc:3060] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.288862  8555 raft_consensus.cc:2749] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:45.294760  8145 leader_election.cc:343] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.297501  8586 raft_consensus.cc:515] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.301772  8569 raft_consensus.cc:493] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9058059c81534bc4b58c5329d5734dcc)
I20260709 12:15:45.302417  8569 raft_consensus.cc:515] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.302569  8457 raft_consensus.cc:515] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.304659  8569 leader_election.cc:290] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:45.305706  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325569f077184e418663d6e5e3f6fd3b" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:45.305871  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:45.306454  8254 raft_consensus.cc:3060] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.306262  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:45.282987  8371 raft_consensus.cc:740] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.306707  8327 raft_consensus.cc:2368] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 for earlier term 2. Current term is 3.
I20260709 12:15:45.310460  8182 raft_consensus.cc:2393] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in current term 2: Already voted for candidate b02838a902c44ea49d8d94181285b20e in this term.
I20260709 12:15:45.307369  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:45.319973  8105 raft_consensus.cc:3060] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.321144  8371 consensus_queue.cc:260] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.314813  8070 leader_election.cc:400] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023) with higher term. Message: Invalid argument: T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 for earlier term 2. Current term is 3.
I20260709 12:15:45.323702  8070 leader_election.cc:403] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:45.325824  8371 ts_tablet_manager.cc:1434] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.047s	user 0.003s	sys 0.004s
I20260709 12:15:45.326941  8371 tablet_bootstrap.cc:492] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:45.315357  8586 leader_election.cc:290] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:45.316227  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325569f077184e418663d6e5e3f6fd3b" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:45.318193  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:45.330729  8180 raft_consensus.cc:3060] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:45.331398  8145 leader_election.cc:343] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.327822  8457 leader_election.cc:290] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:45.340167  8372 tablet_bootstrap.cc:492] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:45.340687  8372 ts_tablet_manager.cc:1403] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.240s	user 0.015s	sys 0.006s
I20260709 12:15:45.343859  8372 raft_consensus.cc:359] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.344400  8374 tablet_bootstrap.cc:492] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:45.344630  8372 raft_consensus.cc:385] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.345111  8372 raft_consensus.cc:740] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.345192  8374 ts_tablet_manager.cc:1403] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.240s	user 0.011s	sys 0.007s
I20260709 12:15:45.346940  8002 catalog_manager.cc:5697] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:45.351186  8373 tablet_bootstrap.cc:654] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.352813  8371 tablet_bootstrap.cc:654] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.347978  8374 raft_consensus.cc:359] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.353413  8374 raft_consensus.cc:385] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.353741  8374 raft_consensus.cc:740] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.348315  8372 consensus_queue.cc:260] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.349273  8254 raft_consensus.cc:2468] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:45.356089  8105 raft_consensus.cc:2468] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 3.
I20260709 12:15:45.356634  8569 raft_consensus.cc:2749] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023) with higher term. Message: Invalid argument: T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 for earlier term 2. Current term is 3.
I20260709 12:15:45.357403  8293 leader_election.cc:304] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:45.358835  8457 raft_consensus.cc:2804] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:45.359153  8148 leader_election.cc:304] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:45.359743  8457 raft_consensus.cc:697] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 3 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:45.360217  8586 raft_consensus.cc:2804] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:45.360747  8586 raft_consensus.cc:697] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:45.361703  8374 consensus_queue.cc:260] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.363163  8586 consensus_queue.cc:237] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.364449  8374 ts_tablet_manager.cc:1434] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:15:45.365326  8372 ts_tablet_manager.cc:1434] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:15:45.365967  8374 tablet_bootstrap.cc:492] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:45.366542  8372 tablet_bootstrap.cc:492] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:45.360808  8457 consensus_queue.cc:237] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.369894  8180 raft_consensus.cc:2468] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 3.
I20260709 12:15:45.370551  8569 consensus_queue.cc:1048] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:45.376894  8372 tablet_bootstrap.cc:654] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.376837  8005 catalog_manager.cc:5697] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.391745  8371 tablet_bootstrap.cc:492] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:45.392269  8371 ts_tablet_manager.cc:1403] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.002s
I20260709 12:15:45.402889  8371 raft_consensus.cc:359] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.403630  8371 raft_consensus.cc:385] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.403928  8371 raft_consensus.cc:740] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.409960  8374 tablet_bootstrap.cc:654] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.411499  8001 catalog_manager.cc:5697] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.422240  8373 tablet_bootstrap.cc:492] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:45.422792  8373 ts_tablet_manager.cc:1403] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.148s	user 0.002s	sys 0.016s
I20260709 12:15:45.426481  8373 raft_consensus.cc:359] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.429013  8373 raft_consensus.cc:385] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.429342  8373 raft_consensus.cc:740] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.429189  8003 catalog_manager.cc:5697] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.430105  8373 consensus_queue.cc:260] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.431459  8569 consensus_queue.cc:1048] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.435887  8373 ts_tablet_manager.cc:1434] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:15:45.437196  8373 tablet_bootstrap.cc:492] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:45.445487  8429 raft_consensus.cc:493] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.446259  8429 raft_consensus.cc:515] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.448767  8429 leader_election.cc:290] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:45.450510  8373 tablet_bootstrap.cc:654] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.451387  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85f56f39a20454d8ddeffad93e935a8" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:45.452090  8105 raft_consensus.cc:2468] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:45.458244  8372 tablet_bootstrap.cc:492] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:45.458026  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85f56f39a20454d8ddeffad93e935a8" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:45.458791  8372 ts_tablet_manager.cc:1403] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.093s	user 0.042s	sys 0.019s
I20260709 12:15:45.459059  8330 raft_consensus.cc:2468] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:45.460677  8219 leader_election.cc:304] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:45.461697  8429 raft_consensus.cc:2804] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.462157  8429 raft_consensus.cc:493] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.462514  8429 raft_consensus.cc:3060] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.463954  8372 raft_consensus.cc:359] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.464763  8372 raft_consensus.cc:385] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.465068  8372 raft_consensus.cc:740] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.466778  8371 consensus_queue.cc:260] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.468453  8371 ts_tablet_manager.cc:1434] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.000s
I20260709 12:15:45.469580  8371 tablet_bootstrap.cc:492] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:45.472338  8429 raft_consensus.cc:515] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.472506  8372 consensus_queue.cc:260] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.474721  8429 leader_election.cc:290] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:45.476593  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85f56f39a20454d8ddeffad93e935a8" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:45.478269  8330 raft_consensus.cc:3060] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.477103  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85f56f39a20454d8ddeffad93e935a8" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:45.479393  8105 raft_consensus.cc:3060] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.490212  8372 ts_tablet_manager.cc:1434] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.001s
I20260709 12:15:45.493417  8372 tablet_bootstrap.cc:492] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:45.496317  8371 tablet_bootstrap.cc:654] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.497490  8374 tablet_bootstrap.cc:492] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:45.503548  8374 ts_tablet_manager.cc:1403] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.138s	user 0.024s	sys 0.024s
I20260709 12:15:45.506541  8374 raft_consensus.cc:359] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.507248  8374 raft_consensus.cc:385] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.507602  8374 raft_consensus.cc:740] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.508406  8374 consensus_queue.cc:260] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.510800  8374 ts_tablet_manager.cc:1434] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:15:45.502676  8373 tablet_bootstrap.cc:492] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:45.499046  8105 raft_consensus.cc:2468] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:45.512348  8373 ts_tablet_manager.cc:1403] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.075s	user 0.005s	sys 0.011s
I20260709 12:15:45.512807  8001 catalog_manager.cc:5697] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.514426  8371 tablet_bootstrap.cc:492] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:45.515311  8371 ts_tablet_manager.cc:1403] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.005s
I20260709 12:15:45.514596  8219 leader_election.cc:304] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:45.515493  8373 raft_consensus.cc:359] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.516278  8373 raft_consensus.cc:385] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.516304  8429 raft_consensus.cc:2804] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:45.516722  8373 raft_consensus.cc:740] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.517282  8429 raft_consensus.cc:697] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:45.517554  8373 consensus_queue.cc:260] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.518584  8429 consensus_queue.cc:237] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.522629  8374 tablet_bootstrap.cc:492] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:45.523092  8330 raft_consensus.cc:2468] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:45.524245  8372 tablet_bootstrap.cc:654] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.526520  8371 raft_consensus.cc:359] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.527375  8371 raft_consensus.cc:385] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.527678  8371 raft_consensus.cc:740] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.527841  8373 ts_tablet_manager.cc:1434] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:15:45.529136  8373 tablet_bootstrap.cc:492] T 2f7f51cbe52e4c4c99fc31b081f4372a P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:45.532436  8371 consensus_queue.cc:260] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.534956  8371 ts_tablet_manager.cc:1434] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:15:45.536299  8371 tablet_bootstrap.cc:492] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:45.537629  8373 tablet_bootstrap.cc:654] T 2f7f51cbe52e4c4c99fc31b081f4372a P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.538300  8374 tablet_bootstrap.cc:654] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.543154  8371 tablet_bootstrap.cc:654] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.551232  8374 tablet_bootstrap.cc:492] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:45.551745  8374 ts_tablet_manager.cc:1403] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.029s	user 0.003s	sys 0.009s
I20260709 12:15:45.566069  8374 raft_consensus.cc:359] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.566773  8374 raft_consensus.cc:385] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.567023  8374 raft_consensus.cc:740] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.567679  8374 consensus_queue.cc:260] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.574460  8577 raft_consensus.cc:493] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.574898  8374 ts_tablet_manager.cc:1434] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.005s
I20260709 12:15:45.575001  8577 raft_consensus.cc:515] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.576073  8374 tablet_bootstrap.cc:492] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:45.577348  8577 leader_election.cc:290] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:45.578474  8586 raft_consensus.cc:493] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.579123  8586 raft_consensus.cc:515] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.581822  8586 leader_election.cc:290] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:45.583801  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cff31edfc694b9b94b47e932c3940f9" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:45.584633  8105 raft_consensus.cc:2468] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:45.584833  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:45.586145  8145 leader_election.cc:304] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
W20260709 12:15:45.586302  8219 leader_election.cc:343] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.586215  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:45.587728  8586 raft_consensus.cc:2804] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.588181  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cff31edfc694b9b94b47e932c3940f9" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:45.588389  8586 raft_consensus.cc:493] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:45.588708  8222 consensus_peers.cc:597] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:45.588920  8586 raft_consensus.cc:3060] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.588971  8254 raft_consensus.cc:2468] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
W20260709 12:15:45.590432  8219 leader_election.cc:343] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.591048  8219 leader_election.cc:304] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:45.591305  8469 raft_consensus.cc:493] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.591836  8469 raft_consensus.cc:515] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.573227  8371 tablet_bootstrap.cc:492] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:45.593216  8371 ts_tablet_manager.cc:1403] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.015s
I20260709 12:15:45.592202  8579 raft_consensus.cc:2749] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:45.595556  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aedf68b2244597bed9a1046869df3e" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:45.599841  8374 tablet_bootstrap.cc:654] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.597610  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aedf68b2244597bed9a1046869df3e" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:45.606374  8073 leader_election.cc:343] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.596194  8330 raft_consensus.cc:2468] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:45.596453  8469 leader_election.cc:290] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:45.596180  8371 raft_consensus.cc:359] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.609368  8371 raft_consensus.cc:385] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.609346  8070 leader_election.cc:304] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:45.609867  8371 raft_consensus.cc:740] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.610713  8371 consensus_queue.cc:260] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.611057  8469 raft_consensus.cc:2804] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.611500  8469 raft_consensus.cc:493] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.611863  8469 raft_consensus.cc:3060] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.621532  8371 ts_tablet_manager.cc:1434] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:15:45.623023  8371 tablet_bootstrap.cc:492] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:45.621532  8469 raft_consensus.cc:515] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.630111  8587 raft_consensus.cc:493] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.630728  8587 raft_consensus.cc:515] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.635273  8372 tablet_bootstrap.cc:492] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:45.635859  8372 ts_tablet_manager.cc:1403] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.145s	user 0.029s	sys 0.014s
I20260709 12:15:45.637776  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:45.638629  8106 raft_consensus.cc:2468] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:45.640362  8145 leader_election.cc:304] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:45.641618  8589 raft_consensus.cc:2804] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.641997  8589 raft_consensus.cc:493] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.642339  8589 raft_consensus.cc:3060] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.642715  8587 leader_election.cc:290] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:45.631541  8586 raft_consensus.cc:515] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.647027  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cff31edfc694b9b94b47e932c3940f9" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:45.647644  8106 raft_consensus.cc:3060] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.648718  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:45.649248  8429 raft_consensus.cc:493] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.649817  8429 raft_consensus.cc:515] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.655498  8371 tablet_bootstrap.cc:654] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.656059  8586 leader_election.cc:290] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:45.652151  8374 tablet_bootstrap.cc:492] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:45.655912  8002 catalog_manager.cc:5697] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.656980  8374 ts_tablet_manager.cc:1403] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.007s
I20260709 12:15:45.657259  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cff31edfc694b9b94b47e932c3940f9" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:45.657868  8253 raft_consensus.cc:3060] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.659651  8254 raft_consensus.cc:2468] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:45.660557  8374 raft_consensus.cc:359] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.661327  8374 raft_consensus.cc:385] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.661638  8374 raft_consensus.cc:740] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.662351  8374 consensus_queue.cc:260] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.665001  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aedf68b2244597bed9a1046869df3e" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:45.653502  8372 raft_consensus.cc:359] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.665441  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aedf68b2244597bed9a1046869df3e" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:45.665688  8330 raft_consensus.cc:3060] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.665951  8469 leader_election.cc:290] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
W20260709 12:15:45.667024  8073 leader_election.cc:343] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.667397  8372 raft_consensus.cc:385] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.667764  8372 raft_consensus.cc:740] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.668071  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:45.668799  8105 raft_consensus.cc:2468] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:45.669203  8371 tablet_bootstrap.cc:492] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:45.669673  8371 ts_tablet_manager.cc:1403] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.003s
I20260709 12:15:45.670539  8374 ts_tablet_manager.cc:1434] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:15:45.671142  8219 leader_election.cc:304] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:45.671670  8374 tablet_bootstrap.cc:492] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:45.671401  8579 consensus_queue.cc:1048] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:45.672458  8371 raft_consensus.cc:359] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.672544  8569 consensus_queue.cc:1048] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.673125  8579 raft_consensus.cc:2804] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.673578  8579 raft_consensus.cc:493] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.673924  8579 raft_consensus.cc:3060] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.674510  8371 raft_consensus.cc:385] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.654034  8577 consensus_queue.cc:1048] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:45.674700  8429 leader_election.cc:290] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:45.677742  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:45.678135  8374 tablet_bootstrap.cc:654] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.668494  8372 consensus_queue.cc:260] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.690809  8253 raft_consensus.cc:2468] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:45.693200  8372 ts_tablet_manager.cc:1434] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.003s
I20260709 12:15:45.674847  8371 raft_consensus.cc:740] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.695554  8148 leader_election.cc:304] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:45.698103  8586 raft_consensus.cc:2804] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:45.697151  8371 consensus_queue.cc:260] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.700951  8579 raft_consensus.cc:515] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.704411  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:45.704591  8106 raft_consensus.cc:2468] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:45.705402  8374 tablet_bootstrap.cc:492] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:45.706000  8625 raft_consensus.cc:493] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.706493  8625 raft_consensus.cc:515] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.707674  8374 ts_tablet_manager.cc:1403] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.003s
I20260709 12:15:45.707937  8371 ts_tablet_manager.cc:1434] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 12:15:45.708979  8371 tablet_bootstrap.cc:492] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:45.710613  8374 raft_consensus.cc:359] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.711232  8374 raft_consensus.cc:385] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.707690  8586 raft_consensus.cc:697] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:45.711920  8330 raft_consensus.cc:2468] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:45.712774  8586 consensus_queue.cc:237] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.713177  8070 leader_election.cc:304] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:45.713773  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:45.714349  8569 raft_consensus.cc:2804] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:45.714905  8569 raft_consensus.cc:697] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:45.711513  8374 raft_consensus.cc:740] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.715723  8374 consensus_queue.cc:260] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.715833  8569 consensus_queue.cc:237] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.717906  8374 ts_tablet_manager.cc:1434] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 12:15:45.718875  8374 tablet_bootstrap.cc:492] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:45.714396  8105 raft_consensus.cc:3060] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.723117  8372 tablet_bootstrap.cc:492] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:45.728483  8105 raft_consensus.cc:2468] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:45.730173  8219 leader_election.cc:304] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:45.731091  8429 raft_consensus.cc:2804] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:45.731603  8429 raft_consensus.cc:697] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:45.732416  8429 consensus_queue.cc:237] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.722723  8589 raft_consensus.cc:515] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.734858  8182 raft_consensus.cc:2393] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66af1447f2c64ebda5448a760d5d7718 in current term 1: Already voted for candidate b02838a902c44ea49d8d94181285b20e in this term.
I20260709 12:15:45.737186  8579 leader_election.cc:290] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:45.737390  8625 leader_election.cc:290] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:45.738966  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9383c8a3a24a0ba2d5b8d5e1006a50" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:45.739653  8102 raft_consensus.cc:2468] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:45.741945  8219 leader_election.cc:304] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:45.741959  8374 tablet_bootstrap.cc:654] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.746119  8469 consensus_queue.cc:1048] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:45.747865  8577 raft_consensus.cc:2804] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.748283  8577 raft_consensus.cc:493] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.748502  8625 raft_consensus.cc:493] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.748658  8577 raft_consensus.cc:3060] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.748993  8625 raft_consensus.cc:515] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.749112  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9383c8a3a24a0ba2d5b8d5e1006a50" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:45.752633  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbd2f663574037a43ecf0219ef1c48" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:45.752868  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbd2f663574037a43ecf0219ef1c48" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
W20260709 12:15:45.762279  8222 leader_election.cc:343] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.751183  8625 leader_election.cc:290] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:45.765784  8371 tablet_bootstrap.cc:654] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.766400  8003 catalog_manager.cc:5697] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:45.769497  8219 leader_election.cc:343] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.769675  8373 tablet_bootstrap.cc:492] T 2f7f51cbe52e4c4c99fc31b081f4372a P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:45.774899  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:45.811833  8373 ts_tablet_manager.cc:1403] T 2f7f51cbe52e4c4c99fc31b081f4372a P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.283s	user 0.020s	sys 0.021s
I20260709 12:15:45.780746  8589 leader_election.cc:290] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:45.786460  8371 tablet_bootstrap.cc:492] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:45.812806  8371 ts_tablet_manager.cc:1403] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.007s
I20260709 12:15:45.813103  8577 raft_consensus.cc:515] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.790956  8569 raft_consensus.cc:493] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.803339  8586 consensus_queue.cc:1048] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.814677  8373 raft_consensus.cc:359] T 2f7f51cbe52e4c4c99fc31b081f4372a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.815361  8373 raft_consensus.cc:385] T 2f7f51cbe52e4c4c99fc31b081f4372a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.815676  8373 raft_consensus.cc:740] T 2f7f51cbe52e4c4c99fc31b081f4372a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.815474  8371 raft_consensus.cc:359] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.816267  8371 raft_consensus.cc:385] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.816568  8371 raft_consensus.cc:740] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.816454  8373 consensus_queue.cc:260] T 2f7f51cbe52e4c4c99fc31b081f4372a P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:45.817303  8371 consensus_queue.cc:260] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.819157  8373 ts_tablet_manager.cc:1434] T 2f7f51cbe52e4c4c99fc31b081f4372a P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:45.803776  8372 tablet_bootstrap.cc:654] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.807293  8427 raft_consensus.cc:493] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.807613  8374 tablet_bootstrap.cc:492] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:45.819607  8371 ts_tablet_manager.cc:1434] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:15:45.820068  8374 ts_tablet_manager.cc:1403] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.101s	user 0.016s	sys 0.013s
I20260709 12:15:45.819901  8427 raft_consensus.cc:515] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.820683  8371 tablet_bootstrap.cc:492] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:45.822101  8427 leader_election.cc:290] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:45.822921  8374 raft_consensus.cc:359] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.823653  8374 raft_consensus.cc:385] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.823815  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:45.824671  8328 raft_consensus.cc:2468] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:45.824923  8373 tablet_bootstrap.cc:492] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:45.825289  8002 catalog_manager.cc:5697] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:45.825881  8145 leader_election.cc:304] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:45.826900  8427 raft_consensus.cc:2804] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.827303  8427 raft_consensus.cc:493] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.827698  8427 raft_consensus.cc:3060] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.823959  8374 raft_consensus.cc:740] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.831642  8373 tablet_bootstrap.cc:654] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.831223  8374 consensus_queue.cc:260] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.832602  8577 leader_election.cc:290] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:45.832804  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9383c8a3a24a0ba2d5b8d5e1006a50" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:45.834144  8374 ts_tablet_manager.cc:1434] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
W20260709 12:15:45.834291  8222 leader_election.cc:343] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.835258  8374 tablet_bootstrap.cc:492] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:45.838742  8106 raft_consensus.cc:1275] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:45.841414  8457 consensus_queue.cc:1048] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:45.841961  8374 tablet_bootstrap.cc:654] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.843586  8371 tablet_bootstrap.cc:654] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.847293  8328 raft_consensus.cc:3060] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.824103  8569 raft_consensus.cc:515] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:45.863801  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8e6e90970441fdad02bb1119456dea" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:45.865500  8070 leader_election.cc:343] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:45.866633  8219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:34153, user_credentials={real_user=slave}} blocked reactor thread for 97162.3us
W20260709 12:15:45.867681  8606 log.cc:927] Time spent T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:15:45.868289  8629 log.cc:927] Time spent T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:15:45.869678  8371 tablet_bootstrap.cc:492] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:45.870152  8371 ts_tablet_manager.cc:1403] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.006s
I20260709 12:15:45.872064  8372 tablet_bootstrap.cc:492] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:45.872733  8372 ts_tablet_manager.cc:1403] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.179s	user 0.012s	sys 0.000s
I20260709 12:15:45.881603  8374 tablet_bootstrap.cc:492] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:45.882315  8374 ts_tablet_manager.cc:1403] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.002s
I20260709 12:15:45.873535  8555 raft_consensus.cc:493] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.889078  8555 raft_consensus.cc:515] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
W20260709 12:15:45.893656  8219 leader_election.cc:343] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.894354  8219 leader_election.cc:304] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:45.870713  8569 leader_election.cc:290] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:45.897393  8577 raft_consensus.cc:2749] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:45.898885  8427 raft_consensus.cc:515] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:45.901062  8427 leader_election.cc:290] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:45.878772  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:45.902918  8105 raft_consensus.cc:2393] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b02838a902c44ea49d8d94181285b20e in current term 1: Already voted for candidate 66af1447f2c64ebda5448a760d5d7718 in this term.
I20260709 12:15:45.904371  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8e6e90970441fdad02bb1119456dea" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:45.905301  8254 raft_consensus.cc:2468] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:45.905951  8145 leader_election.cc:304] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:45.909174  8073 leader_election.cc:304] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:45.916815  8590 raft_consensus.cc:493] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.909482  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:45.922477  8330 raft_consensus.cc:3060] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.911262  8636 raft_consensus.cc:493] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.924237  8636 raft_consensus.cc:515] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.915120  8328 raft_consensus.cc:3060] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.918555  8469 raft_consensus.cc:2804] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.935325  8469 raft_consensus.cc:493] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.935762  8469 raft_consensus.cc:3060] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.937041  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c09223f8a6c4f7fb844bce6937e86f4" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:45.897734  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:45.939867  8104 raft_consensus.cc:2468] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:45.939901  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9383c8a3a24a0ba2d5b8d5e1006a50" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:45.940819  8105 raft_consensus.cc:3060] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.917495  8590 raft_consensus.cc:515] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:45.948654  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:45.948921  8222 leader_election.cc:343] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.950070  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:45.950904  8102 raft_consensus.cc:3060] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.953862  8555 leader_election.cc:290] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:45.927045  8636 leader_election.cc:290] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:45.959862  8589 consensus_queue.cc:1048] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.974856  8180 raft_consensus.cc:1275] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:45.975932  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325569f077184e418663d6e5e3f6fd3b" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:45.977038  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c09223f8a6c4f7fb844bce6937e86f4" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:45.994119  8590 leader_election.cc:290] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:45.995363  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325569f077184e418663d6e5e3f6fd3b" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:45.997527  8296 leader_election.cc:304] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:45.999208  8457 consensus_queue.cc:1048] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.958758  8374 raft_consensus.cc:359] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.002233  8374 raft_consensus.cc:385] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.002662  8374 raft_consensus.cc:740] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.957327  8427 raft_consensus.cc:2749] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:46.008549  8374 consensus_queue.cc:260] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:15:45.999248  8219 leader_election.cc:343] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.015655  8374 ts_tablet_manager.cc:1434] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.133s	user 0.009s	sys 0.000s
I20260709 12:15:46.039819  8374 tablet_bootstrap.cc:492] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:46.045940  8371 raft_consensus.cc:359] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.046710  8371 raft_consensus.cc:385] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.046975  8371 raft_consensus.cc:740] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.018280  8219 leader_election.cc:304] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:46.049540  8373 tablet_bootstrap.cc:492] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:46.050056  8373 ts_tablet_manager.cc:1403] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.225s	user 0.049s	sys 0.076s
I20260709 12:15:46.050675  8102 raft_consensus.cc:2468] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:46.052078  8457 raft_consensus.cc:2749] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:46.056154  8371 consensus_queue.cc:260] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.058060  8373 raft_consensus.cc:359] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:46.059695  8373 raft_consensus.cc:385] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.060006  8373 raft_consensus.cc:740] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.060750  8373 consensus_queue.cc:260] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:46.061779  8145 leader_election.cc:304] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:46.062325  8373 ts_tablet_manager.cc:1434] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:15:46.067669  8374 tablet_bootstrap.cc:654] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.056161  8625 raft_consensus.cc:2749] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:46.073902  8371 ts_tablet_manager.cc:1434] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.203s	user 0.006s	sys 0.001s
I20260709 12:15:46.041319  8469 raft_consensus.cc:515] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
W20260709 12:15:46.058862  8219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:44023, user_credentials={real_user=slave}} blocked reactor thread for 59659us
I20260709 12:15:46.069953  8589 raft_consensus.cc:2804] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:46.069485  8582 raft_consensus.cc:493] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.080428  8589 raft_consensus.cc:697] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:46.081377  8589 consensus_queue.cc:237] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:46.083062  8372 raft_consensus.cc:359] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.083812  8372 raft_consensus.cc:385] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.084081  8372 raft_consensus.cc:740] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.084770  8372 consensus_queue.cc:260] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
W20260709 12:15:46.074786  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:42019, user_credentials={real_user=slave}} blocked reactor thread for 74114.8us
I20260709 12:15:46.089299  8469 leader_election.cc:290] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:46.090286  8582 raft_consensus.cc:515] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:46.092515  8371 tablet_bootstrap.cc:492] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:46.094077  8582 leader_election.cc:290] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:46.095237  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5c04cc27ba4d1dbb26c919321fbfa9" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:46.096410  8181 raft_consensus.cc:3060] T 2f7f51cbe52e4c4c99fc31b081f4372a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.100796  8330 raft_consensus.cc:2468] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:46.102048  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8e6e90970441fdad02bb1119456dea" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:46.106863  8644 consensus_queue.cc:1048] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:46.113191  8647 consensus_queue.cc:1048] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:46.102977  8327 raft_consensus.cc:3060] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.116129  8645 raft_consensus.cc:493] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.120275  8645 raft_consensus.cc:515] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.122897  8645 leader_election.cc:290] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:46.124694  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:46.125150  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:46.126523  8070 leader_election.cc:343] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.129755  8002 catalog_manager.cc:5697] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:46.128203  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5c04cc27ba4d1dbb26c919321fbfa9" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:46.138451  8372 ts_tablet_manager.cc:1434] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.265s	user 0.008s	sys 0.009s
I20260709 12:15:46.139608  8073 leader_election.cc:304] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:46.147542  8372 tablet_bootstrap.cc:492] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:46.148342  8648 consensus_queue.cc:1048] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:46.150311  8105 raft_consensus.cc:2468] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:46.145143  8569 raft_consensus.cc:2749] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:46.166884  8372 tablet_bootstrap.cc:654] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.175043  8373 tablet_bootstrap.cc:492] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:46.178126  8371 tablet_bootstrap.cc:654] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.185365  8589 consensus_queue.cc:1048] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:46.187830  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8e6e90970441fdad02bb1119456dea" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:46.188354  8253 raft_consensus.cc:3060] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.197145  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:46.197911  8255 raft_consensus.cc:2468] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:46.203859  8073 leader_election.cc:304] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:46.171680  8296 leader_election.cc:304] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:46.206298  8569 raft_consensus.cc:2804] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:46.205504  8429 consensus_queue.cc:1048] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:46.206720  8651 raft_consensus.cc:2749] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:46.206866  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:40315, user_credentials={real_user=slave}} blocked reactor thread for 46930.4us
I20260709 12:15:46.206779  8569 raft_consensus.cc:493] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.210237  8569 raft_consensus.cc:3060] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.174207  8219 leader_election.cc:304] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:46.225957  8429 raft_consensus.cc:2804] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:15:46.226296  8219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:34153, user_credentials={real_user=slave}} blocked reactor thread for 52171us
I20260709 12:15:46.237865  8647 raft_consensus.cc:493] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.239547  8647 raft_consensus.cc:515] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:46.241863  8647 leader_election.cc:290] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
W20260709 12:15:46.243968  8053 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:46.245249  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546c0cac1bd49e787e00b8c1d8e9eea" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:46.246903  8222 leader_election.cc:343] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.226603  8429 raft_consensus.cc:697] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:46.248509  8429 consensus_queue.cc:237] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.254464  8373 tablet_bootstrap.cc:654] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.273506  8469 raft_consensus.cc:493] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.231997  8327 raft_consensus.cc:2468] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:46.280544  8569 raft_consensus.cc:515] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.303500  8372 tablet_bootstrap.cc:492] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:46.310647  8372 ts_tablet_manager.cc:1403] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.167s	user 0.011s	sys 0.010s
I20260709 12:15:46.315560  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:46.316252  8254 raft_consensus.cc:3060] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.320538  8374 tablet_bootstrap.cc:492] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:46.321285  8374 ts_tablet_manager.cc:1403] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.291s	user 0.010s	sys 0.005s
I20260709 12:15:46.323823  8002 catalog_manager.cc:5697] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:46.276528  8469 raft_consensus.cc:515] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:46.325659  8648 raft_consensus.cc:493] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.356662  8469 leader_election.cc:290] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:46.338905  8587 consensus_queue.cc:1048] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:15:46.357801  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b09c2f447345459284f96e85c1af52" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:46.362601  8253 raft_consensus.cc:2468] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:46.363678  8181 raft_consensus.cc:3060] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.352015  8648 raft_consensus.cc:515] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:15:46.362751  8073 leader_election.cc:343] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.365661  8073 leader_election.cc:304] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:46.371795  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546c0cac1bd49e787e00b8c1d8e9eea" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:46.372643  8569 leader_election.cc:290] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:46.369117  8645 raft_consensus.cc:2804] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:46.375202  8645 raft_consensus.cc:697] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:46.376116  8645 consensus_queue.cc:237] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.382966  8648 leader_election.cc:290] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:46.386303  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7d8ef97f464b0db4ddc179e9202157" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:46.386399  8374 raft_consensus.cc:359] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.387305  8374 raft_consensus.cc:385] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.387632  8374 raft_consensus.cc:740] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
W20260709 12:15:46.387986  8222 leader_election.cc:343] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.388288  8374 consensus_queue.cc:260] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.397310  8372 raft_consensus.cc:359] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:46.398104  8372 raft_consensus.cc:385] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.398380  8372 raft_consensus.cc:740] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.401795  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7d8ef97f464b0db4ddc179e9202157" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:46.405282  8254 raft_consensus.cc:2468] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:46.406934  8371 tablet_bootstrap.cc:492] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:46.407503  8371 ts_tablet_manager.cc:1403] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.328s	user 0.020s	sys 0.027s
I20260709 12:15:46.409567  8371 raft_consensus.cc:359] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.410071  8371 raft_consensus.cc:385] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.410326  8371 raft_consensus.cc:740] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.411082  8371 consensus_queue.cc:260] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.414101  8371 ts_tablet_manager.cc:1434] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:15:46.415344  8371 tablet_bootstrap.cc:492] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:46.421620  8371 tablet_bootstrap.cc:654] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.399068  8372 consensus_queue.cc:260] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:46.422782  8651 raft_consensus.cc:493] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.423259  8651 raft_consensus.cc:515] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:46.425832  8372 ts_tablet_manager.cc:1434] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.115s	user 0.007s	sys 0.000s
I20260709 12:15:46.427413  8372 tablet_bootstrap.cc:492] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:46.427925  8073 leader_election.cc:304] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:46.428709  8569 raft_consensus.cc:2804] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:46.429191  8569 raft_consensus.cc:697] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:46.430034  8569 consensus_queue.cc:237] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.433962  8372 tablet_bootstrap.cc:654] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.434906  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:46.446822  8469 consensus_queue.cc:1048] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:46.436699  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b09c2f447345459284f96e85c1af52" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:46.452775  8374 ts_tablet_manager.cc:1434] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.131s	user 0.007s	sys 0.000s
I20260709 12:15:46.453823  8373 tablet_bootstrap.cc:492] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:46.454041  8374 tablet_bootstrap.cc:492] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:46.454308  8373 ts_tablet_manager.cc:1403] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.308s	user 0.007s	sys 0.033s
W20260709 12:15:46.455586  8219 leader_election.cc:343] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.455658  8644 consensus_queue.cc:1048] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:46.456264  8219 leader_election.cc:304] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
W20260709 12:15:46.458017  8070 leader_election.cc:343] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.458143  8647 raft_consensus.cc:2749] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:46.460055  8651 leader_election.cc:290] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
W20260709 12:15:46.458175  8219 leader_election.cc:343] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.469228  8372 tablet_bootstrap.cc:492] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
W20260709 12:15:46.470043  8070 leader_election.cc:343] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.470537  8070 leader_election.cc:304] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:46.472131  8631 raft_consensus.cc:2749] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:46.476670  8372 ts_tablet_manager.cc:1403] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.008s
I20260709 12:15:46.487090  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c09223f8a6c4f7fb844bce6937e86f4" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:46.475533  8219 leader_election.cc:304] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:46.491144  8648 raft_consensus.cc:2749] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:46.496361  8373 raft_consensus.cc:359] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.500164  8373 raft_consensus.cc:385] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.500587  8373 raft_consensus.cc:740] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.462569  8645 consensus_queue.cc:1048] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:15:46.508234  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c09223f8a6c4f7fb844bce6937e86f4" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:46.510578  8371 tablet_bootstrap.cc:492] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:46.511289  8371 ts_tablet_manager.cc:1403] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.005s
W20260709 12:15:46.519050  8296 leader_election.cc:343] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.496160  8253 raft_consensus.cc:2468] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:46.526724  8296 leader_election.cc:304] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:46.527684  8651 raft_consensus.cc:2804] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:46.528072  8651 raft_consensus.cc:493] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.528412  8651 raft_consensus.cc:3060] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.532968  8373 consensus_queue.cc:260] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.535862  8373 ts_tablet_manager.cc:1434] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.001s
I20260709 12:15:46.536846  8373 tablet_bootstrap.cc:492] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:46.539191  8651 raft_consensus.cc:515] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:46.541708  8374 tablet_bootstrap.cc:654] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.543100  8651 leader_election.cc:290] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:46.544757  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c09223f8a6c4f7fb844bce6937e86f4" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:46.545965  8253 raft_consensus.cc:3060] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.544757  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c09223f8a6c4f7fb844bce6937e86f4" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:46.551640  8645 raft_consensus.cc:493] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.550025  8002 catalog_manager.cc:5697] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:46.515130  8371 raft_consensus.cc:359] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.554991  8371 raft_consensus.cc:385] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.555383  8371 raft_consensus.cc:740] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.557948  8371 consensus_queue.cc:260] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.565302  8253 raft_consensus.cc:2468] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:46.565578  8372 raft_consensus.cc:359] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:46.566285  8372 raft_consensus.cc:385] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.566563  8372 raft_consensus.cc:740] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
W20260709 12:15:46.556543  8296 leader_election.cc:343] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.567339  8372 consensus_queue.cc:260] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:46.568364  8296 leader_election.cc:304] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:46.570043  8371 ts_tablet_manager.cc:1434] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.001s
I20260709 12:15:46.552325  8645 raft_consensus.cc:515] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.582201  8372 ts_tablet_manager.cc:1434] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.105s	user 0.006s	sys 0.001s
I20260709 12:15:46.588472  8645 leader_election.cc:290] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:46.587071  8371 tablet_bootstrap.cc:492] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:46.573637  8582 raft_consensus.cc:2804] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:46.595923  8582 raft_consensus.cc:697] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:46.596305  8371 tablet_bootstrap.cc:654] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.597167  8582 consensus_queue.cc:237] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:46.600792  8457 raft_consensus.cc:493] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.601491  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbd2f663574037a43ecf0219ef1c48" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:46.601349  8457 raft_consensus.cc:515] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:46.602234  8253 raft_consensus.cc:2468] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:46.603718  8073 leader_election.cc:304] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:46.605091  8469 raft_consensus.cc:2804] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:46.605603  8469 raft_consensus.cc:493] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.606020  8469 raft_consensus.cc:3060] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.612085  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbd2f663574037a43ecf0219ef1c48" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:46.625572  8070 leader_election.cc:343] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.626657  8457 leader_election.cc:290] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:46.639253  8371 tablet_bootstrap.cc:492] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:46.640137  8371 ts_tablet_manager.cc:1403] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.009s
I20260709 12:15:46.644089  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b09c2f447345459284f96e85c1af52" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:46.648160  8373 tablet_bootstrap.cc:654] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.649263  8372 tablet_bootstrap.cc:492] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:46.648674  8664 consensus_queue.cc:1048] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:15:46.653481  8296 leader_election.cc:343] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.650414  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b09c2f447345459284f96e85c1af52" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:46.655011  8102 raft_consensus.cc:2468] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:46.656708  8293 leader_election.cc:304] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:46.657605  8582 raft_consensus.cc:2804] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:46.658013  8582 raft_consensus.cc:493] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.659374  8582 raft_consensus.cc:3060] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.660758  8469 raft_consensus.cc:515] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.661098  8664 consensus_queue.cc:1048] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:46.666946  8005 catalog_manager.cc:5697] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:46.671742  8005 catalog_manager.cc:5697] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:46.674347  8374 tablet_bootstrap.cc:492] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:46.674948  8374 ts_tablet_manager.cc:1403] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.221s	user 0.017s	sys 0.047s
I20260709 12:15:46.678228  8374 raft_consensus.cc:359] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:46.679761  8582 raft_consensus.cc:515] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:46.684315  8374 raft_consensus.cc:385] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.684661  8374 raft_consensus.cc:740] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.686635  8374 consensus_queue.cc:260] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:46.685201  8002 catalog_manager.cc:5697] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 1 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:46.704002  8374 ts_tablet_manager.cc:1434] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:15:46.705870  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b09c2f447345459284f96e85c1af52" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:46.706573  8106 raft_consensus.cc:3060] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.706758  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbd2f663574037a43ecf0219ef1c48" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:46.707448  8254 raft_consensus.cc:3060] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.709082  8371 raft_consensus.cc:359] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.712483  8371 raft_consensus.cc:385] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.712836  8371 raft_consensus.cc:740] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.713680  8371 consensus_queue.cc:260] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.716516  8645 raft_consensus.cc:493] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.716993  8254 raft_consensus.cc:2468] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:46.716995  8645 raft_consensus.cc:515] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.718302  8374 tablet_bootstrap.cc:492] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:46.719488  8073 leader_election.cc:304] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:46.719715  8469 leader_election.cc:290] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:46.720296  8469 raft_consensus.cc:2804] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:46.725208  8469 raft_consensus.cc:697] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:46.727602  8664 raft_consensus.cc:493] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.728276  8664 raft_consensus.cc:515] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.728271  8469 consensus_queue.cc:237] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.737226  8664 leader_election.cc:290] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:46.744027  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7d8ef97f464b0db4ddc179e9202157" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:46.744043  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7d8ef97f464b0db4ddc179e9202157" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:46.743253  8645 leader_election.cc:290] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:46.744956  8254 raft_consensus.cc:2468] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:46.745728  8371 ts_tablet_manager.cc:1434] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.105s	user 0.006s	sys 0.001s
I20260709 12:15:46.746399  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae828d825348490eb62b74680a762deb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:46.746567  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbd2f663574037a43ecf0219ef1c48" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:46.747394  8372 tablet_bootstrap.cc:654] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.749744  8371 tablet_bootstrap.cc:492] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
W20260709 12:15:46.750790  8073 leader_election.cc:343] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.776789  8374 tablet_bootstrap.cc:654] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:46.748647  8070 leader_election.cc:343] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:46.747983  8145 leader_election.cc:343] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.764783  8582 leader_election.cc:290] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:46.784327  8429 raft_consensus.cc:493] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.788630  8429 raft_consensus.cc:515] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.788980  8148 leader_election.cc:304] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:46.748328  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae828d825348490eb62b74680a762deb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:46.790792  8429 leader_election.cc:290] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:46.790896  8664 raft_consensus.cc:2804] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:46.791499  8664 raft_consensus.cc:493] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.791515  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "642643c6b8a74401860aad4b969f9131" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:46.792091  8664 raft_consensus.cc:3060] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:46.793577  8222 consensus_peers.cc:597] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:46.784993  8106 raft_consensus.cc:2468] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
W20260709 12:15:46.795553  8219 leader_election.cc:343] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:46.800750  8073 leader_election.cc:343] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.801203  8073 leader_election.cc:304] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:46.803027  8645 raft_consensus.cc:2749] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:46.820957  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "642643c6b8a74401860aad4b969f9131" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:46.824599  8106 raft_consensus.cc:2468] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:46.811007  8293 leader_election.cc:304] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:46.826061  8219 leader_election.cc:304] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:46.827201  8582 raft_consensus.cc:2804] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:46.827729  8582 raft_consensus.cc:697] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:46.828562  8582 consensus_queue.cc:237] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
W20260709 12:15:46.813493  8148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:40315, user_credentials={real_user=slave}} blocked reactor thread for 63068.8us
I20260709 12:15:46.847779  8644 raft_consensus.cc:2804] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:46.848237  8644 raft_consensus.cc:493] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.848565  8644 raft_consensus.cc:3060] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.856487  8429 consensus_queue.cc:1048] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:46.857805  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b09c2f447345459284f96e85c1af52" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:46.861831  8371 tablet_bootstrap.cc:654] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.864570  8373 tablet_bootstrap.cc:492] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
W20260709 12:15:46.864739  8296 leader_election.cc:343] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.865372  8373 ts_tablet_manager.cc:1403] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.329s	user 0.024s	sys 0.010s
I20260709 12:15:46.871500  8373 raft_consensus.cc:359] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.872372  8373 raft_consensus.cc:385] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.872830  8373 raft_consensus.cc:740] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.875622  8373 consensus_queue.cc:260] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.877339  8372 tablet_bootstrap.cc:492] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:46.877844  8372 ts_tablet_manager.cc:1403] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.236s	user 0.025s	sys 0.044s
I20260709 12:15:46.881078  8372 raft_consensus.cc:359] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:46.881788  8372 raft_consensus.cc:385] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.882066  8372 raft_consensus.cc:740] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.882738  8372 consensus_queue.cc:260] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:46.873710  8647 raft_consensus.cc:493] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.883706  8647 raft_consensus.cc:515] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:46.885152  8372 ts_tablet_manager.cc:1434] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:46.885774  8647 leader_election.cc:290] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:46.886266  8372 tablet_bootstrap.cc:492] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:46.886920  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2eac4b35b3646478eb5d30222e9ec59" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:46.887019  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2eac4b35b3646478eb5d30222e9ec59" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:46.888581  8645 consensus_queue.cc:1048] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:46.888592  8219 leader_election.cc:343] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:46.891283  8222 leader_election.cc:343] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.892050  8373 ts_tablet_manager.cc:1434] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:15:46.893040  8373 tablet_bootstrap.cc:492] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:46.893059  8372 tablet_bootstrap.cc:654] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.897732  8222 leader_election.cc:304] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:46.898887  8647 raft_consensus.cc:2749] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:46.900029  8664 raft_consensus.cc:515] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.903926  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7d8ef97f464b0db4ddc179e9202157" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:46.904348  8373 tablet_bootstrap.cc:654] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.909935  8569 raft_consensus.cc:493] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.910697  8569 raft_consensus.cc:515] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.921864  8664 leader_election.cc:290] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:46.923740  8374 tablet_bootstrap.cc:492] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:46.924494  8374 ts_tablet_manager.cc:1403] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.206s	user 0.018s	sys 0.024s
I20260709 12:15:46.930190  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7d8ef97f464b0db4ddc179e9202157" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:46.930902  8254 raft_consensus.cc:3060] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:46.933059  8145 leader_election.cc:343] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.933656  8374 raft_consensus.cc:359] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.934480  8374 raft_consensus.cc:385] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.934850  8374 raft_consensus.cc:740] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.934329  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3dcd2b92f84d1899b354f41bc21714" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:46.936637  8374 consensus_queue.cc:260] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:46.940932  8373 tablet_bootstrap.cc:492] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:46.942072  8373 ts_tablet_manager.cc:1403] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.009s
I20260709 12:15:46.945709  8372 tablet_bootstrap.cc:492] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:46.945294  8002 catalog_manager.cc:5697] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:46.946210  8372 ts_tablet_manager.cc:1403] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.023s
I20260709 12:15:46.948802  8372 raft_consensus.cc:359] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.949246  8372 raft_consensus.cc:385] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.949419  8372 raft_consensus.cc:740] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.949941  8372 consensus_queue.cc:260] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:46.967252  8372 ts_tablet_manager.cc:1434] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
W20260709 12:15:46.967401  8073 leader_election.cc:343] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.972579  8374 ts_tablet_manager.cc:1434] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 12:15:46.978425  8372 tablet_bootstrap.cc:492] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:46.986132  8569 leader_election.cc:290] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:46.989676  8374 tablet_bootstrap.cc:492] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:46.995901  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3dcd2b92f84d1899b354f41bc21714" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:46.984932  8645 consensus_queue.cc:1048] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:15:46.982306  8644 raft_consensus.cc:515] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
W20260709 12:15:47.000203  8073 leader_election.cc:343] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.000854  8073 leader_election.cc:304] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:47.003190  8371 tablet_bootstrap.cc:492] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:47.003847  8371 ts_tablet_manager.cc:1403] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.254s	user 0.023s	sys 0.022s
I20260709 12:15:47.002714  8569 raft_consensus.cc:2749] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:47.005991  8005 catalog_manager.cc:5697] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 1 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:47.010259  8644 leader_election.cc:290] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:47.012174  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "642643c6b8a74401860aad4b969f9131" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
W20260709 12:15:47.013819  8219 leader_election.cc:343] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.015821  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "642643c6b8a74401860aad4b969f9131" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:47.016459  8107 raft_consensus.cc:3060] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.018100  8254 raft_consensus.cc:2468] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:47.016407  8645 consensus_queue.cc:1048] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:47.028911  8148 leader_election.cc:304] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:47.030182  8665 raft_consensus.cc:2804] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.030697  8665 raft_consensus.cc:697] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:47.021664  8371 raft_consensus.cc:359] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.031490  8371 raft_consensus.cc:385] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.031631  8665 consensus_queue.cc:237] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:47.032492  8328 raft_consensus.cc:3060] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.034595  8372 tablet_bootstrap.cc:654] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.013583  8373 raft_consensus.cc:359] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.037302  8373 raft_consensus.cc:385] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.037617  8373 raft_consensus.cc:740] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.038380  8373 consensus_queue.cc:260] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.010859  8374 tablet_bootstrap.cc:654] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.031805  8371 raft_consensus.cc:740] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.043929  8371 consensus_queue.cc:260] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.048666  8371 ts_tablet_manager.cc:1434] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:15:47.051311  8371 tablet_bootstrap.cc:492] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:47.075021  8373 ts_tablet_manager.cc:1434] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.132s	user 0.008s	sys 0.000s
I20260709 12:15:47.081610  8373 tablet_bootstrap.cc:492] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:47.093282  8373 tablet_bootstrap.cc:654] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:47.104682  8296 consensus_peers.cc:597] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:47.106484  8371 tablet_bootstrap.cc:654] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.109447  8582 raft_consensus.cc:493] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.110138  8582 raft_consensus.cc:515] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.112840  8582 leader_election.cc:290] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:47.114391  8107 raft_consensus.cc:2468] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:47.118937  8219 leader_election.cc:304] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:47.126456  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546c0cac1bd49e787e00b8c1d8e9eea" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:47.130471  8296 leader_election.cc:343] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.121447  8647 raft_consensus.cc:2804] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.135208  8647 raft_consensus.cc:697] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:47.136121  8647 consensus_queue.cc:237] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:47.124953  8469 consensus_queue.cc:1048] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:15:47.122721  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546c0cac1bd49e787e00b8c1d8e9eea" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:47.144534  8253 raft_consensus.cc:2468] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:47.150974  8296 leader_election.cc:304] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:47.152004  8582 raft_consensus.cc:2804] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:47.152163  8645 raft_consensus.cc:493] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.152448  8582 raft_consensus.cc:493] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.152912  8582 raft_consensus.cc:3060] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.152771  8645 raft_consensus.cc:515] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.155184  8645 leader_election.cc:290] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:47.155905  8665 raft_consensus.cc:493] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.156466  8374 tablet_bootstrap.cc:492] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:47.156999  8374 ts_tablet_manager.cc:1403] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.170s	user 0.027s	sys 0.024s
I20260709 12:15:47.157660  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d921491df994357a386e8d378ccfd09" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:47.158248  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d921491df994357a386e8d378ccfd09" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:47.159179  8070 leader_election.cc:343] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:47.159783  8073 leader_election.cc:343] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.159665  8374 raft_consensus.cc:359] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.160250  8073 leader_election.cc:304] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:47.160534  8374 raft_consensus.cc:385] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.160846  8374 raft_consensus.cc:740] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.161525  8374 consensus_queue.cc:260] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.162339  8001 catalog_manager.cc:5697] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:47.163417  8374 ts_tablet_manager.cc:1434] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:15:47.166545  8372 tablet_bootstrap.cc:492] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:47.167029  8372 ts_tablet_manager.cc:1403] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.193s	user 0.014s	sys 0.019s
I20260709 12:15:47.179306  8645 raft_consensus.cc:2749] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:47.186657  8651 consensus_queue.cc:1048] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:15:47.197815  8372 raft_consensus.cc:359] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.198377  8372 raft_consensus.cc:385] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.198621  8372 raft_consensus.cc:740] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.199242  8372 consensus_queue.cc:260] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.156443  8665 raft_consensus.cc:515] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.209151  8374 tablet_bootstrap.cc:492] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:47.211547  8373 tablet_bootstrap.cc:492] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:47.212088  8373 ts_tablet_manager.cc:1403] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.131s	user 0.016s	sys 0.012s
I20260709 12:15:47.217444  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b09c2f447345459284f96e85c1af52" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:47.220752  8372 ts_tablet_manager.cc:1434] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.003s
I20260709 12:15:47.222468  8665 leader_election.cc:290] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:47.224633  8582 raft_consensus.cc:515] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.214844  8373 raft_consensus.cc:359] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.225895  8373 raft_consensus.cc:385] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.226207  8373 raft_consensus.cc:740] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.230157  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b09c2f447345459284f96e85c1af52" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:47.231035  8106 raft_consensus.cc:2393] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b02838a902c44ea49d8d94181285b20e in current term 1: Already voted for candidate 9058059c81534bc4b58c5329d5734dcc in this term.
I20260709 12:15:47.232360  8145 leader_election.cc:304] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:47.234086  8664 raft_consensus.cc:3060] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.234828  8374 tablet_bootstrap.cc:654] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.235482  8371 tablet_bootstrap.cc:492] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:47.236012  8371 ts_tablet_manager.cc:1403] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.185s	user 0.011s	sys 0.027s
I20260709 12:15:47.240971  8569 consensus_queue.cc:1048] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:47.226898  8373 consensus_queue.cc:260] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.246091  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546c0cac1bd49e787e00b8c1d8e9eea" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
W20260709 12:15:47.247607  8296 leader_election.cc:343] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.248673  8371 raft_consensus.cc:359] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:47.249433  8371 raft_consensus.cc:385] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.249711  8371 raft_consensus.cc:740] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.256430  8372 tablet_bootstrap.cc:492] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:47.258543  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546c0cac1bd49e787e00b8c1d8e9eea" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:47.259228  8254 raft_consensus.cc:3060] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.261935  8586 raft_consensus.cc:493] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.262471  8586 raft_consensus.cc:515] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:47.264910  8586 leader_election.cc:290] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
W20260709 12:15:47.266140  8070 consensus_peers.cc:597] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 -> Peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Couldn't send request to peer 9058059c81534bc4b58c5329d5734dcc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:47.266929  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9383c8a3a24a0ba2d5b8d5e1006a50" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:47.274765  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9383c8a3a24a0ba2d5b8d5e1006a50" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:47.275671  8254 raft_consensus.cc:2468] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:47.279735  8296 leader_election.cc:304] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:47.280719  8651 raft_consensus.cc:2804] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.281200  8651 raft_consensus.cc:697] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:47.281826  8372 tablet_bootstrap.cc:654] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.282083  8651 consensus_queue.cc:237] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.276221  8582 leader_election.cc:290] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:47.277220  8373 ts_tablet_manager.cc:1434] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.002s
I20260709 12:15:47.290722  8373 tablet_bootstrap.cc:492] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:47.277707  8371 consensus_queue.cc:260] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:47.300129  8371 ts_tablet_manager.cc:1434] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.002s
I20260709 12:15:47.302455  8371 tablet_bootstrap.cc:492] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:47.305135  8001 catalog_manager.cc:5697] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 1 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:47.309070  8373 tablet_bootstrap.cc:654] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.286406  8005 catalog_manager.cc:5697] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:47.318655  8181 raft_consensus.cc:3060] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.312713  8664 raft_consensus.cc:2749] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:47.345451  8145 leader_election.cc:304] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:47.353691  8371 tablet_bootstrap.cc:654] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.363468  8649 raft_consensus.cc:493] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.364821  8649 raft_consensus.cc:515] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.367192  8649 leader_election.cc:290] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:47.375023  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
W20260709 12:15:47.377555  8293 leader_election.cc:343] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.380505  8374 tablet_bootstrap.cc:492] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:47.381271  8374 ts_tablet_manager.cc:1403] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.193s	user 0.022s	sys 0.022s
I20260709 12:15:47.385459  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:47.388861  8429 raft_consensus.cc:493] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.393214  8429 raft_consensus.cc:515] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:47.395084  8374 raft_consensus.cc:359] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:47.395864  8374 raft_consensus.cc:385] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.396152  8374 raft_consensus.cc:740] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.396837  8374 consensus_queue.cc:260] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:47.397493  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae828d825348490eb62b74680a762deb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:47.395318  8429 leader_election.cc:290] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
W20260709 12:15:47.398345  8296 leader_election.cc:343] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.399278  8296 leader_election.cc:304] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:47.401541  8582 raft_consensus.cc:2749] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:47.398269  8102 raft_consensus.cc:2468] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:47.406345  8219 leader_election.cc:304] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:47.406394  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae828d825348490eb62b74680a762deb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:47.407230  8625 raft_consensus.cc:2804] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:47.407662  8625 raft_consensus.cc:493] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.404206  8373 tablet_bootstrap.cc:492] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
W20260709 12:15:47.407990  8222 leader_election.cc:343] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.408689  8373 ts_tablet_manager.cc:1403] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.118s	user 0.023s	sys 0.013s
I20260709 12:15:47.408007  8625 raft_consensus.cc:3060] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.411517  8373 raft_consensus.cc:359] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.414506  8373 raft_consensus.cc:385] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.414773  8373 raft_consensus.cc:740] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.415690  8373 consensus_queue.cc:260] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.417462  8374 ts_tablet_manager.cc:1434] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 12:15:47.418061  8373 ts_tablet_manager.cc:1434] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:15:47.419113  8373 tablet_bootstrap.cc:492] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:47.419410  8374 tablet_bootstrap.cc:492] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:47.423303  8371 tablet_bootstrap.cc:492] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:47.423314  8372 tablet_bootstrap.cc:492] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:47.424106  8371 ts_tablet_manager.cc:1403] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.122s	user 0.022s	sys 0.007s
I20260709 12:15:47.424122  8372 ts_tablet_manager.cc:1403] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.174s	user 0.019s	sys 0.020s
I20260709 12:15:47.428586  8645 raft_consensus.cc:493] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.429148  8645 raft_consensus.cc:515] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:47.431617  8645 leader_election.cc:290] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:47.435784  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f9fa3d1004f2f820b3f26592cbd1a" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:47.436522  8255 raft_consensus.cc:2468] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:47.441898  8372 raft_consensus.cc:359] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:47.442488  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f9fa3d1004f2f820b3f26592cbd1a" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:47.467484  8372 raft_consensus.cc:385] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.467839  8372 raft_consensus.cc:740] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.444093  8374 tablet_bootstrap.cc:654] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.445822  8073 leader_election.cc:304] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
W20260709 12:15:47.468575  8070 leader_election.cc:343] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:47.448171  8145 consensus_peers.cc:597] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:47.454427  8371 raft_consensus.cc:359] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.469785  8371 raft_consensus.cc:385] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.469810  8631 raft_consensus.cc:2804] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:47.470113  8371 raft_consensus.cc:740] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.470425  8631 raft_consensus.cc:493] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.470844  8631 raft_consensus.cc:3060] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.447233  8625 raft_consensus.cc:515] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:47.470871  8371 consensus_queue.cc:260] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.473726  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae828d825348490eb62b74680a762deb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:47.474291  8102 raft_consensus.cc:3060] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.475106  8371 ts_tablet_manager.cc:1434] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:15:47.476188  8371 tablet_bootstrap.cc:492] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:47.460309  8590 consensus_queue.cc:1048] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:47.462729  8665 consensus_queue.cc:1048] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:47.478463  8649 consensus_queue.cc:1048] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:47.456966  8373 tablet_bootstrap.cc:654] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.482975  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae828d825348490eb62b74680a762deb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
W20260709 12:15:47.484844  8222 leader_election.cc:343] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.485265  8625 leader_election.cc:290] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
W20260709 12:15:47.487392  8053 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:47.468617  8372 consensus_queue.cc:260] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:47.493822  8371 tablet_bootstrap.cc:654] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.498208  8372 ts_tablet_manager.cc:1434] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260709 12:15:47.521212  8371 tablet_bootstrap.cc:492] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:47.521965  8371 ts_tablet_manager.cc:1403] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.001s
I20260709 12:15:47.524410  8372 tablet_bootstrap.cc:492] T 642643c6b8a74401860aad4b969f9131 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:47.540906  8371 raft_consensus.cc:359] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.541692  8371 raft_consensus.cc:385] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.541998  8371 raft_consensus.cc:740] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.546095  8371 consensus_queue.cc:260] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.533695  8631 raft_consensus.cc:515] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:47.550382  8631 leader_election.cc:290] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:47.551966  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f9fa3d1004f2f820b3f26592cbd1a" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
W20260709 12:15:47.556545  8070 leader_election.cc:343] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.559974  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f9fa3d1004f2f820b3f26592cbd1a" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:47.560048  8586 raft_consensus.cc:2749] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:47.560781  8255 raft_consensus.cc:3060] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.543774  8664 raft_consensus.cc:493] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.564493  8664 raft_consensus.cc:515] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.566663  8664 leader_election.cc:290] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:47.567780  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546c0cac1bd49e787e00b8c1d8e9eea" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:47.568645  8256 raft_consensus.cc:2393] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b02838a902c44ea49d8d94181285b20e in current term 1: Already voted for candidate 9058059c81534bc4b58c5329d5734dcc in this term.
I20260709 12:15:47.572570  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546c0cac1bd49e787e00b8c1d8e9eea" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:47.574195  8145 leader_election.cc:304] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:47.575444  8647 consensus_queue.cc:1048] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:47.577271  8665 raft_consensus.cc:3060] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.581053  8372 tablet_bootstrap.cc:654] T 642643c6b8a74401860aad4b969f9131 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.584143  8371 ts_tablet_manager.cc:1434] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:15:47.555274  8102 raft_consensus.cc:2468] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:47.586123  8219 leader_election.cc:304] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:47.586532  8255 raft_consensus.cc:2468] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:47.588217  8073 leader_election.cc:304] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:47.590405  8371 tablet_bootstrap.cc:492] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:47.592746  8373 tablet_bootstrap.cc:492] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:47.593282  8373 ts_tablet_manager.cc:1403] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.174s	user 0.015s	sys 0.001s
I20260709 12:15:47.589224  8644 raft_consensus.cc:2804] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.589936  8645 raft_consensus.cc:2804] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.605569  8645 raft_consensus.cc:697] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:47.606228  8371 tablet_bootstrap.cc:654] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.606514  8645 consensus_queue.cc:237] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:47.607874  8644 raft_consensus.cc:697] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:47.614501  8373 raft_consensus.cc:359] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.615295  8373 raft_consensus.cc:385] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.618798  8373 raft_consensus.cc:740] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.619215  8582 raft_consensus.cc:493] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.619480  8373 consensus_queue.cc:260] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.620003  8582 raft_consensus.cc:515] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:47.622362  8373 ts_tablet_manager.cc:1434] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:15:47.624446  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbd2f663574037a43ecf0219ef1c48" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:47.624591  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbd2f663574037a43ecf0219ef1c48" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:47.608750  8644 consensus_queue.cc:237] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:47.622378  8582 leader_election.cc:290] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:47.638867  8631 raft_consensus.cc:493] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.641115  8631 raft_consensus.cc:515] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.644434  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:47.645279  8330 raft_consensus.cc:2468] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:47.646670  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:47.646827  8070 leader_election.cc:304] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:47.648020  8469 raft_consensus.cc:2804] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:47.648190  8373 tablet_bootstrap.cc:492] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:47.648442  8469 raft_consensus.cc:493] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.648818  8469 raft_consensus.cc:3060] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:47.651947  8073 leader_election.cc:343] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.652763  8647 raft_consensus.cc:493] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.653276  8647 raft_consensus.cc:515] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.656855  8293 leader_election.cc:304] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:47.659874  8649 raft_consensus.cc:2749] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:47.662169  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d0c551bc6b4d279dbcf6d09ea8d741" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:47.663239  8374 tablet_bootstrap.cc:492] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:47.663759  8374 ts_tablet_manager.cc:1403] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.245s	user 0.024s	sys 0.009s
I20260709 12:15:47.665159  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d0c551bc6b4d279dbcf6d09ea8d741" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:47.666045  8587 raft_consensus.cc:493] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.666671  8587 raft_consensus.cc:515] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.666013  8181 raft_consensus.cc:2468] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:47.668591  8327 raft_consensus.cc:3060] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.668687  8222 leader_election.cc:304] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:47.670168  8625 raft_consensus.cc:2804] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:47.670558  8625 raft_consensus.cc:493] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.670876  8625 raft_consensus.cc:3060] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.643371  8631 leader_election.cc:290] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
W20260709 12:15:47.672394  8219 consensus_peers.cc:597] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 -> Peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Couldn't send request to peer 9058059c81534bc4b58c5329d5734dcc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:47.674108  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c09223f8a6c4f7fb844bce6937e86f4" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:47.674754  8219 leader_election.cc:343] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.675748  8587 leader_election.cc:290] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:47.678437  8625 raft_consensus.cc:515] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.655309  8647 leader_election.cc:290] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:47.681342  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d0c551bc6b4d279dbcf6d09ea8d741" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:47.681984  8181 raft_consensus.cc:3060] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.681053  8374 raft_consensus.cc:359] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:47.683497  8374 raft_consensus.cc:385] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.684017  8374 raft_consensus.cc:740] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.685515  8374 consensus_queue.cc:260] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:15:47.684276  8718 log.cc:927] Time spent T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Append to log took a long time: real 0.085s	user 0.003s	sys 0.000s
I20260709 12:15:47.685993  8649 consensus_queue.cc:1048] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:47.637955  8665 raft_consensus.cc:2749] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:47.691865  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d0c551bc6b4d279dbcf6d09ea8d741" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:47.692175  8373 tablet_bootstrap.cc:654] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:47.695780  8219 leader_election.cc:343] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.708760  8374 ts_tablet_manager.cc:1434] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:15:47.691905  8625 leader_election.cc:290] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:47.726692  8374 tablet_bootstrap.cc:492] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:47.721108  8469 raft_consensus.cc:515] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.736836  8469 leader_election.cc:290] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
W20260709 12:15:47.728296  8148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:40315, user_credentials={real_user=slave}} blocked reactor thread for 101321us
I20260709 12:15:47.745404  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:47.745726  8371 tablet_bootstrap.cc:492] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:47.746284  8371 ts_tablet_manager.cc:1403] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.156s	user 0.021s	sys 0.026s
I20260709 12:15:47.746049  8005 catalog_manager.cc:5697] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:47.749148  8371 raft_consensus.cc:359] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:47.749773  8371 raft_consensus.cc:385] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.750022  8371 raft_consensus.cc:740] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.750662  8371 consensus_queue.cc:260] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:47.752748  8371 ts_tablet_manager.cc:1434] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:15:47.753774  8371 tablet_bootstrap.cc:492] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:47.753989  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:47.746065  8330 raft_consensus.cc:3060] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.750818  8181 raft_consensus.cc:2468] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:47.760102  8371 tablet_bootstrap.cc:654] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.760371  8222 leader_election.cc:304] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:47.761524  8429 raft_consensus.cc:2804] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.762072  8429 raft_consensus.cc:697] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:47.763059  8330 raft_consensus.cc:2468] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:47.771944  8429 consensus_queue.cc:237] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.780761  8070 leader_election.cc:304] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:47.778191  8004 catalog_manager.cc:5697] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:47.798925  8569 raft_consensus.cc:2804] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.810316  8569 raft_consensus.cc:697] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:47.811544  8569 consensus_queue.cc:237] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:47.827862  8372 tablet_bootstrap.cc:492] T 642643c6b8a74401860aad4b969f9131 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:47.828347  8372 ts_tablet_manager.cc:1403] T 642643c6b8a74401860aad4b969f9131 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.315s	user 0.013s	sys 0.017s
W20260709 12:15:47.799161  8145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:34153, user_credentials={real_user=slave}} blocked reactor thread for 45531us
I20260709 12:15:47.831857  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c09223f8a6c4f7fb844bce6937e86f4" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
W20260709 12:15:47.837244  8073 leader_election.cc:343] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.873494  8373 tablet_bootstrap.cc:492] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:47.873771  8371 tablet_bootstrap.cc:492] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:47.874017  8373 ts_tablet_manager.cc:1403] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.226s	user 0.032s	sys 0.023s
I20260709 12:15:47.874513  8371 ts_tablet_manager.cc:1403] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.121s	user 0.021s	sys 0.022s
I20260709 12:15:47.876906  8373 raft_consensus.cc:359] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:47.877609  8373 raft_consensus.cc:385] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.877882  8373 raft_consensus.cc:740] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.879786  8373 consensus_queue.cc:260] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:47.882009  8373 ts_tablet_manager.cc:1434] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:15:47.883502  8373 tablet_bootstrap.cc:492] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:47.885459  8374 tablet_bootstrap.cc:654] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.886409  8372 raft_consensus.cc:359] T 642643c6b8a74401860aad4b969f9131 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:47.889592  8373 tablet_bootstrap.cc:654] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.892904  8372 raft_consensus.cc:385] T 642643c6b8a74401860aad4b969f9131 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.893244  8372 raft_consensus.cc:740] T 642643c6b8a74401860aad4b969f9131 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.893898  8372 consensus_queue.cc:260] T 642643c6b8a74401860aad4b969f9131 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:47.895830  8372 ts_tablet_manager.cc:1434] T 642643c6b8a74401860aad4b969f9131 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260709 12:15:47.897130  8371 raft_consensus.cc:359] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:47.898101  8371 raft_consensus.cc:385] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.898432  8371 raft_consensus.cc:740] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.900329  8181 raft_consensus.cc:3060] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.912263  8005 catalog_manager.cc:5697] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:47.899456  8371 consensus_queue.cc:260] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:47.932828  8371 ts_tablet_manager.cc:1434] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.058s	user 0.011s	sys 0.000s
I20260709 12:15:47.934309  8371 tablet_bootstrap.cc:492] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:47.950374  8649 consensus_queue.cc:1048] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:47.956817  8372 tablet_bootstrap.cc:492] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:47.970949  8371 tablet_bootstrap.cc:654] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.980422  8148 leader_election.cc:304] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:47.980898  8005 catalog_manager.cc:5697] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:47.987254  8374 tablet_bootstrap.cc:492] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:47.987809  8374 ts_tablet_manager.cc:1403] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.265s	user 0.016s	sys 0.000s
I20260709 12:15:47.995005  8374 raft_consensus.cc:359] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:47.995807  8374 raft_consensus.cc:385] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.996143  8374 raft_consensus.cc:740] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.999174  8374 consensus_queue.cc:260] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:48.001425  8374 ts_tablet_manager.cc:1434] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:15:48.006255  8374 tablet_bootstrap.cc:492] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:48.003782  8371 tablet_bootstrap.cc:492] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:48.007973  8371 ts_tablet_manager.cc:1403] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.005s
I20260709 12:15:48.012305  8371 raft_consensus.cc:359] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:48.013207  8371 raft_consensus.cc:385] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.013614  8371 raft_consensus.cc:740] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.014766  8371 consensus_queue.cc:260] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:48.019055  8371 ts_tablet_manager.cc:1434] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:15:48.023187  8664 raft_consensus.cc:2749] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.024111  8371 tablet_bootstrap.cc:492] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:48.012818  8374 tablet_bootstrap.cc:654] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.033366  8731 raft_consensus.cc:493] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.036449  8372 tablet_bootstrap.cc:654] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.036550  8731 raft_consensus.cc:515] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.039216  8731 leader_election.cc:290] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:48.042817  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df02ba9540747b5a8c99951df903897" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:48.051254  8371 tablet_bootstrap.cc:654] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.051909  8373 tablet_bootstrap.cc:492] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:48.052493  8373 ts_tablet_manager.cc:1403] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.169s	user 0.025s	sys 0.045s
I20260709 12:15:48.053439  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df02ba9540747b5a8c99951df903897" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:48.055903  8373 raft_consensus.cc:359] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:48.056836  8373 raft_consensus.cc:385] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.057165  8373 raft_consensus.cc:740] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.057984  8373 consensus_queue.cc:260] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
W20260709 12:15:48.060181  8070 leader_election.cc:343] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.061501  8373 ts_tablet_manager.cc:1434] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:15:48.062795  8373 tablet_bootstrap.cc:492] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:48.065001  8469 consensus_queue.cc:1048] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:15:48.067032  8073 leader_election.cc:343] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.067355  8102 raft_consensus.cc:3060] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.067693  8073 leader_election.cc:304] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:48.075150  8371 tablet_bootstrap.cc:492] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:48.075711  8371 ts_tablet_manager.cc:1403] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.000s
I20260709 12:15:48.076000  8373 tablet_bootstrap.cc:654] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:48.078549  8070 consensus_peers.cc:597] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 -> Peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Couldn't send request to peer 9058059c81534bc4b58c5329d5734dcc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.080029  8645 raft_consensus.cc:2749] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.082226  8371 raft_consensus.cc:359] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.085232  8429 consensus_queue.cc:1048] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:48.090656  8373 tablet_bootstrap.cc:492] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:48.091187  8373 ts_tablet_manager.cc:1403] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.000s
I20260709 12:15:48.095160  8373 raft_consensus.cc:359] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.095830  8373 raft_consensus.cc:385] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.096089  8373 raft_consensus.cc:740] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.096925  8373 consensus_queue.cc:260] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.100894  8373 ts_tablet_manager.cc:1434] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:15:48.101862  8373 tablet_bootstrap.cc:492] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:48.108876  8373 tablet_bootstrap.cc:654] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.112344  8664 raft_consensus.cc:493] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.113204  8664 raft_consensus.cc:515] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:48.117170  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2eac4b35b3646478eb5d30222e9ec59" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:48.117367  8664 leader_election.cc:290] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:48.117581  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2eac4b35b3646478eb5d30222e9ec59" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:48.118044  8255 raft_consensus.cc:2468] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:48.119879  8148 leader_election.cc:304] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
W20260709 12:15:48.121645  8145 leader_election.cc:343] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.123801  8587 raft_consensus.cc:2804] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.124275  8587 raft_consensus.cc:493] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.124665  8587 raft_consensus.cc:3060] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.124987  8371 raft_consensus.cc:385] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.125385  8371 raft_consensus.cc:740] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.126075  8371 consensus_queue.cc:260] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.127302  8372 tablet_bootstrap.cc:492] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:48.128171  8371 ts_tablet_manager.cc:1434] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:15:48.128264  8731 raft_consensus.cc:493] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.129244  8371 tablet_bootstrap.cc:492] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:48.128870  8731 raft_consensus.cc:515] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:48.132424  8731 leader_election.cc:290] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:48.127890  8372 ts_tablet_manager.cc:1403] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.171s	user 0.022s	sys 0.008s
I20260709 12:15:48.133750  8374 tablet_bootstrap.cc:492] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:48.135326  8374 ts_tablet_manager.cc:1403] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.005s
I20260709 12:15:48.137703  8373 tablet_bootstrap.cc:492] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:48.138204  8373 ts_tablet_manager.cc:1403] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.007s
I20260709 12:15:48.139101  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279bf9ef43054f1e83e60ed4dd074176" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:48.140982  8373 raft_consensus.cc:359] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.141768  8373 raft_consensus.cc:385] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.141611  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279bf9ef43054f1e83e60ed4dd074176" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:48.142174  8373 raft_consensus.cc:740] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.143287  8182 raft_consensus.cc:3060] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:48.143496  8073 leader_election.cc:343] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.142936  8373 consensus_queue.cc:260] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
W20260709 12:15:48.144237  8073 leader_election.cc:343] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.144675  8073 leader_election.cc:304] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:48.145083  8371 tablet_bootstrap.cc:654] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.145881  8373 ts_tablet_manager.cc:1434] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:48.146308  8469 raft_consensus.cc:2749] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.146106  8587 raft_consensus.cc:515] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:48.146984  8373 tablet_bootstrap.cc:492] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:48.158424  8373 tablet_bootstrap.cc:654] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.158429  8647 raft_consensus.cc:493] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.159063  8647 raft_consensus.cc:515] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:48.160319  8374 raft_consensus.cc:359] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.161073  8374 raft_consensus.cc:385] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.161880  8374 raft_consensus.cc:740] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.162535  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3dcd2b92f84d1899b354f41bc21714" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:48.162608  8374 consensus_queue.cc:260] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
W20260709 12:15:48.164099  8222 leader_election.cc:343] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.163219  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3dcd2b92f84d1899b354f41bc21714" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:48.168503  8104 raft_consensus.cc:2468] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:48.161314  8647 leader_election.cc:290] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:48.175170  8372 raft_consensus.cc:359] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.176079  8372 raft_consensus.cc:385] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.176443  8372 raft_consensus.cc:740] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.184546  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2eac4b35b3646478eb5d30222e9ec59" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:48.184852  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2eac4b35b3646478eb5d30222e9ec59" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:48.185460  8373 tablet_bootstrap.cc:492] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:48.185505  8253 raft_consensus.cc:3060] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:48.186092  8145 leader_election.cc:343] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.186106  8373 ts_tablet_manager.cc:1403] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.016s
I20260709 12:15:48.192788  8587 leader_election.cc:290] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:48.189910  8373 raft_consensus.cc:359] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.195619  8373 raft_consensus.cc:385] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.215068  8373 raft_consensus.cc:740] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.215922  8373 consensus_queue.cc:260] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.216938  8372 consensus_queue.cc:260] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.218204  8373 ts_tablet_manager.cc:1434] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.001s
I20260709 12:15:48.197173  8253 raft_consensus.cc:2468] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:48.203866  8725 raft_consensus.cc:493] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.220486  8372 ts_tablet_manager.cc:1434] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.001s
I20260709 12:15:48.204317  8219 leader_election.cc:304] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: b02838a902c44ea49d8d94181285b20e
I20260709 12:15:48.223073  8636 raft_consensus.cc:2804] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.223589  8636 raft_consensus.cc:493] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.223925  8636 raft_consensus.cc:3060] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.223964  8372 tablet_bootstrap.cc:492] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:48.213696  8374 ts_tablet_manager.cc:1434] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 12:15:48.227914  8374 tablet_bootstrap.cc:492] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:48.220662  8373 tablet_bootstrap.cc:492] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:48.220227  8725 raft_consensus.cc:515] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:48.231034  8725 leader_election.cc:290] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:48.206446  8644 consensus_queue.cc:1048] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:48.233007  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae828d825348490eb62b74680a762deb" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:48.233815  8371 tablet_bootstrap.cc:492] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:48.234292  8371 ts_tablet_manager.cc:1403] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.105s	user 0.022s	sys 0.032s
I20260709 12:15:48.236902  8371 raft_consensus.cc:359] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.237562  8371 raft_consensus.cc:385] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.237845  8371 raft_consensus.cc:740] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.237110  8329 raft_consensus.cc:3060] T 642643c6b8a74401860aad4b969f9131 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.244457  8148 leader_election.cc:304] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:48.245308  8374 tablet_bootstrap.cc:654] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.245781  8722 raft_consensus.cc:2804] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.246425  8722 raft_consensus.cc:697] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:48.247386  8722 consensus_queue.cc:237] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:48.250232  8373 tablet_bootstrap.cc:654] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.252579  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae828d825348490eb62b74680a762deb" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:48.253278  8371 consensus_queue.cc:260] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.255363  8371 ts_tablet_manager.cc:1434] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:15:48.256629  8371 tablet_bootstrap.cc:492] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:48.260212  8145 leader_election.cc:304] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:48.261109  8373 tablet_bootstrap.cc:492] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:48.261698  8373 ts_tablet_manager.cc:1403] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.000s
I20260709 12:15:48.263767  8429 raft_consensus.cc:493] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.264263  8429 raft_consensus.cc:515] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:48.264695  8373 raft_consensus.cc:359] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:48.265522  8373 raft_consensus.cc:385] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.265836  8373 raft_consensus.cc:740] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.266601  8429 leader_election.cc:290] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:48.266716  8373 consensus_queue.cc:260] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:48.267838  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64ebcb5be64da88badd16aa178cd4a" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:48.268882  8373 ts_tablet_manager.cc:1434] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
W20260709 12:15:48.269280  8219 leader_election.cc:343] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.270103  8373 tablet_bootstrap.cc:492] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:48.270525  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64ebcb5be64da88badd16aa178cd4a" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:48.272583  8181 raft_consensus.cc:3060] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.273506  8374 tablet_bootstrap.cc:492] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:48.273993  8374 ts_tablet_manager.cc:1403] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 12:15:48.276269  8373 tablet_bootstrap.cc:654] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.276597  8374 raft_consensus.cc:359] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.277310  8374 raft_consensus.cc:385] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.277576  8374 raft_consensus.cc:740] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.282059  8645 consensus_queue.cc:1048] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:15:48.287397  8222 leader_election.cc:343] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.287935  8222 leader_election.cc:304] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:48.290107  8373 tablet_bootstrap.cc:492] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:48.289659  8374 consensus_queue.cc:260] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.290872  8373 ts_tablet_manager.cc:1403] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 12:15:48.291522  8644 raft_consensus.cc:2749] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.294268  8374 ts_tablet_manager.cc:1434] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:15:48.293921  8373 raft_consensus.cc:359] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:48.294721  8373 raft_consensus.cc:385] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.295014  8373 raft_consensus.cc:740] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.295356  8374 tablet_bootstrap.cc:492] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:48.295823  8373 consensus_queue.cc:260] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:48.297674  8373 ts_tablet_manager.cc:1434] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:48.298709  8373 tablet_bootstrap.cc:492] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:48.299633  8371 tablet_bootstrap.cc:654] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.316684  8664 raft_consensus.cc:2749] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:48.320683  8636 raft_consensus.cc:515] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:48.334595  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3dcd2b92f84d1899b354f41bc21714" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:48.335239  8104 raft_consensus.cc:3060] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.338871  8649 raft_consensus.cc:493] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.339413  8649 raft_consensus.cc:515] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.341522  8649 leader_election.cc:290] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:48.342469  8373 tablet_bootstrap.cc:654] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.342662  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df02ba9540747b5a8c99951df903897" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:48.343034  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df02ba9540747b5a8c99951df903897" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:48.343257  8182 raft_consensus.cc:2468] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:48.343659  8102 raft_consensus.cc:2468] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 0.
I20260709 12:15:48.344398  8726 raft_consensus.cc:493] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.344913  8726 raft_consensus.cc:515] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.346001  8296 leader_election.cc:304] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:48.346894  8726 leader_election.cc:290] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:48.347816  8582 raft_consensus.cc:2804] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.348223  8582 raft_consensus.cc:493] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.348593  8582 raft_consensus.cc:3060] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.350965  8731 consensus_queue.cc:1048] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.351800  8569 raft_consensus.cc:493] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.352281  8569 raft_consensus.cc:515] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:48.354384  8569 leader_election.cc:290] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:48.354929  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008c85279d534f24a2dd08e7bbd167cb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:48.357033  8073 leader_election.cc:343] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.360767  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008c85279d534f24a2dd08e7bbd167cb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
W20260709 12:15:48.364370  8073 leader_election.cc:343] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.365028  8073 leader_election.cc:304] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:48.371307  8004 catalog_manager.cc:5697] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.375936  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879b385c0a08435a943ff307ac8fb275" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:48.368430  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879b385c0a08435a943ff307ac8fb275" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:48.367175  8569 raft_consensus.cc:2749] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.463320  8636 leader_election.cc:290] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:48.508044  8645 raft_consensus.cc:493] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.508687  8645 raft_consensus.cc:515] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.509198  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3dcd2b92f84d1899b354f41bc21714" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:48.509802  8182 raft_consensus.cc:3060] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.513947  8429 consensus_queue.cc:1048] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.516074  8374 tablet_bootstrap.cc:700] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718: Time spent opening tablet: real 0.121s	user 0.006s	sys 0.003s
I20260709 12:15:48.516778  8374 tablet_bootstrap.cc:654] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.517750  8582 raft_consensus.cc:515] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.577307  8582 leader_election.cc:290] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:48.520181  8104 raft_consensus.cc:2468] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:48.523115  8182 raft_consensus.cc:2468] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:48.524403  8645 leader_election.cc:290] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:48.525858  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:48.528151  8371 tablet_bootstrap.cc:492] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:48.531333  8373 tablet_bootstrap.cc:492] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:48.590366  8371 ts_tablet_manager.cc:1403] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.334s	user 0.019s	sys 0.006s
I20260709 12:15:48.590456  8373 ts_tablet_manager.cc:1403] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.292s	user 0.017s	sys 0.003s
W20260709 12:15:48.590971  8070 leader_election.cc:343] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.535025  8374 tablet_bootstrap.cc:492] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
W20260709 12:15:48.519958  8219 leader_election.cc:343] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:48.573408  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:42019, user_credentials={real_user=slave}} blocked reactor thread for 59685.7us
I20260709 12:15:48.519665  8372 tablet_bootstrap.cc:700] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc: Time spent opening tablet: real 0.106s	user 0.000s	sys 0.005s
W20260709 12:15:48.609251  8219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:34153, user_credentials={real_user=slave}} blocked reactor thread for 223579us
I20260709 12:15:48.609845  8372 tablet_bootstrap.cc:654] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.614761  8222 leader_election.cc:304] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:48.579609  8731 raft_consensus.cc:493] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:48.589574  8053 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:48.591780  8374 ts_tablet_manager.cc:1403] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.297s	user 0.018s	sys 0.005s
I20260709 12:15:48.578958  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df02ba9540747b5a8c99951df903897" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:48.617244  8731 raft_consensus.cc:515] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.617841  8107 raft_consensus.cc:3060] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.599274  8371 raft_consensus.cc:359] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.605091  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df02ba9540747b5a8c99951df903897" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:48.619053  8371 raft_consensus.cc:385] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.619246  8181 raft_consensus.cc:3060] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.619442  8371 raft_consensus.cc:740] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.620364  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710d05d6f10242a7b13561b37f5eae08" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:48.620702  8371 consensus_queue.cc:260] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.599870  8373 raft_consensus.cc:359] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:48.627933  8373 raft_consensus.cc:385] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.627971  8181 raft_consensus.cc:2468] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:48.628335  8373 raft_consensus.cc:740] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.629053  8373 consensus_queue.cc:260] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:48.630493  8373 ts_tablet_manager.cc:1434] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
W20260709 12:15:48.621657  8070 leader_election.cc:343] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.631405  8373 tablet_bootstrap.cc:492] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:48.633565  8731 leader_election.cc:290] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:48.633724  8296 leader_election.cc:304] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:48.634142  8371 ts_tablet_manager.cc:1434] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:15:48.634559  8590 raft_consensus.cc:2804] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.635043  8590 raft_consensus.cc:697] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:48.626261  8107 raft_consensus.cc:2468] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
W20260709 12:15:48.616166  8219 leader_election.cc:343] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.637092  8219 leader_election.cc:304] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:48.635145  8371 tablet_bootstrap.cc:492] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:48.639686  8664 raft_consensus.cc:493] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.640302  8373 tablet_bootstrap.cc:654] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.644212  8429 raft_consensus.cc:2804] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.644861  8374 raft_consensus.cc:359] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:48.645079  8644 raft_consensus.cc:493] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.645720  8374 raft_consensus.cc:385] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.646019  8374 raft_consensus.cc:740] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.645803  8429 raft_consensus.cc:697] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:48.647408  8374 consensus_queue.cc:260] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:15:48.648002  8145 consensus_peers.cc:597] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e -> Peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Couldn't send request to peer 9058059c81534bc4b58c5329d5734dcc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.646498  8644 raft_consensus.cc:515] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.635941  8590 consensus_queue.cc:237] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.640717  8664 raft_consensus.cc:515] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.650489  8647 raft_consensus.cc:2749] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.648597  8429 consensus_queue.cc:237] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:48.658742  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710d05d6f10242a7b13561b37f5eae08" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:48.663582  8664 leader_election.cc:290] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:48.665606  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d921491df994357a386e8d378ccfd09" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:48.667577  8145 leader_election.cc:343] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.668426  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:48.651232  8644 leader_election.cc:290] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:48.671957  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:48.672583  8102 raft_consensus.cc:2468] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:48.674119  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d921491df994357a386e8d378ccfd09" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:48.674978  8106 raft_consensus.cc:2468] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:48.675836  8665 raft_consensus.cc:493] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:48.675961  8073 leader_election.cc:343] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.676414  8665 raft_consensus.cc:515] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:48.678548  8665 leader_election.cc:290] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:48.676435  8073 leader_election.cc:304] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:48.685683  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64ebcb5be64da88badd16aa178cd4a" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:48.685999  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:48.686408  8255 raft_consensus.cc:2468] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:48.686607  8253 raft_consensus.cc:2468] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
W20260709 12:15:48.689146  8219 consensus_peers.cc:597] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 -> Peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Couldn't send request to peer 9058059c81534bc4b58c5329d5734dcc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.691072  8148 leader_election.cc:304] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:48.691314  8731 raft_consensus.cc:2749] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.692956  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64ebcb5be64da88badd16aa178cd4a" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:48.699183  8219 leader_election.cc:343] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.706354  8371 tablet_bootstrap.cc:654] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.650270  8374 ts_tablet_manager.cc:1434] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:15:48.708448  8374 tablet_bootstrap.cc:492] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
I20260709 12:15:48.711385  8725 raft_consensus.cc:2804] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.711867  8725 raft_consensus.cc:493] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.712242  8725 raft_consensus.cc:3060] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.712661  8219 leader_election.cc:304] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
W20260709 12:15:48.716897  8145 leader_election.cc:343] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.717144  8731 raft_consensus.cc:493] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.717666  8145 leader_election.cc:304] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:48.717625  8731 raft_consensus.cc:515] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.728565  8665 raft_consensus.cc:2804] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.729514  8665 raft_consensus.cc:493] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.730058  8665 raft_consensus.cc:3060] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.731451  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879b385c0a08435a943ff307ac8fb275" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:48.733920  8647 raft_consensus.cc:2804] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.740386  8647 raft_consensus.cc:493] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.740890  8647 raft_consensus.cc:3060] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.741665  8073 leader_election.cc:304] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:48.745237  8645 raft_consensus.cc:2804] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.745651  8645 raft_consensus.cc:493] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.745999  8645 raft_consensus.cc:3060] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.753509  8645 raft_consensus.cc:515] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.754662  8725 raft_consensus.cc:515] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:48.756695  8725 leader_election.cc:290] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:48.739614  8731 leader_election.cc:290] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:48.762926  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64ebcb5be64da88badd16aa178cd4a" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:48.763486  8005 catalog_manager.cc:5697] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 1 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.768950  8001 catalog_manager.cc:5697] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:48.781340  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879b385c0a08435a943ff307ac8fb275" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:48.786952  8256 raft_consensus.cc:2468] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 0.
I20260709 12:15:48.783515  8254 raft_consensus.cc:3060] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.792429  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:48.793578  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64ebcb5be64da88badd16aa178cd4a" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
W20260709 12:15:48.795288  8070 leader_election.cc:343] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:48.797976  8145 leader_election.cc:343] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.803066  8725 consensus_queue.cc:1048] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:48.813072  8070 leader_election.cc:343] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.828239  8645 leader_election.cc:290] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:48.829610  8254 raft_consensus.cc:2468] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:48.830796  8148 leader_election.cc:304] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:48.831928  8725 raft_consensus.cc:2804] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.832763  8725 raft_consensus.cc:697] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:48.835839  8374 tablet_bootstrap.cc:654] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:48.839668  8219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:34153, user_credentials={real_user=slave}} blocked reactor thread for 62279.6us
I20260709 12:15:48.865993  8647 raft_consensus.cc:515] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.868880  8647 leader_election.cc:290] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:48.833631  8725 consensus_queue.cc:237] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:48.886549  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:48.890254  8372 tablet_bootstrap.cc:492] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:48.890901  8372 ts_tablet_manager.cc:1403] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.668s	user 0.010s	sys 0.021s
I20260709 12:15:48.896744  8372 raft_consensus.cc:359] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:48.897713  8372 raft_consensus.cc:385] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.898065  8372 raft_consensus.cc:740] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
W20260709 12:15:48.900815  8219 leader_election.cc:343] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.912194  8373 tablet_bootstrap.cc:492] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:48.912842  8373 ts_tablet_manager.cc:1403] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.282s	user 0.070s	sys 0.084s
I20260709 12:15:48.899155  8372 consensus_queue.cc:260] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
W20260709 12:15:48.914633  8073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:40315, user_credentials={real_user=slave}} blocked reactor thread for 135027us
I20260709 12:15:48.922397  8372 ts_tablet_manager.cc:1434] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:15:48.934904  8073 leader_election.cc:304] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:48.915598  8665 raft_consensus.cc:515] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.940310  8372 tablet_bootstrap.cc:492] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:48.937551  8731 raft_consensus.cc:2804] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.949069  8731 raft_consensus.cc:493] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.953553  8373 raft_consensus.cc:359] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.954136  8731 raft_consensus.cc:3060] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.954319  8373 raft_consensus.cc:385] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.954667  8373 raft_consensus.cc:740] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.955403  8373 consensus_queue.cc:260] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:48.966812  8372 tablet_bootstrap.cc:654] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.975172  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:48.976171  8256 raft_consensus.cc:2393] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in current term 1: Already voted for candidate 66af1447f2c64ebda5448a760d5d7718 in this term.
I20260709 12:15:48.983948  8373 ts_tablet_manager.cc:1434] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.004s
I20260709 12:15:48.985469  8073 leader_election.cc:304] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:48.986405  8469 raft_consensus.cc:2749] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.987810  8371 tablet_bootstrap.cc:492] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:48.988409  8371 ts_tablet_manager.cc:1403] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.353s	user 0.017s	sys 0.007s
I20260709 12:15:48.991891  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:48.992719  8106 raft_consensus.cc:2393] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 66af1447f2c64ebda5448a760d5d7718 in current term 1: Already voted for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in this term.
I20260709 12:15:48.993001  8371 raft_consensus.cc:359] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.993712  8665 leader_election.cc:290] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:48.993736  8371 raft_consensus.cc:385] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.994395  8371 raft_consensus.cc:740] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.995210  8371 consensus_queue.cc:260] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:48.998107  8371 ts_tablet_manager.cc:1434] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:15:48.999148  8371 tablet_bootstrap.cc:492] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:49.001081  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d921491df994357a386e8d378ccfd09" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:49.001816  8106 raft_consensus.cc:3060] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.004884  8219 leader_election.cc:304] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:49.005179  8371 tablet_bootstrap.cc:654] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.007958  8636 raft_consensus.cc:2749] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:49.000665  8731 raft_consensus.cc:515] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.006132  8374 tablet_bootstrap.cc:492] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:49.020053  8374 ts_tablet_manager.cc:1403] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.312s	user 0.015s	sys 0.022s
I20260709 12:15:49.022372  8371 tablet_bootstrap.cc:492] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: No bootstrap required, opened a new log
I20260709 12:15:49.024278  8371 ts_tablet_manager.cc:1403] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 12:15:49.024061  8374 raft_consensus.cc:359] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.024911  8374 raft_consensus.cc:385] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.024955  8644 raft_consensus.cc:493] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.027127  8644 raft_consensus.cc:515] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:49.028224  8731 leader_election.cc:290] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:49.029235  8644 leader_election.cc:290] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:49.001148  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d921491df994357a386e8d378ccfd09" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:49.026209  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879b385c0a08435a943ff307ac8fb275" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:49.030658  8254 raft_consensus.cc:3060] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:49.030814  8145 leader_election.cc:343] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.030972  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008c85279d534f24a2dd08e7bbd167cb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:49.032052  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879b385c0a08435a943ff307ac8fb275" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:49.032364  8107 raft_consensus.cc:2468] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:49.026924  8374 raft_consensus.cc:740] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.036664  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008c85279d534f24a2dd08e7bbd167cb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:49.035226  8374 consensus_queue.cc:260] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.037120  8219 leader_election.cc:304] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:49.037317  8177 raft_consensus.cc:2468] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:49.038211  8644 raft_consensus.cc:2804] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:49.038616  8644 raft_consensus.cc:493] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.038954  8644 raft_consensus.cc:3060] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.041107  8373 tablet_bootstrap.cc:492] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:49.041929  8590 consensus_queue.cc:1048] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:49.041109  8371 raft_consensus.cc:359] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.048555  8371 raft_consensus.cc:385] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:49.048666  8070 leader_election.cc:343] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.048977  8371 raft_consensus.cc:740] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.049901  8371 consensus_queue.cc:260] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.052090  8371 ts_tablet_manager.cc:1434] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.002s
I20260709 12:15:49.047765  8254 raft_consensus.cc:2468] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:49.064226  8645 raft_consensus.cc:493] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.054414  8001 catalog_manager.cc:5697] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.065343  8374 ts_tablet_manager.cc:1434] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:15:49.066843  8373 tablet_bootstrap.cc:654] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.067394  8073 leader_election.cc:304] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:49.064219  8644 raft_consensus.cc:515] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:49.071022  8644 leader_election.cc:290] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:49.071698  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008c85279d534f24a2dd08e7bbd167cb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:49.072322  8107 raft_consensus.cc:3060] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.075623  8645 raft_consensus.cc:515] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.076341  8590 consensus_queue.cc:1048] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:49.077700  8645 leader_election.cc:290] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:49.078945  8731 raft_consensus.cc:2804] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.079687  8731 raft_consensus.cc:697] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:49.080701  8731 consensus_queue.cc:237] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.048204  8106 raft_consensus.cc:2468] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:49.085129  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:49.086467  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:49.087793  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008c85279d534f24a2dd08e7bbd167cb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:49.088496  8178 raft_consensus.cc:3060] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.087126  8145 leader_election.cc:304] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
W20260709 12:15:49.094389  8073 leader_election.cc:343] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.097327  8725 raft_consensus.cc:2804] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.098109  8725 raft_consensus.cc:697] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:49.098937  8725 consensus_queue.cc:237] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.102959  8374 tablet_bootstrap.cc:492] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
W20260709 12:15:49.117208  8070 leader_election.cc:343] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.117873  8070 leader_election.cc:304] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:49.118501  8107 raft_consensus.cc:2468] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:49.146807  8372 tablet_bootstrap.cc:492] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:49.147403  8372 ts_tablet_manager.cc:1403] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.219s	user 0.011s	sys 0.010s
I20260709 12:15:49.154808  8219 leader_election.cc:304] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:49.162261  8372 raft_consensus.cc:359] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.163304  8372 raft_consensus.cc:385] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.163681  8372 raft_consensus.cc:740] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.164671  8372 consensus_queue.cc:260] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.158749  8726 raft_consensus.cc:2804] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.183055  8372 ts_tablet_manager.cc:1434] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.003s
I20260709 12:15:49.184556  8372 tablet_bootstrap.cc:492] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:49.190807  8726 raft_consensus.cc:697] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:49.191951  8328 raft_consensus.cc:3060] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.202121  8726 consensus_queue.cc:237] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:49.212574  8374 tablet_bootstrap.cc:654] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.213502  8372 tablet_bootstrap.cc:654] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.156625  8731 raft_consensus.cc:2749] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:49.219364  8178 raft_consensus.cc:2468] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:49.230612  8005 catalog_manager.cc:5697] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:49.237955  8645 raft_consensus.cc:493] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.251689  8645 raft_consensus.cc:515] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.254989  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76a73968afd4c25951776edaf3da243" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:49.256860  8373 tablet_bootstrap.cc:492] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:49.257411  8373 ts_tablet_manager.cc:1403] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.217s	user 0.047s	sys 0.051s
I20260709 12:15:49.258502  8374 tablet_bootstrap.cc:492] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:49.259068  8374 ts_tablet_manager.cc:1403] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.001s
W20260709 12:15:49.260442  8073 leader_election.cc:343] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.260254  8373 raft_consensus.cc:359] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.261072  8373 raft_consensus.cc:385] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.261365  8373 raft_consensus.cc:740] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.262116  8373 consensus_queue.cc:260] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.264479  8373 ts_tablet_manager.cc:1434] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:15:49.265584  8373 tablet_bootstrap.cc:492] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:49.271028  8644 raft_consensus.cc:493] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.271756  8644 raft_consensus.cc:515] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.272217  8645 leader_election.cc:290] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:49.274520  8644 leader_election.cc:290] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:49.281754  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2041e92a156540d1854b8b4cccdb3ee8" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:49.277307  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2041e92a156540d1854b8b4cccdb3ee8" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:49.278110  8373 tablet_bootstrap.cc:654] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.279106  8374 raft_consensus.cc:359] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:49.283305  8178 raft_consensus.cc:2468] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:49.284771  8222 leader_election.cc:304] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:49.285588  8644 raft_consensus.cc:2804] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:49.285919  8219 leader_election.cc:343] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.285959  8644 raft_consensus.cc:493] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.286674  8644 raft_consensus.cc:3060] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.288295  8429 consensus_queue.cc:1048] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:49.294462  8003 catalog_manager.cc:5697] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:49.283541  8374 raft_consensus.cc:385] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.300339  8726 consensus_queue.cc:1048] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:49.305064  8374 raft_consensus.cc:740] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.312593  8374 consensus_queue.cc:260] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:15:49.322275  8145 consensus_peers.cc:597] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e -> Peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Couldn't send request to peer 9058059c81534bc4b58c5329d5734dcc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:49.322880  8374 ts_tablet_manager.cc:1434] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.000s
I20260709 12:15:49.324169  8374 tablet_bootstrap.cc:492] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718: Bootstrap starting.
W20260709 12:15:49.335561  8070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:44023, user_credentials={real_user=slave}} blocked reactor thread for 51256.5us
I20260709 12:15:49.340221  8372 tablet_bootstrap.cc:492] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:49.340744  8372 ts_tablet_manager.cc:1403] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.156s	user 0.030s	sys 0.013s
I20260709 12:15:49.340981  8374 tablet_bootstrap.cc:654] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.343565  8372 raft_consensus.cc:359] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.344333  8372 raft_consensus.cc:385] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.344637  8372 raft_consensus.cc:740] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.344856  8665 raft_consensus.cc:493] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.345541  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76a73968afd4c25951776edaf3da243" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:49.345449  8665 raft_consensus.cc:515] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.346869  8372 consensus_queue.cc:260] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.349182  8582 raft_consensus.cc:493] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b02838a902c44ea49d8d94181285b20e)
I20260709 12:15:49.349707  8582 raft_consensus.cc:515] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.348924  8665 leader_election.cc:290] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:49.351919  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710d05d6f10242a7b13561b37f5eae08" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:49.358268  8582 leader_election.cc:290] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
W20260709 12:15:49.359158  8145 leader_election.cc:343] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.284814  8001 catalog_manager.cc:5697] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:49.363250  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2eac4b35b3646478eb5d30222e9ec59" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:49.366756  8372 ts_tablet_manager.cc:1434] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:15:49.366518  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2eac4b35b3646478eb5d30222e9ec59" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:49.382144  8296 leader_election.cc:304] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:49.385653  8649 raft_consensus.cc:2749] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:49.374507  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710d05d6f10242a7b13561b37f5eae08" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:49.374735  8372 tablet_bootstrap.cc:492] T 8d921491df994357a386e8d378ccfd09 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:49.410437  8107 raft_consensus.cc:2468] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:49.411680  8145 leader_election.cc:304] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:49.412472  8665 raft_consensus.cc:2804] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:49.412875  8665 raft_consensus.cc:493] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.413216  8665 raft_consensus.cc:3060] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.419044  8644 raft_consensus.cc:515] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.424683  8587 consensus_queue.cc:1048] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:49.430812  8372 tablet_bootstrap.cc:654] T 8d921491df994357a386e8d378ccfd09 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.430011  8665 raft_consensus.cc:515] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.434532  8649 raft_consensus.cc:493] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.434865  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2041e92a156540d1854b8b4cccdb3ee8" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:49.435559  8180 raft_consensus.cc:3060] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.435170  8649 raft_consensus.cc:515] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.444900  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d0c551bc6b4d279dbcf6d09ea8d741" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:49.445122  8070 leader_election.cc:343] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.445763  8070 leader_election.cc:304] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:49.448416  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2041e92a156540d1854b8b4cccdb3ee8" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:49.446826  8644 leader_election.cc:290] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
W20260709 12:15:49.456429  8219 leader_election.cc:343] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.456468  8180 raft_consensus.cc:2468] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:49.459656  8222 leader_election.cc:304] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:49.461172  8726 raft_consensus.cc:2804] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.462339  8726 raft_consensus.cc:697] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:49.463409  8726 consensus_queue.cc:237] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.471652  8372 tablet_bootstrap.cc:492] T 8d921491df994357a386e8d378ccfd09 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:49.472317  8372 ts_tablet_manager.cc:1403] T 8d921491df994357a386e8d378ccfd09 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.001s
I20260709 12:15:49.475323  8372 raft_consensus.cc:359] T 8d921491df994357a386e8d378ccfd09 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.479640  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710d05d6f10242a7b13561b37f5eae08" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:49.480641  8645 raft_consensus.cc:2749] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:49.482767  8145 leader_election.cc:343] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.483830  8372 raft_consensus.cc:385] T 8d921491df994357a386e8d378ccfd09 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.485267  8372 raft_consensus.cc:740] T 8d921491df994357a386e8d378ccfd09 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.487201  8372 consensus_queue.cc:260] T 8d921491df994357a386e8d378ccfd09 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.493741  8372 ts_tablet_manager.cc:1434] T 8d921491df994357a386e8d378ccfd09 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:15:49.497953  8372 tablet_bootstrap.cc:492] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:49.518710  8372 tablet_bootstrap.cc:654] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.502358  8374 tablet_bootstrap.cc:492] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718: No bootstrap required, opened a new log
I20260709 12:15:49.519083  8645 consensus_queue.cc:1048] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:49.509630  8328 raft_consensus.cc:3060] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.519824  8374 ts_tablet_manager.cc:1403] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718: Time spent bootstrapping tablet: real 0.196s	user 0.019s	sys 0.036s
I20260709 12:15:49.524124  8665 leader_election.cc:290] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
W20260709 12:15:49.525009  8793 log.cc:927] Time spent T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:15:49.528143  8649 leader_election.cc:290] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:49.531262  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710d05d6f10242a7b13561b37f5eae08" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:49.531809  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d0c551bc6b4d279dbcf6d09ea8d741" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:49.546876  8296 leader_election.cc:304] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
W20260709 12:15:49.548079  8070 consensus_peers.cc:597] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 -> Peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Couldn't send request to peer 9058059c81534bc4b58c5329d5734dcc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:49.549470  8106 raft_consensus.cc:3060] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.550160  8003 catalog_manager.cc:5697] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.531908  8649 raft_consensus.cc:493] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.539911  8329 raft_consensus.cc:3060] T 8d921491df994357a386e8d378ccfd09 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.541786  8372 tablet_bootstrap.cc:492] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:49.563349  8372 ts_tablet_manager.cc:1403] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.004s
I20260709 12:15:49.531302  8374 raft_consensus.cc:359] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.563997  8374 raft_consensus.cc:385] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.564333  8374 raft_consensus.cc:740] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.564997  8374 consensus_queue.cc:260] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.566206  8372 raft_consensus.cc:359] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.566847  8374 ts_tablet_manager.cc:1434] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.002s
I20260709 12:15:49.566939  8372 raft_consensus.cc:385] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.567790  8372 raft_consensus.cc:740] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.568529  8372 consensus_queue.cc:260] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.568423  8649 raft_consensus.cc:515] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.569693  8327 raft_consensus.cc:3060] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.570763  8372 ts_tablet_manager.cc:1434] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:15:49.572556  8665 consensus_queue.cc:1048] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:49.571882  8372 tablet_bootstrap.cc:492] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:49.583602  8582 raft_consensus.cc:2749] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:49.586246  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f9fa3d1004f2f820b3f26592cbd1a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:49.589556  8649 leader_election.cc:290] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:49.590709  8372 tablet_bootstrap.cc:654] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.592092  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f9fa3d1004f2f820b3f26592cbd1a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:49.592749  8106 raft_consensus.cc:2468] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:49.592388  8373 tablet_bootstrap.cc:492] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:49.593559  8373 ts_tablet_manager.cc:1403] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.328s	user 0.023s	sys 0.050s
I20260709 12:15:49.597755  8296 leader_election.cc:304] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:49.600095  8373 raft_consensus.cc:359] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:49.600807  8373 raft_consensus.cc:385] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.601059  8373 raft_consensus.cc:740] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.601751  8373 consensus_queue.cc:260] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:49.602474  8145 leader_election.cc:304] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:49.605229  8665 raft_consensus.cc:2804] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.606130  8725 consensus_queue.cc:1048] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:49.611650  8665 raft_consensus.cc:697] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:49.614224  8665 consensus_queue.cc:237] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.629691  8587 raft_consensus.cc:493] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.630239  8587 raft_consensus.cc:515] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:49.632356  8587 leader_election.cc:290] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:49.633802  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279bf9ef43054f1e83e60ed4dd074176" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:49.634537  8254 raft_consensus.cc:2468] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:49.635874  8148 leader_election.cc:304] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:49.636684  8587 raft_consensus.cc:2804] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:49.636883  8372 tablet_bootstrap.cc:492] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:49.637094  8587 raft_consensus.cc:493] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.637702  8372 ts_tablet_manager.cc:1403] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.010s
I20260709 12:15:49.610037  8590 raft_consensus.cc:2749] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:49.637866  8587 raft_consensus.cc:3060] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.610039  8373 ts_tablet_manager.cc:1434] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:15:49.645048  8373 tablet_bootstrap.cc:492] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e: Bootstrap starting.
I20260709 12:15:49.646356  8587 raft_consensus.cc:515] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:49.648063  8372 raft_consensus.cc:359] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.656165  8372 raft_consensus.cc:385] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.656487  8372 raft_consensus.cc:740] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.657205  8372 consensus_queue.cc:260] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.659107  8372 ts_tablet_manager.cc:1434] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:15:49.660144  8372 tablet_bootstrap.cc:492] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:49.662603  8429 raft_consensus.cc:493] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.663091  8429 raft_consensus.cc:515] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.663616  8726 consensus_queue.cc:1048] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:49.664870  8429 leader_election.cc:290] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:49.666145  8372 tablet_bootstrap.cc:654] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.665935  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76a73968afd4c25951776edaf3da243" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:49.668720  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279bf9ef43054f1e83e60ed4dd074176" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:49.669526  8105 raft_consensus.cc:2468] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:49.668820  8587 leader_election.cc:290] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:49.668292  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279bf9ef43054f1e83e60ed4dd074176" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:49.670782  8253 raft_consensus.cc:3060] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.671209  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279bf9ef43054f1e83e60ed4dd074176" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:49.671547  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76a73968afd4c25951776edaf3da243" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:49.672477  8102 raft_consensus.cc:2468] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 0.
I20260709 12:15:49.671908  8103 raft_consensus.cc:3060] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.709841  8103 raft_consensus.cc:2468] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:49.703416  8219 leader_election.cc:304] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
W20260709 12:15:49.724099  8219 leader_election.cc:343] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.724179  8429 raft_consensus.cc:2804] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:49.724759  8429 raft_consensus.cc:493] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.725131  8429 raft_consensus.cc:3060] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.711351  8253 raft_consensus.cc:2468] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:49.728492  8148 leader_election.cc:304] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:49.729374  8725 raft_consensus.cc:2804] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.729856  8725 raft_consensus.cc:697] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:49.730860  8372 tablet_bootstrap.cc:492] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:49.730683  8725 consensus_queue.cc:237] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:49.731402  8372 ts_tablet_manager.cc:1403] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.071s	user 0.007s	sys 0.016s
I20260709 12:15:49.734256  8372 raft_consensus.cc:359] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.736954  8372 raft_consensus.cc:385] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.737253  8372 raft_consensus.cc:740] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.738992  8372 consensus_queue.cc:260] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.741233  8372 ts_tablet_manager.cc:1434] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:15:49.742250  8372 tablet_bootstrap.cc:492] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:49.755802  8372 tablet_bootstrap.cc:654] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.757572  8644 consensus_queue.cc:1048] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:49.766680  8373 tablet_bootstrap.cc:654] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.767146  8372 tablet_bootstrap.cc:492] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:49.773223  8649 raft_consensus.cc:493] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.786769  8372 ts_tablet_manager.cc:1403] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.001s
I20260709 12:15:49.786775  8649 raft_consensus.cc:515] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.789340  8649 leader_election.cc:290] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:49.789944  8372 raft_consensus.cc:359] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.790647  8372 raft_consensus.cc:385] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.790917  8372 raft_consensus.cc:740] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.790851  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64ebcb5be64da88badd16aa178cd4a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:49.791870  8372 consensus_queue.cc:260] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.794559  8372 ts_tablet_manager.cc:1434] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:49.795919  8372 tablet_bootstrap.cc:492] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:49.785661  8429 raft_consensus.cc:515] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.804972  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76a73968afd4c25951776edaf3da243" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
W20260709 12:15:49.806407  8219 leader_election.cc:343] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.804158  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64ebcb5be64da88badd16aa178cd4a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:49.815517  8296 leader_election.cc:304] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:49.816336  8649 raft_consensus.cc:2749] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:49.822573  8329 raft_consensus.cc:3060] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.811465  8372 tablet_bootstrap.cc:654] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.837558  8373 tablet_bootstrap.cc:492] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e: No bootstrap required, opened a new log
I20260709 12:15:49.838084  8373 ts_tablet_manager.cc:1403] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e: Time spent bootstrapping tablet: real 0.193s	user 0.008s	sys 0.002s
I20260709 12:15:49.842552  8373 raft_consensus.cc:359] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.843204  8373 raft_consensus.cc:385] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.843477  8373 raft_consensus.cc:740] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.845265  8373 consensus_queue.cc:260] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.847323  8373 ts_tablet_manager.cc:1434] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:15:49.849156  8001 catalog_manager.cc:5697] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:49.852321  8372 tablet_bootstrap.cc:492] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:49.852833  8372 ts_tablet_manager.cc:1403] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.001s
I20260709 12:15:49.862249  8372 raft_consensus.cc:359] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.862952  8372 raft_consensus.cc:385] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.863276  8372 raft_consensus.cc:740] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.863929  8372 consensus_queue.cc:260] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.865904  8372 ts_tablet_manager.cc:1434] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:15:49.813517  8429 leader_election.cc:290] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:49.813707  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76a73968afd4c25951776edaf3da243" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:49.866703  8102 raft_consensus.cc:3060] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.866869  8372 tablet_bootstrap.cc:492] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:49.873466  8372 tablet_bootstrap.cc:654] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.873571  8102 raft_consensus.cc:2468] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:49.874754  8219 leader_election.cc:304] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:49.875852  8429 raft_consensus.cc:2804] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.876247  8582 raft_consensus.cc:493] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.876775  8582 raft_consensus.cc:515] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:49.879413  8429 raft_consensus.cc:697] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:49.880401  8429 consensus_queue.cc:237] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.897997  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710d05d6f10242a7b13561b37f5eae08" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:49.898277  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710d05d6f10242a7b13561b37f5eae08" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:49.892125  8582 leader_election.cc:290] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:49.900128  8103 raft_consensus.cc:2393] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9058059c81534bc4b58c5329d5734dcc in current term 1: Already voted for candidate b02838a902c44ea49d8d94181285b20e in this term.
I20260709 12:15:49.904876  8296 leader_election.cc:304] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:49.906848  8004 catalog_manager.cc:5697] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.915611  8649 raft_consensus.cc:3060] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.924778  8327 raft_consensus.cc:3060] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.934033  8372 tablet_bootstrap.cc:492] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:49.934587  8372 ts_tablet_manager.cc:1403] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.010s
W20260709 12:15:49.935659  8053 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:49.937762  8372 raft_consensus.cc:359] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.938158  8590 raft_consensus.cc:493] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.938491  8372 raft_consensus.cc:385] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.938829  8372 raft_consensus.cc:740] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.939661  8372 consensus_queue.cc:260] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:49.940173  8649 raft_consensus.cc:2749] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:49.942515  8372 ts_tablet_manager.cc:1434] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:49.944300  8004 catalog_manager.cc:5697] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.938757  8590 raft_consensus.cc:515] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:49.948565  8429 consensus_queue.cc:1048] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:49.948778  8590 leader_election.cc:290] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:49.946095  8372 tablet_bootstrap.cc:492] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc: Bootstrap starting.
I20260709 12:15:49.950737  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2041e92a156540d1854b8b4cccdb3ee8" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:49.953754  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2041e92a156540d1854b8b4cccdb3ee8" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:49.954631  8180 raft_consensus.cc:2393] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9058059c81534bc4b58c5329d5734dcc in current term 1: Already voted for candidate 66af1447f2c64ebda5448a760d5d7718 in this term.
I20260709 12:15:49.956200  8296 leader_election.cc:304] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:49.961366  8372 tablet_bootstrap.cc:654] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.969151  8582 raft_consensus.cc:3060] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.986939  8582 raft_consensus.cc:2749] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:49.997771  8429 consensus_queue.cc:1048] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.002610  8372 tablet_bootstrap.cc:492] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc: No bootstrap required, opened a new log
I20260709 12:15:50.003196  8372 ts_tablet_manager.cc:1403] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc: Time spent bootstrapping tablet: real 0.057s	user 0.024s	sys 0.012s
I20260709 12:15:50.005936  8372 raft_consensus.cc:359] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:50.006685  8372 raft_consensus.cc:385] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.006966  8372 raft_consensus.cc:740] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.007647  8372 consensus_queue.cc:260] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:50.009950  8372 ts_tablet_manager.cc:1434] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:50.028846  8664 consensus_queue.cc:1048] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.037312  8582 raft_consensus.cc:493] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.037835  8582 raft_consensus.cc:515] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:50.039991  8582 leader_election.cc:290] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:50.040717  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:50.041571  8253 raft_consensus.cc:2393] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9058059c81534bc4b58c5329d5734dcc in current term 1: Already voted for candidate 66af1447f2c64ebda5448a760d5d7718 in this term.
I20260709 12:15:50.041376  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:50.042600  8102 raft_consensus.cc:2393] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9058059c81534bc4b58c5329d5734dcc in current term 1: Already voted for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in this term.
I20260709 12:15:50.044670  8293 leader_election.cc:304] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:50.067893  8582 raft_consensus.cc:3060] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.069715  8665 raft_consensus.cc:493] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.070406  8665 raft_consensus.cc:515] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:50.074926  8665 leader_election.cc:290] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:50.076439  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:50.079587  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:50.080343  8102 raft_consensus.cc:2468] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:50.080214  8665 consensus_queue.cc:1048] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:50.090127  8328 raft_consensus.cc:2468] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 0.
I20260709 12:15:50.091943  8145 leader_election.cc:304] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:50.083756  8582 raft_consensus.cc:2749] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:50.107539  8664 raft_consensus.cc:2804] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:50.108034  8664 raft_consensus.cc:493] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.108376  8664 raft_consensus.cc:3060] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.123015  8664 raft_consensus.cc:515] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:50.125176  8664 leader_election.cc:290] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:50.126034  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:50.126638  8327 raft_consensus.cc:3060] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.133867  8327 raft_consensus.cc:2468] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:50.136477  8145 leader_election.cc:304] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:50.136929  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
I20260709 12:15:50.137538  8102 raft_consensus.cc:3060] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.138376  8664 raft_consensus.cc:2804] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:50.139295  8725 consensus_queue.cc:1048] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.139672  8664 raft_consensus.cc:697] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:50.140619  8664 consensus_queue.cc:237] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:50.157264  8102 raft_consensus.cc:2468] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:50.175633  8590 raft_consensus.cc:493] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.176337  8722 consensus_queue.cc:1048] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.176216  8590 raft_consensus.cc:515] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:50.180768  8590 leader_election.cc:290] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:50.182600  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76a73968afd4c25951776edaf3da243" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:15:50.183310  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76a73968afd4c25951776edaf3da243" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:50.183374  8102 raft_consensus.cc:2393] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9058059c81534bc4b58c5329d5734dcc in current term 1: Already voted for candidate 66af1447f2c64ebda5448a760d5d7718 in this term.
I20260709 12:15:50.185325  8296 leader_election.cc:304] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:50.186357  8590 raft_consensus.cc:3060] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.192716  8590 raft_consensus.cc:2749] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:50.194676  8004 catalog_manager.cc:5697] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 0 to 1, leader changed from <none> to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 1 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:50.319590  8429 consensus_queue.cc:1048] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.338438  8429 consensus_queue.cc:1048] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.627977  8725 consensus_queue.cc:1048] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.642953  8665 consensus_queue.cc:1048] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.691957  8645 raft_consensus.cc:493] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.692487  8645 raft_consensus.cc:515] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:50.694510  8645 leader_election.cc:290] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:50.696348  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:50.697183  8327 raft_consensus.cc:2468] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:50.698669  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:50.699334  8253 raft_consensus.cc:2468] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 1.
I20260709 12:15:50.699554  8070 leader_election.cc:304] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:50.702325  8469 raft_consensus.cc:2804] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:50.702724  8469 raft_consensus.cc:493] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.703234  8469 raft_consensus.cc:3060] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.711891  8469 raft_consensus.cc:515] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:50.713985  8469 leader_election.cc:290] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:50.714572  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:50.714929  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:50.715128  8253 raft_consensus.cc:3060] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.715565  8327 raft_consensus.cc:3060] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.719826  8253 raft_consensus.cc:2468] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:15:50.720409  8327 raft_consensus.cc:2468] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:15:50.721428  8073 leader_election.cc:304] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:15:50.722479  8469 raft_consensus.cc:2804] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:50.723524  8469 raft_consensus.cc:697] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:15:50.724288  8469 consensus_queue.cc:237] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:50.734055  8001 catalog_manager.cc:5697] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 0 to 2, leader changed from <none> to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:51.130527  8327 raft_consensus.cc:1275] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:51.132292  8469 consensus_queue.cc:1048] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:51.161707  8253 raft_consensus.cc:1275] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:51.163513  8469 consensus_queue.cc:1048] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:51.169559  2017 tablet_server.cc:179] TabletServer@127.1.248.65:0 shutting down...
W20260709 12:15:51.183701  8219 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:15:51.196184  8293 consensus_peers.cc:597] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:51.199872  8145 consensus_peers.cc:597] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:51.205288  8145 consensus_peers.cc:597] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:51.208004  8219 consensus_peers.cc:597] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:51.209568  8145 consensus_peers.cc:597] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:51.210017  8219 consensus_peers.cc:597] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.227653  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:51.233424  2017 tablet_replica.cc:333] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.235388  2017 raft_consensus.cc:2243] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.235975  2017 raft_consensus.cc:2272] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.239970  2017 tablet_replica.cc:333] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.240805  2017 raft_consensus.cc:2243] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.241590  2017 raft_consensus.cc:2272] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.243485  2017 tablet_replica.cc:333] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.244091  2017 raft_consensus.cc:2243] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.244508  2017 raft_consensus.cc:2272] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:51.245253  8145 consensus_peers.cc:597] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.246774  2017 tablet_replica.cc:333] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.248574  2017 raft_consensus.cc:2243] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.249527  2017 raft_consensus.cc:2272] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:51.249818  8219 consensus_peers.cc:597] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.251839  2017 tablet_replica.cc:333] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.252504  2017 raft_consensus.cc:2243] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.252857  2017 raft_consensus.cc:2272] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.254541  2017 tablet_replica.cc:333] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.255089  2017 raft_consensus.cc:2243] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.255851  2017 raft_consensus.cc:2272] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.258085  2017 tablet_replica.cc:333] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.258860  2017 raft_consensus.cc:2243] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.259955  2017 raft_consensus.cc:2272] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.262404  2017 tablet_replica.cc:333] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.263712  2017 raft_consensus.cc:2243] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:51.263923  8293 consensus_peers.cc:597] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.264219  2017 raft_consensus.cc:2272] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.266824  2017 tablet_replica.cc:333] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.267704  2017 raft_consensus.cc:2243] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:51.267879  8145 consensus_peers.cc:597] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.268210  2017 raft_consensus.cc:2272] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.270584  2017 tablet_replica.cc:333] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.271395  2017 raft_consensus.cc:2243] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:15:51.271335  8145 consensus_peers.cc:597] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.272559  2017 raft_consensus.cc:2272] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.274528  2017 tablet_replica.cc:333] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.275175  2017 raft_consensus.cc:2243] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.275683  2017 raft_consensus.cc:2272] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.277765  2017 tablet_replica.cc:333] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.278504  2017 raft_consensus.cc:2243] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.279345  2017 raft_consensus.cc:2272] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.281715  2017 tablet_replica.cc:333] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.282536  2017 raft_consensus.cc:2243] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.283259  2017 raft_consensus.cc:2272] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.285051  2017 tablet_replica.cc:333] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.285612  2017 raft_consensus.cc:2243] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.286096  2017 raft_consensus.cc:2272] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.288229  2017 tablet_replica.cc:333] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.288975  2017 raft_consensus.cc:2243] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.289409  2017 raft_consensus.cc:2272] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:51.289693  8145 consensus_peers.cc:597] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.291565  2017 tablet_replica.cc:333] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.292263  2017 raft_consensus.cc:2243] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.292699  2017 raft_consensus.cc:2272] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.295001  2017 tablet_replica.cc:333] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.295677  2017 raft_consensus.cc:2243] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.296111  2017 raft_consensus.cc:2272] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.298110  2017 tablet_replica.cc:333] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.298766  2017 raft_consensus.cc:2243] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.299258  2017 raft_consensus.cc:2272] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.301432  2017 tablet_replica.cc:333] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.301990  2017 raft_consensus.cc:2243] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.302455  2017 raft_consensus.cc:2272] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.304808  2017 tablet_replica.cc:333] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.305408  2017 raft_consensus.cc:2243] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.306417  2017 raft_consensus.cc:2272] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.309176  2017 tablet_replica.cc:333] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.310014  2017 raft_consensus.cc:2243] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.310591  2017 raft_consensus.cc:2272] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.312954  2017 tablet_replica.cc:333] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.313558  2017 raft_consensus.cc:2243] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.314006  2017 raft_consensus.cc:2272] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.316309  2017 tablet_replica.cc:333] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.317118  2017 raft_consensus.cc:2243] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.317976  2017 raft_consensus.cc:2272] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.320108  2017 tablet_replica.cc:333] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.320684  2017 raft_consensus.cc:2243] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.321092  2017 raft_consensus.cc:2272] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.322850  2017 tablet_replica.cc:333] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.323329  2017 raft_consensus.cc:2243] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.324111  2017 raft_consensus.cc:2272] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.325965  2017 tablet_replica.cc:333] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.326680  2017 raft_consensus.cc:2243] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.327189  2017 raft_consensus.cc:2272] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.329746  2017 tablet_replica.cc:333] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.330300  2017 raft_consensus.cc:2243] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.330706  2017 raft_consensus.cc:2272] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.332662  2017 tablet_replica.cc:333] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.333220  2017 raft_consensus.cc:2243] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.333626  2017 raft_consensus.cc:2272] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.335559  2017 tablet_replica.cc:333] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.336092  2017 raft_consensus.cc:2243] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.336478  2017 raft_consensus.cc:2272] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.338259  2017 tablet_replica.cc:333] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.338812  2017 raft_consensus.cc:2243] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.339680  2017 raft_consensus.cc:2272] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.341394  2017 tablet_replica.cc:333] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.341967  2017 raft_consensus.cc:2243] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.342700  2017 raft_consensus.cc:2272] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.344590  2017 tablet_replica.cc:333] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.345147  2017 raft_consensus.cc:2243] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.345577  2017 raft_consensus.cc:2272] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.347476  2017 tablet_replica.cc:333] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.348207  2017 raft_consensus.cc:2243] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.348680  2017 raft_consensus.cc:2272] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.350999  2017 tablet_replica.cc:333] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.351779  2017 raft_consensus.cc:2243] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.352335  2017 raft_consensus.cc:2272] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:51.353237  8219 consensus_peers.cc:597] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.355012  2017 tablet_replica.cc:333] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.355867  2017 raft_consensus.cc:2243] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.356364  2017 raft_consensus.cc:2272] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:51.356894  8145 consensus_peers.cc:597] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.358312  2017 tablet_replica.cc:333] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
W20260709 12:15:51.358354  8219 consensus_peers.cc:597] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.359045  2017 raft_consensus.cc:2243] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.359984  2017 raft_consensus.cc:2272] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.361999  2017 tablet_replica.cc:333] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.362550  2017 raft_consensus.cc:2243] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.362973  2017 raft_consensus.cc:2272] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.364936  2017 tablet_replica.cc:333] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.365459  2017 raft_consensus.cc:2243] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.365964  2017 raft_consensus.cc:2272] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.367862  2017 tablet_replica.cc:333] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.368409  2017 raft_consensus.cc:2243] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.368819  2017 raft_consensus.cc:2272] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.370810  2017 tablet_replica.cc:333] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.371354  2017 raft_consensus.cc:2243] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.371835  2017 raft_consensus.cc:2272] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.373756  2017 tablet_replica.cc:333] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.374271  2017 raft_consensus.cc:2243] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.374735  2017 raft_consensus.cc:2272] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.377036  2017 tablet_replica.cc:333] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.377569  2017 raft_consensus.cc:2243] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.377974  2017 raft_consensus.cc:2272] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.380002  2017 tablet_replica.cc:333] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.380549  2017 raft_consensus.cc:2243] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:51.380970  2017 raft_consensus.cc:2272] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.382678  2017 tablet_replica.cc:333] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.383286  2017 raft_consensus.cc:2243] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.384096  2017 raft_consensus.cc:2272] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:51.386308  2017 tablet_replica.cc:333] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49: stopping tablet replica
I20260709 12:15:51.386885  2017 raft_consensus.cc:2243] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:51.387732  2017 raft_consensus.cc:2272] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:51.431080  8219 consensus_peers.cc:597] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:51.451658  8145 consensus_peers.cc:597] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.458217  2017 tablet_server.cc:196] TabletServer@127.1.248.65:0 shutdown complete.
W20260709 12:15:51.480903  8293 consensus_peers.cc:597] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:51.496347  8219 consensus_peers.cc:597] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:51.512915  8145 consensus_peers.cc:597] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:51.514087  8219 consensus_peers.cc:597] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.531369  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:51.538319  8847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:51.539333  8848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:51.542848  2017 server_base.cc:1061] running on GCE node
W20260709 12:15:51.543286  8850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:51.547987  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:51.548333  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
W20260709 12:15:51.548576  8219 consensus_peers.cc:597] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.548588  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599351548562 us; error 0 us; skew 500 ppm
I20260709 12:15:51.549572  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:51.553788  2017 webserver.cc:533] Webserver started at http://127.1.248.65:41917/ using document root <none> and password file <none>
I20260709 12:15:51.554466  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:51.554744  2017 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 12:15:51.556552  8293 consensus_peers.cc:597] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.559228  2017 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
W20260709 12:15:51.565999  8219 consensus_peers.cc:597] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.570079  8855 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:51.571261  2017 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:15:51.571709  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-0-root
uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
format_stamp: "Formatted at 2026-07-09 12:15:39 on dist-test-slave-z9f9"
I20260709 12:15:51.572232  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599108657414-2017-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:51.592449  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:51.594107  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:51.596413  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 12:15:51.600271  8145 consensus_peers.cc:597] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.603019  8862 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:15:51.624150  8293 consensus_peers.cc:597] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:51.629410  8145 consensus_peers.cc:597] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:51.649621  8219 consensus_peers.cc:597] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:51.658761  8219 consensus_peers.cc:597] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:51.738242  8219 consensus_peers.cc:597] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:51.868866  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:15:51.869194  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.268s	user 0.009s	sys 0.002s
I20260709 12:15:51.869431  2017 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:15:51.873904  8862 tablet_bootstrap.cc:492] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:51.896968  8862 tablet_bootstrap.cc:492] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:51.897964  8862 tablet_bootstrap.cc:492] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:51.898614  8862 ts_tablet_manager.cc:1403] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 12:15:51.901413  8862 raft_consensus.cc:359] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:51.902127  8862 raft_consensus.cc:740] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.902843  8862 consensus_queue.cc:260] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:51.916100  8862 ts_tablet_manager.cc:1434] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.017s	user 0.016s	sys 0.004s
I20260709 12:15:51.916797  8862 tablet_bootstrap.cc:492] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:51.928738  8862 tablet_bootstrap.cc:492] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:51.929486  8862 tablet_bootstrap.cc:492] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:51.930002  8862 ts_tablet_manager.cc:1403] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 12:15:51.931823  8862 raft_consensus.cc:359] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:51.932312  8862 raft_consensus.cc:740] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.932832  8862 consensus_queue.cc:260] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:51.934191  8862 ts_tablet_manager.cc:1434] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:15:51.934803  8862 tablet_bootstrap.cc:492] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:51.951129  8862 tablet_bootstrap.cc:492] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:51.951993  8862 tablet_bootstrap.cc:492] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:51.952620  8862 ts_tablet_manager.cc:1403] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 12:15:51.954993  8862 raft_consensus.cc:359] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:51.955884  8862 raft_consensus.cc:740] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.956758  8862 consensus_queue.cc:260] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:51.958842  8862 ts_tablet_manager.cc:1434] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:51.959625  8862 tablet_bootstrap.cc:492] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:51.971989  8862 tablet_bootstrap.cc:492] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:51.972740  8862 tablet_bootstrap.cc:492] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:51.973263  8862 ts_tablet_manager.cc:1403] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:15:51.975248  8862 raft_consensus.cc:359] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:51.975905  8862 raft_consensus.cc:740] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.976727  8862 consensus_queue.cc:260] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:51.978967  8862 ts_tablet_manager.cc:1434] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:15:51.979916  8862 tablet_bootstrap.cc:492] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:51.992141  8862 tablet_bootstrap.cc:492] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:51.993039  8862 tablet_bootstrap.cc:492] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:51.993690  8862 ts_tablet_manager.cc:1403] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:15:51.996035  8862 raft_consensus.cc:359] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:51.996711  8862 raft_consensus.cc:740] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.997375  8862 consensus_queue.cc:260] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:51.999248  8862 ts_tablet_manager.cc:1434] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:52.000087  8862 tablet_bootstrap.cc:492] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.056237  8862 tablet_bootstrap.cc:492] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.057210  8862 tablet_bootstrap.cc:492] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:52.057866  8862 ts_tablet_manager.cc:1403] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.024s
I20260709 12:15:52.060449  8862 raft_consensus.cc:359] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.061133  8862 raft_consensus.cc:740] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.061983  8862 consensus_queue.cc:260] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.064404  8862 ts_tablet_manager.cc:1434] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:15:52.065214  8862 tablet_bootstrap.cc:492] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.087036  8862 tablet_bootstrap.cc:492] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.088049  8862 tablet_bootstrap.cc:492] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:52.088697  8862 ts_tablet_manager.cc:1403] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.012s
I20260709 12:15:52.091419  8862 raft_consensus.cc:359] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.092147  8862 raft_consensus.cc:740] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.092928  8862 consensus_queue.cc:260] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.095079  8862 ts_tablet_manager.cc:1434] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:15:52.095894  8862 tablet_bootstrap.cc:492] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.137236  8862 tablet_bootstrap.cc:492] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.138274  8862 tablet_bootstrap.cc:492] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:52.138998  8862 ts_tablet_manager.cc:1403] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.005s
I20260709 12:15:52.142259  8862 raft_consensus.cc:359] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:52.142972  8862 raft_consensus.cc:740] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.144079  8862 consensus_queue.cc:260] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:52.147322  8862 ts_tablet_manager.cc:1434] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:15:52.148224  8862 tablet_bootstrap.cc:492] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.167539  2017 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:15:52.168006  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.299s	user 0.282s	sys 0.000s
I20260709 12:15:52.172184  8862 tablet_bootstrap.cc:492] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.173713  8862 tablet_bootstrap.cc:492] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:52.174875  8862 ts_tablet_manager.cc:1403] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.027s	user 0.024s	sys 0.000s
I20260709 12:15:52.182603  8862 raft_consensus.cc:359] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.184041  8862 raft_consensus.cc:740] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.185442  8862 consensus_queue.cc:260] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.188673  8862 ts_tablet_manager.cc:1434] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:15:52.189836  8862 tablet_bootstrap.cc:492] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.217481  8862 tablet_bootstrap.cc:492] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.218942  8862 tablet_bootstrap.cc:492] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:52.220075  8862 ts_tablet_manager.cc:1403] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.031s	user 0.028s	sys 0.000s
I20260709 12:15:52.223889  8862 raft_consensus.cc:359] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:52.224924  8862 raft_consensus.cc:740] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.226089  8862 consensus_queue.cc:260] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:52.229179  8862 ts_tablet_manager.cc:1434] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:52.230252  8862 tablet_bootstrap.cc:492] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.281394  8862 tablet_bootstrap.cc:492] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.283016  8862 tablet_bootstrap.cc:492] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:52.284160  8862 ts_tablet_manager.cc:1403] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.012s
I20260709 12:15:52.287969  8862 raft_consensus.cc:359] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.289088  8862 raft_consensus.cc:740] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.290505  8862 consensus_queue.cc:260] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.294055  8862 ts_tablet_manager.cc:1434] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:15:52.295387  8862 tablet_bootstrap.cc:492] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.326471  8862 tablet_bootstrap.cc:492] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.327910  8862 tablet_bootstrap.cc:492] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:52.328855  8862 ts_tablet_manager.cc:1403] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.008s
I20260709 12:15:52.332645  8862 raft_consensus.cc:359] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.333740  8862 raft_consensus.cc:740] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.334754  8862 consensus_queue.cc:260] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.337612  8862 ts_tablet_manager.cc:1434] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:52.338723  8862 tablet_bootstrap.cc:492] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.338768  8590 raft_consensus.cc:493] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.339650  8590 raft_consensus.cc:515] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.345005  8590 leader_election.cc:290] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:52.351547  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aedf68b2244597bed9a1046869df3e" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:52.357079  8293 leader_election.cc:336] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.357549  8293 leader_election.cc:304] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:52.362422  8590 raft_consensus.cc:2749] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.368067  8862 tablet_bootstrap.cc:492] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.369382  8862 tablet_bootstrap.cc:492] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:52.370182  8862 ts_tablet_manager.cc:1403] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.012s
I20260709 12:15:52.374246  8862 raft_consensus.cc:359] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.375286  8862 raft_consensus.cc:740] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.376403  8862 consensus_queue.cc:260] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.379292  8862 ts_tablet_manager.cc:1434] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:15:52.380472  8862 tablet_bootstrap.cc:492] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.400882  8590 raft_consensus.cc:493] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.401474  8590 raft_consensus.cc:515] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.406803  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8e6e90970441fdad02bb1119456dea" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:52.407665  8862 tablet_bootstrap.cc:492] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.409040  8862 tablet_bootstrap.cc:492] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
W20260709 12:15:52.409680  8293 leader_election.cc:336] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.409960  8862 ts_tablet_manager.cc:1403] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.004s
I20260709 12:15:52.410414  8296 leader_election.cc:304] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:52.411507  8876 raft_consensus.cc:2749] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.403363  8590 leader_election.cc:290] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.413585  8862 raft_consensus.cc:359] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:52.414669  8862 raft_consensus.cc:740] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.416013  8862 consensus_queue.cc:260] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:52.419353  8862 ts_tablet_manager.cc:1434] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:15:52.420433  8862 tablet_bootstrap.cc:492] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.442364  8862 tablet_bootstrap.cc:492] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.443818  8862 tablet_bootstrap.cc:492] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:52.444661  8862 ts_tablet_manager.cc:1403] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 12:15:52.448132  8862 raft_consensus.cc:359] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.448817  8590 raft_consensus.cc:493] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.449095  8862 raft_consensus.cc:740] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.449400  8590 raft_consensus.cc:515] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.450255  8862 consensus_queue.cc:260] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.451182  8590 leader_election.cc:290] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.452706  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879b385c0a08435a943ff307ac8fb275" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:52.453693  8862 ts_tablet_manager.cc:1434] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:15:52.454942  8862 tablet_bootstrap.cc:492] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.456490  8884 raft_consensus.cc:493] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.457022  8884 raft_consensus.cc:515] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.459740  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd20020a2924e31be0f16636e76efa7" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:52.463176  8864 raft_consensus.cc:493] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.463780  8864 raft_consensus.cc:515] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.468942  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f9fa3d1004f2f820b3f26592cbd1a" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
W20260709 12:15:52.471149  8293 leader_election.cc:336] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.471700  8293 leader_election.cc:304] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:52.472913  8582 raft_consensus.cc:2749] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:52.473369  8219 leader_election.cc:336] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.473814  8219 leader_election.cc:304] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:52.474617  8874 raft_consensus.cc:2749] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.475636  8864 leader_election.cc:290] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
W20260709 12:15:52.476615  8145 leader_election.cc:336] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.477026  8145 leader_election.cc:304] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:52.477732  8842 raft_consensus.cc:2749] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.478551  8884 leader_election.cc:290] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.480863  8884 raft_consensus.cc:493] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.480855  8862 tablet_bootstrap.cc:492] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.481441  8884 raft_consensus.cc:515] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.482522  8862 tablet_bootstrap.cc:492] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:52.483209  8884 leader_election.cc:290] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.483659  8862 ts_tablet_manager.cc:1403] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.004s
I20260709 12:15:52.486642  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aedf68b2244597bed9a1046869df3e" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:52.487385  8328 raft_consensus.cc:2468] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:52.487862  8862 raft_consensus.cc:359] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.488991  8862 raft_consensus.cc:740] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.489639  8590 raft_consensus.cc:493] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.490052  8145 leader_election.cc:304] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:52.491791  8842 raft_consensus.cc:2804] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.491171  8862 consensus_queue.cc:260] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.492179  8842 raft_consensus.cc:493] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.492587  8842 raft_consensus.cc:3060] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.494906  8862 ts_tablet_manager.cc:1434] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:15:52.496237  8862 tablet_bootstrap.cc:492] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.490304  8590 raft_consensus.cc:515] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
W20260709 12:15:52.496465  8145 leader_election.cc:336] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.502568  8842 raft_consensus.cc:515] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
W20260709 12:15:52.506075  8293 leader_election.cc:336] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.506510  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78aedf68b2244597bed9a1046869df3e" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:52.509469  8328 raft_consensus.cc:3060] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.516494  8328 raft_consensus.cc:2468] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 2.
I20260709 12:15:52.507475  8590 leader_election.cc:290] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:52.508862  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc189c974f5542a682c54f9bde0483a1" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:15:52.516569  8145 leader_election.cc:336] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.518239  8145 leader_election.cc:304] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:52.518253  8296 leader_election.cc:304] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:52.519045  8582 raft_consensus.cc:2749] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.504894  8842 leader_election.cc:290] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.520372  8884 raft_consensus.cc:2804] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.520908  8884 raft_consensus.cc:697] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 2 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:52.521751  8884 consensus_queue.cc:237] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.523399  8862 tablet_bootstrap.cc:492] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.524377  8862 tablet_bootstrap.cc:492] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:52.524986  8862 ts_tablet_manager.cc:1403] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.029s	user 0.022s	sys 0.004s
I20260709 12:15:52.527963  8862 raft_consensus.cc:359] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:52.528731  8862 raft_consensus.cc:740] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.529572  8862 consensus_queue.cc:260] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:52.532034  8862 ts_tablet_manager.cc:1434] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:15:52.532868  8862 tablet_bootstrap.cc:492] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.534348  8582 raft_consensus.cc:493] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.534969  8582 raft_consensus.cc:515] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.536947  8582 leader_election.cc:290] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.539131  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f9fa3d1004f2f820b3f26592cbd1a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:52.539805  8253 raft_consensus.cc:2468] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:52.540961  8296 leader_election.cc:304] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
W20260709 12:15:52.543541  8293 leader_election.cc:336] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.544574  8582 raft_consensus.cc:2804] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.548986  8582 raft_consensus.cc:493] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.549598  8582 raft_consensus.cc:3060] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.555936  8864 raft_consensus.cc:493] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.556543  8864 raft_consensus.cc:515] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.561244  8001 catalog_manager.cc:5697] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 2 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:52.564463  8219 leader_election.cc:336] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.564713  8876 raft_consensus.cc:493] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.569582  8590 raft_consensus.cc:493] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.565423  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879b385c0a08435a943ff307ac8fb275" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:52.570222  8328 raft_consensus.cc:2468] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:52.570073  8590 raft_consensus.cc:515] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.569296  8876 raft_consensus.cc:515] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.567215  8864 leader_election.cc:290] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.574548  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:52.576200  8219 leader_election.cc:304] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:52.578104  8874 raft_consensus.cc:2804] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.578474  8874 raft_consensus.cc:493] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.578812  8874 raft_consensus.cc:3060] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.575174  8842 raft_consensus.cc:493] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.584333  8842 raft_consensus.cc:515] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:52.587240  8876 leader_election.cc:290] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:52.588575  8842 leader_election.cc:290] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:52.588732  8863 raft_consensus.cc:493] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.593994  8863 raft_consensus.cc:515] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.595335  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:52.596163  8863 leader_election.cc:290] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
W20260709 12:15:52.596885  8145 leader_election.cc:336] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.599079  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:52.599860  8148 leader_election.cc:304] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:52.600648  8665 raft_consensus.cc:493] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.601097  8665 raft_consensus.cc:515] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.601401  8866 raft_consensus.cc:2749] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.603017  8665 leader_election.cc:290] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.607721  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb422c1b757045358366d25d227e95ec" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:52.608366  8328 raft_consensus.cc:2468] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:52.609907  8145 leader_election.cc:304] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:52.611609  8884 raft_consensus.cc:2804] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.612006  8884 raft_consensus.cc:493] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.612375  8884 raft_consensus.cc:3060] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.621490  8878 raft_consensus.cc:493] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.622076  8878 raft_consensus.cc:515] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
W20260709 12:15:52.623221  8145 leader_election.cc:336] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.624241  8878 leader_election.cc:290] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.629236  8874 raft_consensus.cc:515] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.633332  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb422c1b757045358366d25d227e95ec" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:52.634183  8590 leader_election.cc:290] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:52.638089  8665 raft_consensus.cc:493] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.638646  8665 raft_consensus.cc:515] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.640529  8665 leader_election.cc:290] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
W20260709 12:15:52.641276  8293 leader_election.cc:336] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.641806  8293 leader_election.cc:304] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:52.642457  8874 leader_election.cc:290] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.642938  8590 raft_consensus.cc:2749] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.636634  8582 raft_consensus.cc:515] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
W20260709 12:15:52.649761  8293 leader_election.cc:336] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.650204  8293 leader_election.cc:304] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:52.649665  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879b385c0a08435a943ff307ac8fb275" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:52.651082  8327 raft_consensus.cc:3060] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.654867  8863 raft_consensus.cc:2749] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.651746  8876 raft_consensus.cc:493] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.656673  8876 raft_consensus.cc:515] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.659150  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895082ba16e461b8ca83550f065f98c" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:52.659154  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8e6e90970441fdad02bb1119456dea" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:52.660729  8328 raft_consensus.cc:2468] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:52.661738  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc189c974f5542a682c54f9bde0483a1" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:52.662423  8325 raft_consensus.cc:2468] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:52.663738  8219 leader_election.cc:304] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:52.666786  8878 raft_consensus.cc:2804] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.667155  8878 raft_consensus.cc:493] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.667309  8145 leader_election.cc:304] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:52.667539  8878 raft_consensus.cc:3060] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.669028  8864 raft_consensus.cc:493] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.669569  8864 raft_consensus.cc:515] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.672786  8665 raft_consensus.cc:2804] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.673206  8665 raft_consensus.cc:493] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.673543  8665 raft_consensus.cc:3060] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.664717  8876 leader_election.cc:290] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.676687  8590 raft_consensus.cc:493] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.677212  8590 raft_consensus.cc:515] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.679837  8327 raft_consensus.cc:2468] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 2.
I20260709 12:15:52.684228  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:52.686348  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f9fa3d1004f2f820b3f26592cbd1a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:52.686918  8253 raft_consensus.cc:3060] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.688910  8590 leader_election.cc:290] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.698815  8842 raft_consensus.cc:493] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.684881  8254 raft_consensus.cc:2468] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 2.
I20260709 12:15:52.701987  8219 leader_election.cc:304] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:52.704625  8296 leader_election.cc:304] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:52.721195  8253 raft_consensus.cc:2468] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 2.
I20260709 12:15:52.723524  8296 leader_election.cc:304] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:52.724400  8590 raft_consensus.cc:2804] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.725615  8590 raft_consensus.cc:697] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:52.726426  8590 consensus_queue.cc:237] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.729884  8636 raft_consensus.cc:2804] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.730099  8876 raft_consensus.cc:2804] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:52.733743  8876 raft_consensus.cc:493] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.734145  8876 raft_consensus.cc:3060] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:52.736930  8862 tablet_bootstrap.cc:492] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.699391  8842 raft_consensus.cc:515] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.738303  8862 tablet_bootstrap.cc:492] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
W20260709 12:15:52.742902  8293 leader_election.cc:336] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.744421  8293 leader_election.cc:304] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:52.739259  8862 ts_tablet_manager.cc:1403] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.207s	user 0.063s	sys 0.135s
I20260709 12:15:52.749430  8665 raft_consensus.cc:515] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.770748  8582 leader_election.cc:290] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.771703  8582 raft_consensus.cc:493] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.771767  8665 leader_election.cc:290] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.772413  8582 raft_consensus.cc:515] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.730751  8864 leader_election.cc:290] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.740522  8874 raft_consensus.cc:493] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.749832  8636 raft_consensus.cc:697] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:52.786103  8939 raft_consensus.cc:2749] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.792029  8582 leader_election.cc:290] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.795162  8842 leader_election.cc:290] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.797242  8876 raft_consensus.cc:515] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.797628  8862 raft_consensus.cc:359] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.803821  8862 raft_consensus.cc:740] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.808231  8862 consensus_queue.cc:260] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.813102  8863 raft_consensus.cc:493] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.813679  8863 raft_consensus.cc:515] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:15:52.814576  8876 leader_election.cc:290] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.815294  8878 raft_consensus.cc:515] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.778716  8874 raft_consensus.cc:515] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:52.815572  8636 consensus_queue.cc:237] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.817282  8878 leader_election.cc:290] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.817914  8874 leader_election.cc:290] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:52.818135  8862 ts_tablet_manager.cc:1434] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.001s
I20260709 12:15:52.787781  8884 raft_consensus.cc:515] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:52.818986  8862 tablet_bootstrap.cc:492] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:52.819284  8178 raft_consensus.cc:2393] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9058059c81534bc4b58c5329d5734dcc in current term 2: Already voted for candidate b02838a902c44ea49d8d94181285b20e in this term.
I20260709 12:15:52.819942  8884 leader_election.cc:290] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.815593  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
W20260709 12:15:52.822371  8293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:34153, user_credentials={real_user=slave}} blocked reactor thread for 79499.1us
I20260709 12:15:52.822420  8253 raft_consensus.cc:2468] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
W20260709 12:15:52.822926  8293 leader_election.cc:336] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:15:52.823594  8293 leader_election.cc:336] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:15:52.824980  8219 leader_election.cc:336] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.826684  8296 leader_election.cc:304] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:52.827153  8582 raft_consensus.cc:493] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.827255  8876 raft_consensus.cc:493] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.827836  8582 raft_consensus.cc:515] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.827836  8876 raft_consensus.cc:515] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.830080  8296 leader_election.cc:304] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:52.830364  8876 leader_election.cc:290] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.830922  8876 raft_consensus.cc:2804] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:15:52.832031  8219 leader_election.cc:336] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.834714  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:52.835912  8253 raft_consensus.cc:3060] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:52.838420  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7014425193644424abe3ad50857b4051" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:52.839082  8254 raft_consensus.cc:2468] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:52.840204  8296 leader_election.cc:304] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:52.831673  8863 leader_election.cc:290] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.831265  8876 raft_consensus.cc:493] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.842077  8874 raft_consensus.cc:493] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.862568  8874 raft_consensus.cc:515] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.864602  8582 leader_election.cc:290] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.865499  8582 raft_consensus.cc:2804] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.865713  8582 raft_consensus.cc:493] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.865988  8582 raft_consensus.cc:3060] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:52.869164  8145 leader_election.cc:336] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.870960  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676232727c4f42c28fd5608fbeb3f634" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:52.871843  8327 raft_consensus.cc:2393] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66af1447f2c64ebda5448a760d5d7718 in current term 3: Already voted for candidate 9058059c81534bc4b58c5329d5734dcc in this term.
I20260709 12:15:52.875269  8253 raft_consensus.cc:2468] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 3.
I20260709 12:15:52.878214  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:52.879041  8328 raft_consensus.cc:2468] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 1.
I20260709 12:15:52.861631  8863 raft_consensus.cc:3060] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.864782  8876 raft_consensus.cc:3060] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.877529  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd20020a2924e31be0f16636e76efa7" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:52.891649  8178 raft_consensus.cc:2468] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:52.879992  8935 raft_consensus.cc:493] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
W20260709 12:15:52.900919  8145 leader_election.cc:336] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:15:52.903509  8145 leader_election.cc:336] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.903793  8582 raft_consensus.cc:515] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
W20260709 12:15:52.904516  8293 leader_election.cc:336] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.883214  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:52.882474  8726 raft_consensus.cc:493] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.922847  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8e6e90970441fdad02bb1119456dea" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
W20260709 12:15:52.932636  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:42019, user_credentials={real_user=slave}} blocked reactor thread for 54641.3us
I20260709 12:15:52.910293  8935 raft_consensus.cc:515] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.935568  8935 leader_election.cc:290] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.913889  8177 raft_consensus.cc:2468] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:52.923585  8329 raft_consensus.cc:3060] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.938261  8582 leader_election.cc:290] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
W20260709 12:15:52.939164  8293 leader_election.cc:336] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:15:52.940681  8293 leader_election.cc:336] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.928038  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc189c974f5542a682c54f9bde0483a1" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:52.942335  8222 leader_election.cc:304] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
W20260709 12:15:52.944373  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:40315, user_credentials={real_user=slave}} blocked reactor thread for 104239us
I20260709 12:15:52.914098  8726 raft_consensus.cc:515] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:52.946326  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbd2f663574037a43ecf0219ef1c48" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:52.946921  8253 raft_consensus.cc:2468] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 1.
I20260709 12:15:52.947371  8726 leader_election.cc:290] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.952694  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb422c1b757045358366d25d227e95ec" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:52.959611  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7014425193644424abe3ad50857b4051" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:52.960004  8296 leader_election.cc:304] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:15:52.960529  8254 raft_consensus.cc:3060] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.944769  8325 raft_consensus.cc:3060] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.945433  8864 raft_consensus.cc:2804] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.971216  8864 raft_consensus.cc:493] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:52.980731  8003 catalog_manager.cc:5697] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:52.977773  8293 leader_election.cc:336] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:15:52.989974  8293 leader_election.cc:336] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.990231  8582 raft_consensus.cc:2804] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.990681  8582 raft_consensus.cc:493] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
W20260709 12:15:52.990756  8293 leader_election.cc:336] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.991104  8582 raft_consensus.cc:3060] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:52.992760  8293 leader_election.cc:336] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:52.977923  8325 raft_consensus.cc:2468] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 2.
I20260709 12:15:52.995595  8863 raft_consensus.cc:2749] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:53.013499  8145 leader_election.cc:304] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:53.008908  8326 raft_consensus.cc:1275] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer b02838a902c44ea49d8d94181285b20e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:52.971405  8874 leader_election.cc:290] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:52.974862  8864 raft_consensus.cc:3060] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.976338  8004 catalog_manager.cc:5697] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 2 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:53.021749  8296 leader_election.cc:304] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:53.021921  8254 raft_consensus.cc:2468] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 2.
I20260709 12:15:53.023809  8145 leader_election.cc:304] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:53.024636  8582 raft_consensus.cc:515] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.024988  8328 raft_consensus.cc:2468] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 2.
I20260709 12:15:53.031560  8665 raft_consensus.cc:2804] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:53.032135  8665 raft_consensus.cc:697] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 2 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:53.032081  8296 leader_election.cc:304] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:53.032975  8665 consensus_queue.cc:237] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:53.016927  8937 raft_consensus.cc:2804] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:53.035696  8582 leader_election.cc:290] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:53.036927  8296 leader_election.cc:304] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:53.041766  8876 raft_consensus.cc:515] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.043504  8329 raft_consensus.cc:2468] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 2.
I20260709 12:15:53.044781  8942 raft_consensus.cc:2804] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:53.045325  8942 raft_consensus.cc:697] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:53.046201  8942 consensus_queue.cc:237] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
W20260709 12:15:53.064253  8145 leader_election.cc:336] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:53.068778  8145 leader_election.cc:304] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:53.075978  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:53.076673  8326 raft_consensus.cc:2468] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:53.080974  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbd2f663574037a43ecf0219ef1c48" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:53.082000  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895082ba16e461b8ca83550f065f98c" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:53.082688  8326 raft_consensus.cc:2468] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 1.
I20260709 12:15:53.086568  8876 leader_election.cc:290] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:53.087474  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd20020a2924e31be0f16636e76efa7" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:53.088099  8177 raft_consensus.cc:3060] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.035746  8946 raft_consensus.cc:2804] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:53.090281  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:53.091962  8254 raft_consensus.cc:3060] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.037734  8937 raft_consensus.cc:493] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:53.064563  8939 raft_consensus.cc:2804] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:53.094336  8884 consensus_queue.cc:1048] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:53.099079  8937 raft_consensus.cc:3060] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.099653  8939 raft_consensus.cc:493] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:53.100240  8939 raft_consensus.cc:3060] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.089758  8842 raft_consensus.cc:2804] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:53.115108  8254 raft_consensus.cc:2468] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 2.
I20260709 12:15:53.083233  8219 leader_election.cc:304] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
W20260709 12:15:53.123523  8293 leader_election.cc:336] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:53.124377  8944 raft_consensus.cc:2804] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:53.124647  8864 raft_consensus.cc:515] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:53.128747  8944 raft_consensus.cc:697] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
W20260709 12:15:53.128926  8293 leader_election.cc:336] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:53.130286  8944 consensus_queue.cc:237] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.127358  8219 leader_election.cc:304] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:53.112895  8946 raft_consensus.cc:697] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 3 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:53.135764  8953 raft_consensus.cc:2804] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:53.136201  8953 raft_consensus.cc:493] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:53.136207  8868 raft_consensus.cc:493] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.136639  8953 raft_consensus.cc:3060] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.136296  8946 consensus_queue.cc:237] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.137023  8868 raft_consensus.cc:515] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
W20260709 12:15:53.137938  8145 consensus_peers.cc:597] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:53.141196  8219 leader_election.cc:304] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:15:53.144367  8296 leader_election.cc:304] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
W20260709 12:15:53.149112  8219 leader_election.cc:336] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:15:53.152056  8219 leader_election.cc:336] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:53.119267  8842 raft_consensus.cc:697] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 2 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
W20260709 12:15:53.163130  8219 leader_election.cc:336] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:53.163666  8219 leader_election.cc:304] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:53.159224  8935 raft_consensus.cc:2804] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:53.161401  8863 raft_consensus.cc:2804] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:53.150055  8868 leader_election.cc:290] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:53.181926  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:15:53.168497  8874 raft_consensus.cc:2749] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:53.174105  8864 leader_election.cc:290] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:53.176263  8935 raft_consensus.cc:493] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:15:53.184705  8863 raft_consensus.cc:697] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:53.193629  8179 raft_consensus.cc:3060] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:53.203054  8219 leader_election.cc:336] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:53.204550  8863 consensus_queue.cc:237] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.199244  8935 raft_consensus.cc:3060] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:53.209986  8219 leader_election.cc:336] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:15:53.211226  8219 leader_election.cc:336] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:53.230815  8862 tablet_bootstrap.cc:492] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:53.199841  8842 consensus_queue.cc:237] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:53.244244  8253 raft_consensus.cc:1275] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.246428  8582 consensus_queue.cc:1048] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:15:53.247440  8219 leader_election.cc:336] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:53.260913  8862 tablet_bootstrap.cc:492] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:53.262045  8862 ts_tablet_manager.cc:1403] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.443s	user 0.031s	sys 0.011s
I20260709 12:15:53.246102  8177 raft_consensus.cc:2468] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 2.
W20260709 12:15:53.277220  8148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:40315, user_credentials={real_user=slave}} blocked reactor thread for 46448.1us
I20260709 12:15:53.278625  8296 leader_election.cc:304] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:53.303385  8582 raft_consensus.cc:2804] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:53.304098  8582 raft_consensus.cc:697] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:53.314709  8582 consensus_queue.cc:237] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.320742  8327 raft_consensus.cc:1275] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.276539  8937 raft_consensus.cc:515] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:53.343896  8862 raft_consensus.cc:359] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.344767  8862 raft_consensus.cc:740] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:53.345525  8862 consensus_queue.cc:260] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.349982  8862 ts_tablet_manager.cc:1434] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 12:15:53.352200  8862 tablet_bootstrap.cc:492] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:53.353066  8939 raft_consensus.cc:515] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.353555  8864 consensus_queue.cc:1048] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:53.355651  8329 raft_consensus.cc:2393] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66af1447f2c64ebda5448a760d5d7718 in current term 2: Already voted for candidate 9058059c81534bc4b58c5329d5734dcc in this term.
I20260709 12:15:53.358255  8179 raft_consensus.cc:2468] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 2.
I20260709 12:15:53.354945  8953 raft_consensus.cc:515] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.378530  8953 leader_election.cc:290] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
W20260709 12:15:53.375747  8219 consensus_peers.cc:597] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:53.383090  8219 leader_election.cc:304] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:53.380182  8937 leader_election.cc:290] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:53.404583  8004 catalog_manager.cc:5697] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 2 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:53.406458  8004 catalog_manager.cc:5697] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 2 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:53.391928  8953 raft_consensus.cc:3060] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:53.428277  8293 consensus_peers.cc:597] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:53.442134  8868 raft_consensus.cc:493] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.440481  8222 leader_election.cc:304] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:53.442898  8868 raft_consensus.cc:515] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.452081  8868 leader_election.cc:290] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:53.450042  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:53.454234  8329 raft_consensus.cc:3060] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:53.455569  8145 leader_election.cc:336] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:53.462553  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:53.463460  8327 raft_consensus.cc:3060] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:53.473373  8219 leader_election.cc:336] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:53.472609  8935 raft_consensus.cc:515] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.477407  8935 leader_election.cc:290] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:53.478427  8979 raft_consensus.cc:2804] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:53.479246  8979 raft_consensus.cc:697] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:53.487042  8003 catalog_manager.cc:5697] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:53.491619  8868 raft_consensus.cc:493] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.492419  8868 raft_consensus.cc:515] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:53.496093  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9895082ba16e461b8ca83550f065f98c" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:15:53.496811  8324 raft_consensus.cc:3060] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.534332  8004 catalog_manager.cc:5697] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 2 to 3, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 3 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:53.505147  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbd2f663574037a43ecf0219ef1c48" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:15:53.549590  8004 catalog_manager.cc:5697] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 2 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:53.501880  8327 raft_consensus.cc:2468] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 2.
I20260709 12:15:53.551620  8004 catalog_manager.cc:5697] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 2 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:53.515168  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7014425193644424abe3ad50857b4051" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:53.553082  8254 raft_consensus.cc:2393] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in current term 2: Already voted for candidate 9058059c81534bc4b58c5329d5734dcc in this term.
I20260709 12:15:53.553272  8004 catalog_manager.cc:5697] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 2 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:53.553174  8989 raft_consensus.cc:493] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.561335  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7014425193644424abe3ad50857b4051" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:53.513375  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586406114304e5a9209b76096a2f1ba" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:53.566947  8327 raft_consensus.cc:1275] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer b02838a902c44ea49d8d94181285b20e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.511345  8953 raft_consensus.cc:2749] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:53.564715  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586406114304e5a9209b76096a2f1ba" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:53.549403  8939 leader_election.cc:290] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:53.551092  8868 leader_election.cc:290] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:53.516317  8329 raft_consensus.cc:2468] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 2.
I20260709 12:15:53.571532  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d921491df994357a386e8d378ccfd09" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:53.578927  8145 leader_election.cc:304] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:53.580965  8665 raft_consensus.cc:2804] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:53.581615  8665 raft_consensus.cc:697] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 2 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:15:53.578979  8969 consensus_queue.cc:1048] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:15:53.585253  8856 leader_election.cc:304] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:53.590288  8986 raft_consensus.cc:493] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.590893  8986 raft_consensus.cc:515] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
W20260709 12:15:53.591653  8219 leader_election.cc:336] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:53.592614  8219 leader_election.cc:304] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:53.593091  8986 leader_election.cc:290] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:53.549161  8979 consensus_queue.cc:237] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:53.594861  8953 raft_consensus.cc:2804] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:53.595346  8953 raft_consensus.cc:697] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:53.596179  8953 consensus_queue.cc:237] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.599732  8256 raft_consensus.cc:1275] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:53.585307  8293 leader_election.cc:336] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:15:53.601202  8868 raft_consensus.cc:493] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.601747  8868 raft_consensus.cc:515] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:53.603158  8856 leader_election.cc:304] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:53.582653  8665 consensus_queue.cc:237] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:53.624621  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df02ba9540747b5a8c99951df903897" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:53.619381  8986 raft_consensus.cc:3060] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.660604  8253 raft_consensus.cc:2468] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 2.
I20260709 12:15:53.667790  8862 tablet_bootstrap.cc:492] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:53.564930  8989 raft_consensus.cc:515] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.645473  8868 leader_election.cc:290] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:53.634455  8946 consensus_queue.cc:1048] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:15:53.646384  8988 raft_consensus.cc:2749] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:53.697397  8862 tablet_bootstrap.cc:492] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:53.698452  8862 ts_tablet_manager.cc:1403] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.347s	user 0.023s	sys 0.033s
I20260709 12:15:53.707085  8324 raft_consensus.cc:2468] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 2.
I20260709 12:15:53.713922  8989 leader_election.cc:290] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:53.714732  8989 raft_consensus.cc:493] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.696177  8868 raft_consensus.cc:493] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.718425  8868 raft_consensus.cc:515] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:15:53.724987  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:42019, user_credentials={real_user=slave}} blocked reactor thread for 79602.7us
I20260709 12:15:53.726325  8219 leader_election.cc:304] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:15:53.709887  8988 raft_consensus.cc:493] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.754208  8862 raft_consensus.cc:359] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:53.744704  8988 raft_consensus.cc:515] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:53.765702  8252 raft_consensus.cc:1275] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:53.768431  9001 raft_consensus.cc:493] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.769201  8868 leader_election.cc:290] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:53.769268  9001 raft_consensus.cc:515] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.715348  8989 raft_consensus.cc:515] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:53.763175  8988 leader_election.cc:290] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:53.732422  8941 raft_consensus.cc:2804] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:53.755295  8862 raft_consensus.cc:740] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:53.778570  8862 consensus_queue.cc:260] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:53.779345  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.65:34153
I20260709 12:15:53.784556  9002 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.65:34153 every 8 connection(s)
I20260709 12:15:53.784659  9003 raft_consensus.cc:493] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.785449  9003 raft_consensus.cc:515] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:53.788195  8868 raft_consensus.cc:493] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.788822  8868 raft_consensus.cc:515] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:53.792747  8862 ts_tablet_manager.cc:1434] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.000s
I20260709 12:15:53.799407  8942 consensus_queue.cc:1048] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:15:53.787916  9003 leader_election.cc:290] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:53.780604  8941 raft_consensus.cc:697] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:15:53.814713  8868 leader_election.cc:290] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:53.815173  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:53.822330  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008c85279d534f24a2dd08e7bbd167cb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:53.816738  8989 leader_election.cc:290] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:53.843811  8941 consensus_queue.cc:237] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.836477  8256 raft_consensus.cc:2393] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in current term 2: Already voted for candidate 9058059c81534bc4b58c5329d5734dcc in this term.
I20260709 12:15:53.867702  8986 raft_consensus.cc:2749] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:53.877629  8862 tablet_bootstrap.cc:492] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:53.884321  9001 leader_election.cc:290] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:53.912237  8324 raft_consensus.cc:1275] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.915339  8179 raft_consensus.cc:1275] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:53.920651  8145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:44023, user_credentials={real_user=slave}} blocked reactor thread for 58619.5us
I20260709 12:15:53.921871  8255 raft_consensus.cc:1275] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.922858  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544e8410d33f4f21851df79c3d646d76" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:53.924705  9012 consensus_queue.cc:1048] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:53.907034  8296 leader_election.cc:304] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
W20260709 12:15:53.928191  8856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.68:44023, user_credentials={real_user=slave}} blocked reactor thread for 325131us
I20260709 12:15:53.928920  8876 raft_consensus.cc:2804] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:53.929427  8876 raft_consensus.cc:697] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:15:53.930243  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:53.930367  8876 consensus_queue.cc:237] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:53.932513  8330 raft_consensus.cc:1275] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer b02838a902c44ea49d8d94181285b20e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.938843  8952 consensus_queue.cc:1048] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:53.954877  8001 catalog_manager.cc:5697] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:53.959117  8003 catalog_manager.cc:5697] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 2 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:53.979744  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:53.993439  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:54.001507  8001 catalog_manager.cc:5697] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:54.003328  8001 catalog_manager.cc:5697] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:54.004439  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85f56f39a20454d8ddeffad93e935a8" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:53.989645  8946 consensus_queue.cc:1048] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:15:53.990046  9007 consensus_queue.cc:1048] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:15:54.015339  8330 raft_consensus.cc:2393] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in current term 2: Already voted for candidate b02838a902c44ea49d8d94181285b20e in this term.
I20260709 12:15:54.020159  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fee3a59c3aa4cc7aa1c7bbf41e4c0c8" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:54.033623  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:54.050748  9001 raft_consensus.cc:493] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.051288  9001 raft_consensus.cc:515] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:54.053603  9001 leader_election.cc:290] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:54.058041  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:54.059300  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85f56f39a20454d8ddeffad93e935a8" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:54.059661  9001 raft_consensus.cc:493] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.059214  8004 catalog_manager.cc:5697] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 1 to 2, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 2 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:54.060266  9001 raft_consensus.cc:515] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.060968  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:54.062079  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544e8410d33f4f21851df79c3d646d76" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:54.062917  9001 leader_election.cc:290] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:15:54.063387  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fee3a59c3aa4cc7aa1c7bbf41e4c0c8" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:54.064154  8986 raft_consensus.cc:493] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.064635  8986 raft_consensus.cc:515] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:54.066278  9004 raft_consensus.cc:493] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66af1447f2c64ebda5448a760d5d7718)
I20260709 12:15:54.066617  8986 leader_election.cc:290] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:54.066817  9004 raft_consensus.cc:515] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:54.067567  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008c85279d534f24a2dd08e7bbd167cb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:54.068876  9004 leader_election.cc:290] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:15:54.069280  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da9a7d0425b4dd09d6615567d1fc738" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:54.069555  8914 raft_consensus.cc:3060] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.071220  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df02ba9540747b5a8c99951df903897" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:54.072800  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d921491df994357a386e8d378ccfd09" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:54.074872  8325 raft_consensus.cc:1275] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:54.069628  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879b385c0a08435a943ff307ac8fb275" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:54.079792  8856 leader_election.cc:304] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:54.081723  9004 raft_consensus.cc:3060] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.082690  8935 consensus_queue.cc:1048] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:54.087337  8989 raft_consensus.cc:493] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.087939  8989 raft_consensus.cc:515] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:54.089455  9004 raft_consensus.cc:2749] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.090045  8989 leader_election.cc:290] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:15:54.099466  8180 raft_consensus.cc:1275] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:54.101275  8944 consensus_queue.cc:1048] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:54.110201  8856 leader_election.cc:304] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
I20260709 12:15:54.113880  8916 raft_consensus.cc:3060] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.115262  9001 raft_consensus.cc:2749] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.115861  8862 tablet_bootstrap.cc:492] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.116835  8862 tablet_bootstrap.cc:492] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.117480  8862 ts_tablet_manager.cc:1403] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.240s	user 0.015s	sys 0.004s
I20260709 12:15:54.120558  8917 raft_consensus.cc:3060] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.128983  8917 raft_consensus.cc:1275] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:54.131839  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:54.132251  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:54.130892  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:54.134826  8859 leader_election.cc:304] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:54.135215  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710d05d6f10242a7b13561b37f5eae08" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:54.135759  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879b385c0a08435a943ff307ac8fb275" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:54.136086  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9383c8a3a24a0ba2d5b8d5e1006a50" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
W20260709 12:15:54.140471  8219 consensus_peers.cc:597] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:54.142259  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:15:54.147929  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9383c8a3a24a0ba2d5b8d5e1006a50" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:15:54.149621  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710d05d6f10242a7b13561b37f5eae08" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:15:54.141717  9004 raft_consensus.cc:2749] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.157374  8325 raft_consensus.cc:1275] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer b02838a902c44ea49d8d94181285b20e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:54.159447  9011 consensus_queue.cc:1048] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:15:54.165978  8219 consensus_peers.cc:597] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:54.159932  8916 raft_consensus.cc:1275] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:54.166772  8219 consensus_peers.cc:597] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:54.169358  8219 consensus_peers.cc:597] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:54.170276  8941 consensus_queue.cc:1048] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:54.169173  8859 leader_election.cc:304] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:54.174443  9004 raft_consensus.cc:3060] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.181941  9004 raft_consensus.cc:2749] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.183147  8859 leader_election.cc:304] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:54.184036  9001 raft_consensus.cc:2749] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.185418  8859 leader_election.cc:304] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:54.186249  9001 raft_consensus.cc:2749] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:54.187471  8859 leader_election.cc:304] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:54.188762  8859 leader_election.cc:304] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:54.194092  9001 raft_consensus.cc:2749] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.194729  9001 raft_consensus.cc:2749] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.195941  8859 leader_election.cc:304] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:54.203532  8859 leader_election.cc:304] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:54.204356  9001 raft_consensus.cc:2749] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.205077  9001 raft_consensus.cc:2749] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.206245  8862 raft_consensus.cc:359] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.206956  8862 raft_consensus.cc:740] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.207649  8862 consensus_queue.cc:260] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.208735  8915 raft_consensus.cc:1275] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:54.209748  8862 ts_tablet_manager.cc:1434] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.000s
I20260709 12:15:54.210582  8944 consensus_queue.cc:1048] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:54.212437  8917 raft_consensus.cc:1275] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:54.214349  8915 raft_consensus.cc:3060] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.226320  8917 raft_consensus.cc:1275] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Refusing update from remote peer b02838a902c44ea49d8d94181285b20e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:54.227810  8862 tablet_bootstrap.cc:492] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:54.230175  8859 leader_election.cc:304] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:54.231734  8859 leader_election.cc:304] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
W20260709 12:15:54.234436  8145 consensus_peers.cc:597] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:54.235563  9004 raft_consensus.cc:2749] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:54.236380  8145 consensus_peers.cc:597] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:54.237926  8145 consensus_peers.cc:597] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:54.238878  8145 consensus_peers.cc:597] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:54.241241  8145 consensus_peers.cc:597] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:54.243737  9001 raft_consensus.cc:2749] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.247550  8859 leader_election.cc:304] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:54.249970  9001 raft_consensus.cc:2749] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.251125  8859 leader_election.cc:304] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
W20260709 12:15:54.251545  8145 consensus_peers.cc:597] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:54.252512  9001 raft_consensus.cc:2749] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:54.253247  8145 consensus_peers.cc:597] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:54.253934  8293 consensus_peers.cc:597] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:54.253747  8856 leader_election.cc:304] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e
I20260709 12:15:54.254773  9011 consensus_queue.cc:1048] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:54.255640  8946 consensus_queue.cc:1048] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:54.257579  8939 consensus_queue.cc:1048] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:54.260667  8293 consensus_peers.cc:597] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:54.262481  8219 consensus_peers.cc:597] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:54.263389  9001 raft_consensus.cc:2749] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.265113  9018 heartbeater.cc:344] Connected to a master server at 127.1.248.126:46043
I20260709 12:15:54.265467  9018 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:54.266424  9018 heartbeater.cc:507] Master 127.1.248.126:46043 requested a full tablet report, sending...
W20260709 12:15:54.292491  8219 consensus_peers.cc:597] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:54.307277  8003 ts_manager.cc:194] Re-registered known tserver with Master: ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:15:54.319140  8862 tablet_bootstrap.cc:492] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.320201  8862 tablet_bootstrap.cc:492] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.321194  8862 ts_tablet_manager.cc:1403] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.002s
I20260709 12:15:54.323892  8862 raft_consensus.cc:359] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.324465  8862 raft_consensus.cc:740] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.325146  8862 consensus_queue.cc:260] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.326782  8862 ts_tablet_manager.cc:1434] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:15:54.327548  8862 tablet_bootstrap.cc:492] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:54.341877  8862 tablet_bootstrap.cc:492] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.342896  8862 tablet_bootstrap.cc:492] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.343590  8862 ts_tablet_manager.cc:1403] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 12:15:54.346140  8862 raft_consensus.cc:359] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.353433  8862 raft_consensus.cc:740] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.354331  8862 consensus_queue.cc:260] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.357666  8862 ts_tablet_manager.cc:1434] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:15:54.358512  8862 tablet_bootstrap.cc:492] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:54.360013  8325 raft_consensus.cc:1275] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:54.362210  8944 consensus_queue.cc:1048] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:54.363508  8219 consensus_peers.cc:597] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:54.400571  8003 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46740
I20260709 12:15:54.409818  8862 tablet_bootstrap.cc:492] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.410933  8862 tablet_bootstrap.cc:492] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.411671  8862 ts_tablet_manager.cc:1403] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.003s
I20260709 12:15:54.414865  8862 raft_consensus.cc:359] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:54.416461  8862 raft_consensus.cc:740] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.411227  9018 heartbeater.cc:499] Master 127.1.248.126:46043 was elected leader, sending a full tablet report...
I20260709 12:15:54.417325  8862 consensus_queue.cc:260] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:54.419474  8862 ts_tablet_manager.cc:1434] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:54.420416  8862 tablet_bootstrap.cc:492] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:54.527040  8917 raft_consensus.cc:3060] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.548465  8917 raft_consensus.cc:1275] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:54.551471  8249 raft_consensus.cc:1275] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:54.553455  8946 consensus_queue.cc:1048] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:54.554594  9000 consensus_queue.cc:1048] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:15:54.580521  8145 consensus_peers.cc:597] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:54.588044  8862 tablet_bootstrap.cc:492] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.589252  8862 tablet_bootstrap.cc:492] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.589936  8862 ts_tablet_manager.cc:1403] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.170s	user 0.057s	sys 0.063s
I20260709 12:15:54.597669  8862 raft_consensus.cc:359] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.598371  8862 raft_consensus.cc:740] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.599027  8862 consensus_queue.cc:260] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.602258  8862 ts_tablet_manager.cc:1434] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:54.603482  8862 tablet_bootstrap.cc:492] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:54.626912  8862 tablet_bootstrap.cc:492] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.627964  8862 tablet_bootstrap.cc:492] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.628561  8862 ts_tablet_manager.cc:1403] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.009s
I20260709 12:15:54.630805  8862 raft_consensus.cc:359] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:54.631461  8862 raft_consensus.cc:740] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.632237  8862 consensus_queue.cc:260] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:54.634657  8862 ts_tablet_manager.cc:1434] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:54.635454  8862 tablet_bootstrap.cc:492] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:54.655917  8862 tablet_bootstrap.cc:492] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.657338  8862 tablet_bootstrap.cc:492] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.657986  8862 ts_tablet_manager.cc:1403] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 12:15:54.660508  8862 raft_consensus.cc:359] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.661190  8862 raft_consensus.cc:740] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.661882  8862 consensus_queue.cc:260] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.664230  8862 ts_tablet_manager.cc:1434] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:15:54.665019  8862 tablet_bootstrap.cc:492] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:54.688001  8862 tablet_bootstrap.cc:492] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.689049  8862 tablet_bootstrap.cc:492] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.689695  8862 ts_tablet_manager.cc:1403] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.005s
W20260709 12:15:54.694758  8145 consensus_peers.cc:597] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:54.694566  8862 raft_consensus.cc:359] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.695302  8862 raft_consensus.cc:740] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.697136  8862 consensus_queue.cc:260] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.699540  8862 ts_tablet_manager.cc:1434] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:15:54.707512  8862 tablet_bootstrap.cc:492] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:54.725248  8862 tablet_bootstrap.cc:492] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.726636  8862 tablet_bootstrap.cc:492] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.727315  8862 ts_tablet_manager.cc:1403] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.000s
I20260709 12:15:54.729984  8862 raft_consensus.cc:359] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:54.730741  8862 raft_consensus.cc:740] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.731600  8862 consensus_queue.cc:260] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
W20260709 12:15:54.732278  8293 consensus_peers.cc:597] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:54.733842  8862 ts_tablet_manager.cc:1434] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:54.734783  8862 tablet_bootstrap.cc:492] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
W20260709 12:15:54.738102  8219 consensus_peers.cc:597] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:54.752444  8862 tablet_bootstrap.cc:492] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.753480  8862 tablet_bootstrap.cc:492] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.754118  8862 ts_tablet_manager.cc:1403] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 12:15:54.756489  8862 raft_consensus.cc:359] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:54.757035  8862 raft_consensus.cc:740] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.757807  8862 consensus_queue.cc:260] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:54.759800  8862 ts_tablet_manager.cc:1434] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:15:54.762629  8862 tablet_bootstrap.cc:492] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:54.775789  8862 tablet_bootstrap.cc:492] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.776746  8862 tablet_bootstrap.cc:492] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.777381  8862 ts_tablet_manager.cc:1403] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:15:54.779832  8862 raft_consensus.cc:359] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.780454  8862 raft_consensus.cc:740] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.781065  8862 consensus_queue.cc:260] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.782640  8862 ts_tablet_manager.cc:1434] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:54.783334  8862 tablet_bootstrap.cc:492] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:54.805629  8862 tablet_bootstrap.cc:492] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.806720  8862 tablet_bootstrap.cc:492] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.807461  8862 ts_tablet_manager.cc:1403] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.004s
I20260709 12:15:54.811472  8862 raft_consensus.cc:359] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.812218  8862 raft_consensus.cc:740] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.812979  8862 consensus_queue.cc:260] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.815948  8862 ts_tablet_manager.cc:1434] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:54.817752  8862 tablet_bootstrap.cc:492] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:54.840683  8862 tablet_bootstrap.cc:492] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.841843  8862 tablet_bootstrap.cc:492] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.842520  8862 ts_tablet_manager.cc:1403] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.001s
I20260709 12:15:54.845346  8862 raft_consensus.cc:359] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.846132  8862 raft_consensus.cc:740] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.847047  8862 consensus_queue.cc:260] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:54.849457  8862 ts_tablet_manager.cc:1434] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:15:54.850400  8862 tablet_bootstrap.cc:492] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:54.953831  8917 raft_consensus.cc:3060] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.980835  8862 tablet_bootstrap.cc:492] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.982438  8862 tablet_bootstrap.cc:492] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:54.983803  8862 ts_tablet_manager.cc:1403] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.134s	user 0.026s	sys 0.015s
I20260709 12:15:54.989801  8862 raft_consensus.cc:359] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:54.992035  8862 raft_consensus.cc:740] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.993471  8862 consensus_queue.cc:260] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:54.997479  8862 ts_tablet_manager.cc:1434] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:15:54.999339  8862 tablet_bootstrap.cc:492] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:55.050062  8916 raft_consensus.cc:3060] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:55.094498  8862 tablet_bootstrap.cc:492] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:55.103842  8862 tablet_bootstrap.cc:492] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:55.104765  8862 ts_tablet_manager.cc:1403] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.106s	user 0.024s	sys 0.019s
I20260709 12:15:55.111836  8862 raft_consensus.cc:359] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:55.112725  8862 raft_consensus.cc:740] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:55.113705  8862 consensus_queue.cc:260] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:55.150144  8862 ts_tablet_manager.cc:1434] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.008s
I20260709 12:15:55.151489  8862 tablet_bootstrap.cc:492] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:55.194732  8862 tablet_bootstrap.cc:492] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:55.195766  8862 tablet_bootstrap.cc:492] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:55.196884  8862 ts_tablet_manager.cc:1403] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.001s
I20260709 12:15:55.204519  8862 raft_consensus.cc:359] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:55.205246  8862 raft_consensus.cc:740] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:55.206159  8862 consensus_queue.cc:260] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:15:55.208494  8862 ts_tablet_manager.cc:1434] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:15:55.209628  8862 tablet_bootstrap.cc:492] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:55.224310  8862 tablet_bootstrap.cc:492] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:55.225405  8862 tablet_bootstrap.cc:492] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:55.226152  8862 ts_tablet_manager.cc:1403] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 12:15:55.227408  8914 raft_consensus.cc:3060] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.228422  8862 raft_consensus.cc:359] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:55.228977  8862 raft_consensus.cc:740] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:55.229637  8862 consensus_queue.cc:260] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:55.231880  8862 ts_tablet_manager.cc:1434] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:15:55.234010  8862 tablet_bootstrap.cc:492] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:55.250480  8862 tablet_bootstrap.cc:492] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:55.251657  8862 tablet_bootstrap.cc:492] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:55.252555  8862 ts_tablet_manager.cc:1403] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:15:55.252983  8914 raft_consensus.cc:3060] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.255576  8862 raft_consensus.cc:359] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:55.256361  8862 raft_consensus.cc:740] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:55.257226  8862 consensus_queue.cc:260] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:55.259115  8862 ts_tablet_manager.cc:1434] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:15:55.260023  8862 tablet_bootstrap.cc:492] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:55.286876  8862 tablet_bootstrap.cc:492] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:55.287967  8862 tablet_bootstrap.cc:492] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:55.289960  8862 ts_tablet_manager.cc:1403] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.009s
I20260709 12:15:55.292974  8862 raft_consensus.cc:359] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:55.293694  8862 raft_consensus.cc:740] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:55.294441  8862 consensus_queue.cc:260] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:55.296996  8862 ts_tablet_manager.cc:1434] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:15:55.297936  8862 tablet_bootstrap.cc:492] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:55.314213  8862 tablet_bootstrap.cc:492] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:55.315275  8862 tablet_bootstrap.cc:492] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:55.316006  8862 ts_tablet_manager.cc:1403] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.006s
I20260709 12:15:55.318650  8862 raft_consensus.cc:359] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:55.319358  8862 raft_consensus.cc:740] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:55.320231  8862 consensus_queue.cc:260] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:55.321825  8862 ts_tablet_manager.cc:1434] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:55.322847  8862 tablet_bootstrap.cc:492] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:55.330137  8917 raft_consensus.cc:3060] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.356923  8862 tablet_bootstrap.cc:492] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:55.358078  8862 tablet_bootstrap.cc:492] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:55.358781  8862 ts_tablet_manager.cc:1403] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.036s	user 0.027s	sys 0.007s
I20260709 12:15:55.361582  8862 raft_consensus.cc:359] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:55.362324  8862 raft_consensus.cc:740] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:55.363232  8862 consensus_queue.cc:260] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:55.365713  8862 ts_tablet_manager.cc:1434] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:15:55.366703  8862 tablet_bootstrap.cc:492] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:55.385383  8862 tablet_bootstrap.cc:492] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:55.386397  8862 tablet_bootstrap.cc:492] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:55.387086  8862 ts_tablet_manager.cc:1403] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 12:15:55.391378  8862 raft_consensus.cc:359] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:55.392107  8862 raft_consensus.cc:740] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:55.392808  8862 consensus_queue.cc:260] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:55.394934  8862 ts_tablet_manager.cc:1434] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:15:55.396498  8862 tablet_bootstrap.cc:492] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:55.415078  8862 tablet_bootstrap.cc:492] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:55.416047  8862 tablet_bootstrap.cc:492] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:55.416712  8862 ts_tablet_manager.cc:1403] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:15:55.419500  8862 raft_consensus.cc:359] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:55.420142  8862 raft_consensus.cc:740] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:55.420794  8862 consensus_queue.cc:260] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:55.422976  8862 ts_tablet_manager.cc:1434] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:55.426831  8862 tablet_bootstrap.cc:492] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:55.448276  8862 tablet_bootstrap.cc:492] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:55.449251  8862 tablet_bootstrap.cc:492] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:55.449860  8862 ts_tablet_manager.cc:1403] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 12:15:55.452373  8862 raft_consensus.cc:359] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:55.452880  8862 raft_consensus.cc:740] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:55.453449  8862 consensus_queue.cc:260] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:15:55.454901  8862 ts_tablet_manager.cc:1434] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:55.456007  8862 tablet_bootstrap.cc:492] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap starting.
I20260709 12:15:55.469542  8862 tablet_bootstrap.cc:492] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:55.470593  8862 tablet_bootstrap.cc:492] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49: Bootstrap complete.
I20260709 12:15:55.471326  8862 ts_tablet_manager.cc:1403] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:15:55.473662  8862 raft_consensus.cc:359] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:55.474329  8862 raft_consensus.cc:740] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Initialized, Role: FOLLOWER
I20260709 12:15:55.474978  8862 consensus_queue.cc:260] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:15:55.477190  8862 ts_tablet_manager.cc:1434] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:55.512281  8917 raft_consensus.cc:3060] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.670238  8914 raft_consensus.cc:3060] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.040401  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:04.103502  8326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c09223f8a6c4f7fb844bce6937e86f4"
dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
mode: GRACEFUL
new_leader_uuid: "66af1447f2c64ebda5448a760d5d7718"
 from {username='slave'} at 127.0.0.1:33106
I20260709 12:16:04.104126  8326 raft_consensus.cc:606] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Received request to transfer leadership to TS 66af1447f2c64ebda5448a760d5d7718
I20260709 12:16:04.115495  8249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d02767f53ba4da998190270c72317fb"
dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:54612
I20260709 12:16:04.116093  8249 raft_consensus.cc:606] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:04.118782  8249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265"
dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:54612
I20260709 12:16:04.119269  8249 raft_consensus.cc:606] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:04.132745  8175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d552c1db4b14ac89628e14ac27582ba"
dest_uuid: "b02838a902c44ea49d8d94181285b20e"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:43336
I20260709 12:16:04.133296  8175 raft_consensus.cc:606] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:04.135995  8249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19"
dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:54612
I20260709 12:16:04.136507  8249 raft_consensus.cc:606] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:04.138957  8249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac5c04cc27ba4d1dbb26c919321fbfa9"
dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
mode: GRACEFUL
new_leader_uuid: "9058059c81534bc4b58c5329d5734dcc"
 from {username='slave'} at 127.0.0.1:54612
I20260709 12:16:04.139573  8249 raft_consensus.cc:606] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Received request to transfer leadership to TS 9058059c81534bc4b58c5329d5734dcc
I20260709 12:16:04.142031  8249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e76a73968afd4c25951776edaf3da243"
dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:54612
I20260709 12:16:04.143836  8249 raft_consensus.cc:606] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:04.144922  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:16:04.146795  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:04.147990  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:04.152375  9084 raft_consensus.cc:993] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:04.153039  9082 raft_consensus.cc:1081] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:04.154623  8916 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44934
I20260709 12:16:04.155231  8916 raft_consensus.cc:493] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:04.155627  8916 raft_consensus.cc:3060] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.162751  8916 raft_consensus.cc:515] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:04.164769  8916 leader_election.cc:290] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 3 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:04.165858  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:04.166844  8249 raft_consensus.cc:3055] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:04.167135  8249 raft_consensus.cc:740] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:04.168020  8249 consensus_queue.cc:260] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:04.169206  8249 raft_consensus.cc:3060] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.167137  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:16:04.172869  8175 raft_consensus.cc:3060] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.179929  8249 raft_consensus.cc:2468] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 3.
I20260709 12:16:04.181475  8859 leader_election.cc:304] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:04.197642  9089 raft_consensus.cc:2804] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:04.193324  8175 raft_consensus.cc:2468] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 3.
I20260709 12:16:04.200425  9089 raft_consensus.cc:697] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:04.202642  9089 consensus_queue.cc:237] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:04.216893  9084 raft_consensus.cc:993] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:04.217475  9082 raft_consensus.cc:1081] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:04.217550  8002 catalog_manager.cc:5697] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 2 to 3, leader changed from 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:04.219334  8914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44934
I20260709 12:16:04.219967  8914 raft_consensus.cc:493] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:04.220343  8914 raft_consensus.cc:3060] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.229255  8914 raft_consensus.cc:515] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:04.232775  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:16:04.233722  8175 raft_consensus.cc:3060] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.232774  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:04.234797  8249 raft_consensus.cc:3055] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:04.235145  8249 raft_consensus.cc:740] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:04.236030  8249 consensus_queue.cc:260] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:04.237275  8249 raft_consensus.cc:3060] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.231635  8914 leader_election.cc:290] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:04.247341  8249 raft_consensus.cc:2468] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:04.247852  8175 raft_consensus.cc:2468] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:04.249042  8859 leader_election.cc:304] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:04.249931  9089 raft_consensus.cc:2804] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:04.250478  9089 raft_consensus.cc:697] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:04.251490  9089 consensus_queue.cc:237] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:04.263862  8002 catalog_manager.cc:5697] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 1 to 2, leader changed from 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:04.268404  9084 raft_consensus.cc:993] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:04.269181  9079 raft_consensus.cc:1081] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:04.270900  8914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d02767f53ba4da998190270c72317fb"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44934
I20260709 12:16:04.271688  8914 raft_consensus.cc:493] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:04.275080  8914 raft_consensus.cc:3060] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.282474  8914 raft_consensus.cc:515] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:04.284418  8914 leader_election.cc:290] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:16:04.285172  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02767f53ba4da998190270c72317fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:04.285569  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02767f53ba4da998190270c72317fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:04.285848  8248 raft_consensus.cc:3055] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:04.286243  8326 raft_consensus.cc:3060] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.286231  8248 raft_consensus.cc:740] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:04.287276  8248 consensus_queue.cc:260] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:04.288863  8248 raft_consensus.cc:3060] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.294719  8326 raft_consensus.cc:2468] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:04.296303  8856 leader_election.cc:304] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:04.297120  8248 raft_consensus.cc:2468] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:04.297168  9089 raft_consensus.cc:2804] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:04.298604  9089 raft_consensus.cc:697] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:04.299357  9089 consensus_queue.cc:237] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:04.310204  8002 catalog_manager.cc:5697] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 1 to 2, leader changed from 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:04.387936  9098 raft_consensus.cc:993] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc: : Instructing follower 66af1447f2c64ebda5448a760d5d7718 to start an election
I20260709 12:16:04.388458  9081 raft_consensus.cc:1081] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Signalling peer 66af1447f2c64ebda5448a760d5d7718 to start an election
I20260709 12:16:04.389861  8248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c09223f8a6c4f7fb844bce6937e86f4"
dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
 from {username='slave'} at 127.0.0.1:59950
I20260709 12:16:04.390314  8248 raft_consensus.cc:493] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:04.390642  8248 raft_consensus.cc:3060] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.395537  8248 raft_consensus.cc:515] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:16:04.397897  8248 leader_election.cc:290] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:16:04.398590  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c09223f8a6c4f7fb844bce6937e86f4" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:16:04.399266  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c09223f8a6c4f7fb844bce6937e86f4" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:04.399276  8178 raft_consensus.cc:3060] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.399935  8326 raft_consensus.cc:3055] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:04.400298  8326 raft_consensus.cc:740] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:16:04.400966  8326 consensus_queue.cc:260] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:16:04.401904  8326 raft_consensus.cc:3060] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.404724  8178 raft_consensus.cc:2468] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 2.
I20260709 12:16:04.405869  8222 leader_election.cc:304] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:16:04.406529  9082 raft_consensus.cc:2804] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:04.406919  8326 raft_consensus.cc:2468] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 2.
I20260709 12:16:04.407051  9082 raft_consensus.cc:697] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:04.407966  9082 consensus_queue.cc:237] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:16:04.417356  8002 catalog_manager.cc:5697] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 1 to 2, leader changed from 9058059c81534bc4b58c5329d5734dcc (127.1.248.68) to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:04.444283  9011 raft_consensus.cc:993] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:04.444900  9083 raft_consensus.cc:1081] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:04.446494  8914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d552c1db4b14ac89628e14ac27582ba"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44944
I20260709 12:16:04.447032  8914 raft_consensus.cc:493] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:04.447345  8914 raft_consensus.cc:3060] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.447607  9084 raft_consensus.cc:993] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:04.448151  9082 raft_consensus.cc:1081] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:04.449523  8917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e76a73968afd4c25951776edaf3da243"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44934
I20260709 12:16:04.450088  8917 raft_consensus.cc:493] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:04.450372  8917 raft_consensus.cc:3060] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.452733  8914 raft_consensus.cc:515] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:04.454432  8914 leader_election.cc:290] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:04.455166  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d552c1db4b14ac89628e14ac27582ba" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:16:04.455562  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d552c1db4b14ac89628e14ac27582ba" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:04.455464  8917 raft_consensus.cc:515] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:04.456205  8248 raft_consensus.cc:3060] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.455788  8178 raft_consensus.cc:3055] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:04.456697  8178 raft_consensus.cc:740] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:16:04.457422  8178 consensus_queue.cc:260] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:04.458706  8178 raft_consensus.cc:3060] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.461306  8917 leader_election.cc:290] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:16:04.461207  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76a73968afd4c25951776edaf3da243" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:04.462154  8249 raft_consensus.cc:3055] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:04.462467  8249 raft_consensus.cc:740] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:04.463240  8248 raft_consensus.cc:2468] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:04.464705  8859 leader_election.cc:304] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:04.463183  8249 consensus_queue.cc:260] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:04.464983  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76a73968afd4c25951776edaf3da243" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:04.465571  8326 raft_consensus.cc:3060] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.465919  8249 raft_consensus.cc:3060] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.466478  8178 raft_consensus.cc:2468] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:04.467212  9089 raft_consensus.cc:2804] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:04.467765  9089 raft_consensus.cc:697] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:04.468577  9089 consensus_queue.cc:237] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:04.472381  8326 raft_consensus.cc:2468] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:04.472827  8249 raft_consensus.cc:2468] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:04.473632  8856 leader_election.cc:304] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:04.474877  9089 raft_consensus.cc:2804] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:04.475405  9089 raft_consensus.cc:697] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:04.476317  9089 consensus_queue.cc:237] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:04.481550  8002 catalog_manager.cc:5697] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 1 to 2, leader changed from b02838a902c44ea49d8d94181285b20e (127.1.248.66) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:04.497388  8002 catalog_manager.cc:5697] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 1 to 2, leader changed from 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:04.651121  8178 raft_consensus.cc:1275] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.652196  9089 consensus_queue.cc:1048] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:04.664189  8249 raft_consensus.cc:1275] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.666103  9089 consensus_queue.cc:1048] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:04.680708  9082 raft_consensus.cc:993] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718: : Instructing follower 9058059c81534bc4b58c5329d5734dcc to start an election
I20260709 12:16:04.681231  9082 raft_consensus.cc:1081] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Signalling peer 9058059c81534bc4b58c5329d5734dcc to start an election
I20260709 12:16:04.683112  8324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac5c04cc27ba4d1dbb26c919321fbfa9"
dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
 from {username='slave'} at 127.0.0.1:60250
I20260709 12:16:04.683679  8324 raft_consensus.cc:493] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:04.684034  8324 raft_consensus.cc:3060] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.696054  8324 raft_consensus.cc:515] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:16:04.698573  8324 leader_election.cc:290] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:04.700048  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5c04cc27ba4d1dbb26c919321fbfa9" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:16:04.700233  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac5c04cc27ba4d1dbb26c919321fbfa9" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:04.700666  8178 raft_consensus.cc:3060] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.700934  8254 raft_consensus.cc:3055] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:04.701365  8254 raft_consensus.cc:740] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:04.702204  8254 consensus_queue.cc:260] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:16:04.703500  8254 raft_consensus.cc:3060] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.706017  8178 raft_consensus.cc:2468] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 2.
I20260709 12:16:04.707059  8296 leader_election.cc:304] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:16:04.707753  9081 raft_consensus.cc:2804] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:04.708144  9081 raft_consensus.cc:697] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:16:04.708760  8254 raft_consensus.cc:2468] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 2.
I20260709 12:16:04.708833  9081 consensus_queue.cc:237] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:16:04.718228  8003 catalog_manager.cc:5697] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 1 to 2, leader changed from 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67) to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 2 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:04.773767  8178 raft_consensus.cc:1275] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:04.775069  9089 consensus_queue.cc:1048] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:04.787817  8254 raft_consensus.cc:1275] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:04.795053  9090 consensus_queue.cc:1048] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:04.825819  8254 raft_consensus.cc:1275] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.826980  9090 consensus_queue.cc:1048] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:04.838750  8324 raft_consensus.cc:1275] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.840605  9090 consensus_queue.cc:1048] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:04.896620  8254 raft_consensus.cc:1275] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.898010  9090 consensus_queue.cc:1048] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:04.912498  8178 raft_consensus.cc:1275] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.914047  9110 consensus_queue.cc:1048] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:04.932263  8249 raft_consensus.cc:1275] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.935158  8178 raft_consensus.cc:1275] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.935913  9110 consensus_queue.cc:1048] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:04.937578  9079 consensus_queue.cc:1048] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:04.954542  8324 raft_consensus.cc:1275] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.957218  8324 raft_consensus.cc:1275] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:05.002831  9079 consensus_queue.cc:1048] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:16:05.014424  9089 consensus_queue.cc:1048] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:05.236217  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:05.243191  8254 raft_consensus.cc:1275] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:05.245230  9121 consensus_queue.cc:1048] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:16:05.249522  8219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:34153, user_credentials={real_user=slave}} blocked reactor thread for 54935.8us
I20260709 12:16:05.317005  8175 raft_consensus.cc:1275] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:05.320276  9081 consensus_queue.cc:1048] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:05.375741  8254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14a6107537934605a85ad9af15618125"
dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:54612
I20260709 12:16:05.376658  8254 raft_consensus.cc:606] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:05.381160  8254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad"
dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:54612
I20260709 12:16:05.382102  8254 raft_consensus.cc:606] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:05.387861  8324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c"
dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:33106
I20260709 12:16:05.388284  8324 raft_consensus.cc:606] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:05.391484  8254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae828d825348490eb62b74680a762deb"
dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:54612
I20260709 12:16:05.392081  8254 raft_consensus.cc:606] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:05.394891  8175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb"
dest_uuid: "b02838a902c44ea49d8d94181285b20e"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:43336
I20260709 12:16:05.395362  8175 raft_consensus.cc:606] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:05.404181  8254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb"
dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:54612
I20260709 12:16:05.404786  8254 raft_consensus.cc:606] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:05.406687  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:16:05.408528  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:05.409601  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:05.509192  9083 raft_consensus.cc:993] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:05.509902  9102 raft_consensus.cc:1081] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:05.511736  8917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44944
I20260709 12:16:05.512305  8917 raft_consensus.cc:493] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.512691  8917 raft_consensus.cc:3060] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.519701  8917 raft_consensus.cc:515] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:05.521799  8917 leader_election.cc:290] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:05.522370  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:05.523147  8324 raft_consensus.cc:3060] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.522450  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:16:05.523938  8175 raft_consensus.cc:3055] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:05.524230  8175 raft_consensus.cc:740] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:16:05.525100  8175 consensus_queue.cc:260] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:05.526384  8175 raft_consensus.cc:3060] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.529436  8324 raft_consensus.cc:2468] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:05.530696  8856 leader_election.cc:304] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:05.531500  9110 raft_consensus.cc:2804] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:05.531960  9110 raft_consensus.cc:697] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:05.532759  8175 raft_consensus.cc:2468] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:05.532990  9110 consensus_queue.cc:237] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:05.544036  8004 catalog_manager.cc:5697] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 1 to 2, leader changed from b02838a902c44ea49d8d94181285b20e (127.1.248.66) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:05.616580  9079 raft_consensus.cc:993] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:05.617189  9084 raft_consensus.cc:1081] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:05.618634  8916 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae828d825348490eb62b74680a762deb"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44934
I20260709 12:16:05.619027  8916 raft_consensus.cc:493] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.619261  8916 raft_consensus.cc:3060] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.627013  8916 raft_consensus.cc:515] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:05.629912  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae828d825348490eb62b74680a762deb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:16:05.630482  8178 raft_consensus.cc:3060] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.630548  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae828d825348490eb62b74680a762deb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:05.631229  8254 raft_consensus.cc:3055] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:05.631549  8254 raft_consensus.cc:740] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:05.632345  8254 consensus_queue.cc:260] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:05.633323  8254 raft_consensus.cc:3060] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.630441  8916 leader_election.cc:290] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:05.638347  8178 raft_consensus.cc:2468] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:05.639631  8859 leader_election.cc:304] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:05.640354  9110 raft_consensus.cc:2804] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:05.640858  9110 raft_consensus.cc:697] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:05.641834  9110 consensus_queue.cc:237] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:05.642160  8254 raft_consensus.cc:2468] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:05.652469  8004 catalog_manager.cc:5697] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 1 to 2, leader changed from 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:05.671196  9079 raft_consensus.cc:993] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:05.671687  9079 raft_consensus.cc:1081] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:05.673377  8917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14a6107537934605a85ad9af15618125"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44934
I20260709 12:16:05.674103  8917 raft_consensus.cc:493] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.674480  8917 raft_consensus.cc:3060] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.680017  8917 raft_consensus.cc:515] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:05.681885  8917 leader_election.cc:290] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:05.682914  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a6107537934605a85ad9af15618125" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:16:05.683260  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a6107537934605a85ad9af15618125" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:05.683553  8178 raft_consensus.cc:3060] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.683920  8254 raft_consensus.cc:3055] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:05.684218  8254 raft_consensus.cc:740] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:05.685000  8254 consensus_queue.cc:260] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:05.686484  8254 raft_consensus.cc:3060] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.689435  8178 raft_consensus.cc:2468] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:05.690419  8859 leader_election.cc:304] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:05.691093  9110 raft_consensus.cc:2804] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:05.691562  9110 raft_consensus.cc:697] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:05.692093  8254 raft_consensus.cc:2468] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:05.692476  9110 consensus_queue.cc:237] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:05.701892  8004 catalog_manager.cc:5697] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 1 to 2, leader changed from 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:05.734867  9121 raft_consensus.cc:993] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:05.735590  9126 raft_consensus.cc:1081] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:05.737207  8917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44936
I20260709 12:16:05.737784  8917 raft_consensus.cc:493] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.738148  8917 raft_consensus.cc:3060] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.744755  8917 raft_consensus.cc:515] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:05.746793  8917 leader_election.cc:290] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 3 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:16:05.747308  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:05.748013  8254 raft_consensus.cc:3060] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.748925  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:05.749540  8326 raft_consensus.cc:3055] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:05.749806  8326 raft_consensus.cc:740] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:16:05.750552  8326 consensus_queue.cc:260] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:05.751761  8326 raft_consensus.cc:3060] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.754851  8254 raft_consensus.cc:2468] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 3.
I20260709 12:16:05.756032  8859 leader_election.cc:304] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:05.756847  9110 raft_consensus.cc:2804] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:05.757328  9110 raft_consensus.cc:697] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:05.757884  8326 raft_consensus.cc:2468] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 3.
I20260709 12:16:05.758301  9110 consensus_queue.cc:237] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:05.769017  8004 catalog_manager.cc:5697] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 2 to 3, leader changed from 9058059c81534bc4b58c5329d5734dcc (127.1.248.68) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:05.792035  9084 raft_consensus.cc:993] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:05.792538  9079 raft_consensus.cc:1081] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:05.793928  8917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44934
I20260709 12:16:05.794502  8917 raft_consensus.cc:493] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.794863  8917 raft_consensus.cc:3060] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.800338  8917 raft_consensus.cc:515] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:05.802142  8917 leader_election.cc:290] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:05.802853  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:16:05.803169  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:05.803508  8178 raft_consensus.cc:3060] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.803875  8254 raft_consensus.cc:3055] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:05.804251  8254 raft_consensus.cc:740] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:05.805058  8254 consensus_queue.cc:260] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:05.806304  8254 raft_consensus.cc:3060] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.812384  8178 raft_consensus.cc:2468] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:05.813364  8859 leader_election.cc:304] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:05.814085  9110 raft_consensus.cc:2804] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:05.814560  9110 raft_consensus.cc:697] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:05.815526  9110 consensus_queue.cc:237] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:05.817706  8254 raft_consensus.cc:2468] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:05.827884  8004 catalog_manager.cc:5697] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 1 to 2, leader changed from 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:05.913208  9120 raft_consensus.cc:993] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:05.913774  9079 raft_consensus.cc:1081] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:05.915395  8917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44934
I20260709 12:16:05.916095  8917 raft_consensus.cc:493] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.916543  8917 raft_consensus.cc:3060] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.923094  8917 raft_consensus.cc:515] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:05.926966  8917 leader_election.cc:290] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 3 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:16:05.927064  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:05.927785  8254 raft_consensus.cc:3055] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:05.928059  8254 raft_consensus.cc:740] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:05.928042  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:05.929047  8254 consensus_queue.cc:260] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:05.929487  8324 raft_consensus.cc:3060] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.930711  8254 raft_consensus.cc:3060] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.936523  8324 raft_consensus.cc:2468] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 3.
I20260709 12:16:05.937525  8254 raft_consensus.cc:2468] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 3.
I20260709 12:16:05.937585  8856 leader_election.cc:304] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:05.938580  9110 raft_consensus.cc:2804] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:05.939034  9110 raft_consensus.cc:697] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:05.940025  9110 consensus_queue.cc:237] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:05.950253  8004 catalog_manager.cc:5697] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 2 to 3, leader changed from 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:06.062734  8178 raft_consensus.cc:1275] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.063854  9110 consensus_queue.cc:1048] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:06.076141  8324 raft_consensus.cc:1275] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.077782  9089 consensus_queue.cc:1048] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:06.114626  8254 raft_consensus.cc:1275] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.117547  9110 consensus_queue.cc:1048] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:06.128994  8254 raft_consensus.cc:1275] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.135989  9138 consensus_queue.cc:1048] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:16:06.157421  8330 raft_consensus.cc:1275] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:06.159492  9138 consensus_queue.cc:1048] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:06.179132  8178 raft_consensus.cc:1275] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.182116  8253 raft_consensus.cc:1275] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:06.186336  9110 consensus_queue.cc:1048] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:06.187734  9089 consensus_queue.cc:1048] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:06.190850  8175 raft_consensus.cc:1275] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.193848  9143 consensus_queue.cc:1048] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:06.321277  8175 raft_consensus.cc:1275] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.322551  9143 consensus_queue.cc:1048] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:06.332037  8253 raft_consensus.cc:1275] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.336066  9089 consensus_queue.cc:1048] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:06.366384  8253 raft_consensus.cc:1275] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:06.367642  9089 consensus_queue.cc:1048] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:06.379614  8324 raft_consensus.cc:1275] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:06.381198  9089 consensus_queue.cc:1048] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:06.450840  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:07.397778  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212"
dest_uuid: "b02838a902c44ea49d8d94181285b20e"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:43336
I20260709 12:16:07.398413  8178 raft_consensus.cc:606] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:07.438483  9177 raft_consensus.cc:493] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b02838a902c44ea49d8d94181285b20e)
I20260709 12:16:07.439146  9177 raft_consensus.cc:515] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } }
I20260709 12:16:07.441442  9177 leader_election.cc:290] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:07.445777  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64ebcb5be64da88badd16aa178cd4a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:07.448975  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f64ebcb5be64da88badd16aa178cd4a" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:16:07.450958  8296 leader_election.cc:304] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e
I20260709 12:16:07.451699  9177 raft_consensus.cc:2749] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:07.486629  9172 raft_consensus.cc:493] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66af1447f2c64ebda5448a760d5d7718)
I20260709 12:16:07.487254  9172 raft_consensus.cc:515] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:07.489526  9172 leader_election.cc:290] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:16:07.491994  9172 raft_consensus.cc:493] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66af1447f2c64ebda5448a760d5d7718)
I20260709 12:16:07.482409  9161 raft_consensus.cc:493] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b02838a902c44ea49d8d94181285b20e)
I20260709 12:16:07.493697  9161 raft_consensus.cc:515] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:07.499011  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "642643c6b8a74401860aad4b969f9131" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:16:07.492610  9172 raft_consensus.cc:515] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:07.506091  9161 leader_election.cc:290] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:07.507650  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431"
dest_uuid: "b02838a902c44ea49d8d94181285b20e"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:43336
I20260709 12:16:07.508145  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:16:07.507961  9172 leader_election.cc:290] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:16:07.508491  8174 raft_consensus.cc:606] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 2 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:07.510818  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586406114304e5a9209b76096a2f1ba" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:16:07.519044  9175 raft_consensus.cc:993] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:07.519577  9168 raft_consensus.cc:1081] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:07.519645  8330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6dee16badf54437bc48a2f623d62066"
dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
mode: GRACEFUL
new_leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:33106
I20260709 12:16:07.520260  8330 raft_consensus.cc:606] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Received request to transfer leadership to TS ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:07.522305  8918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44944
I20260709 12:16:07.522912  8918 raft_consensus.cc:493] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:07.523279  8918 raft_consensus.cc:3060] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:07.528215  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:16:07.530514  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:07.531037  8918 raft_consensus.cc:515] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:07.531908  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:07.533872  8918 leader_election.cc:290] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:07.536011  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:07.536643  8330 raft_consensus.cc:3060] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:07.544062  8330 raft_consensus.cc:2468] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:07.547214  8856 leader_election.cc:304] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:07.548187  9172 raft_consensus.cc:2804] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:07.548933  9172 raft_consensus.cc:697] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:07.549882  9172 consensus_queue.cc:237] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:07.566825  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "642643c6b8a74401860aad4b969f9131" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:07.567315  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586406114304e5a9209b76096a2f1ba" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:07.572470  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:16:07.573057  8180 raft_consensus.cc:3055] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:07.573342  8180 raft_consensus.cc:740] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:16:07.574270  8180 consensus_queue.cc:260] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:07.575598  8180 raft_consensus.cc:3060] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:07.583559  8180 raft_consensus.cc:2468] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:07.586125  8859 leader_election.cc:304] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
I20260709 12:16:07.589349  8859 leader_election.cc:304] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc
I20260709 12:16:07.590682  9143 raft_consensus.cc:2749] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:07.590979  9145 raft_consensus.cc:2749] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:07.607474  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" is_pre_election: true
I20260709 12:16:07.618494  8293 leader_election.cc:304] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:07.619939  9160 raft_consensus.cc:2749] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:07.630054  8003 catalog_manager.cc:5697] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 1 to 2, leader changed from b02838a902c44ea49d8d94181285b20e (127.1.248.66) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:07.706264  9165 raft_consensus.cc:993] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:07.706804  9169 raft_consensus.cc:1081] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 2 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:07.708150  8918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44944
I20260709 12:16:07.708599  8918 raft_consensus.cc:493] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:07.708846  8918 raft_consensus.cc:3060] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.714547  8918 raft_consensus.cc:515] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:07.716239  8918 leader_election.cc:290] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 3 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:07.716915  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:07.717307  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:16:07.717548  8327 raft_consensus.cc:3060] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.717868  8180 raft_consensus.cc:3055] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:07.718127  8180 raft_consensus.cc:740] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:16:07.718740  8180 consensus_queue.cc:260] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:07.719645  8180 raft_consensus.cc:3060] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.722684  8327 raft_consensus.cc:2468] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 3.
I20260709 12:16:07.723639  8856 leader_election.cc:304] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:07.724318  9143 raft_consensus.cc:2804] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:07.724368  8180 raft_consensus.cc:2468] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 3.
I20260709 12:16:07.724916  9143 raft_consensus.cc:697] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:07.725785  9143 consensus_queue.cc:237] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:07.737365  8003 catalog_manager.cc:5697] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 2 to 3, leader changed from b02838a902c44ea49d8d94181285b20e (127.1.248.66) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 3 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:07.780922  9160 raft_consensus.cc:993] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc: : Instructing follower ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:07.781402  9161 raft_consensus.cc:1081] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Signalling peer ee6a7bcc0bc742dda6ce79fbd49d6e49 to start an election
I20260709 12:16:07.782821  8918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6dee16badf54437bc48a2f623d62066"
dest_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49"
 from {username='slave'} at 127.0.0.1:44936
I20260709 12:16:07.783309  8918 raft_consensus.cc:493] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:07.783669  8918 raft_consensus.cc:3060] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:07.791488  8918 raft_consensus.cc:515] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:07.793282  8918 leader_election.cc:290] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023)
I20260709 12:16:07.793910  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dee16badf54437bc48a2f623d62066" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:07.794165  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dee16badf54437bc48a2f623d62066" candidate_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:07.794646  8252 raft_consensus.cc:3060] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:07.794756  8327 raft_consensus.cc:3055] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:07.795271  8327 raft_consensus.cc:740] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:16:07.796177  8327 consensus_queue.cc:260] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:07.797601  8327 raft_consensus.cc:3060] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:07.804282  8327 raft_consensus.cc:2468] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:07.808604  8252 raft_consensus.cc:2468] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6a7bcc0bc742dda6ce79fbd49d6e49 in term 2.
I20260709 12:16:07.814239  8856 leader_election.cc:304] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49; no voters: 
I20260709 12:16:07.815121  9143 raft_consensus.cc:2804] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:07.815629  9143 raft_consensus.cc:697] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Becoming Leader. State: Replica: ee6a7bcc0bc742dda6ce79fbd49d6e49, State: Running, Role: LEADER
I20260709 12:16:07.816538  9143 consensus_queue.cc:237] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:07.834086  8003 catalog_manager.cc:5697] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 reported cstate change: term changed from 1 to 2, leader changed from 9058059c81534bc4b58c5329d5734dcc (127.1.248.68) to ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:07.943313  8180 raft_consensus.cc:1275] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.944649  9138 consensus_queue.cc:1048] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.962949  8327 raft_consensus.cc:1275] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.964381  9138 consensus_queue.cc:1048] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:08.075366  8983 debug-util.cc:398] Leaking SignalData structure 0x7b0800294b00 after lost signal to thread 2020
W20260709 12:16:08.076665  8983 debug-util.cc:398] Leaking SignalData structure 0x7b080015cb20 after lost signal to thread 8039
W20260709 12:16:08.077689  8983 debug-util.cc:398] Leaking SignalData structure 0x7b080020a620 after lost signal to thread 8206
W20260709 12:16:08.078572  8983 debug-util.cc:398] Leaking SignalData structure 0x7b0800021ca0 after lost signal to thread 8280
W20260709 12:16:08.079630  8983 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2c00 after lost signal to thread 8354
W20260709 12:16:08.080699  8983 debug-util.cc:398] Leaking SignalData structure 0x7b080010d400 after lost signal to thread 9002
I20260709 12:16:08.122156  8327 raft_consensus.cc:1275] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:08.123757  9143 consensus_queue.cc:1048] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:08.148914  8174 raft_consensus.cc:1275] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:08.150662  9172 consensus_queue.cc:1048] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:08.221768  8327 raft_consensus.cc:1275] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:08.223323  9194 consensus_queue.cc:1048] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:08.236783  8252 raft_consensus.cc:1275] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Refusing update from remote peer ee6a7bcc0bc742dda6ce79fbd49d6e49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:08.238700  9143 consensus_queue.cc:1048] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:08.420801  8351 debug-util.cc:398] Leaking SignalData structure 0x7b080031bb40 after lost signal to thread 2020
W20260709 12:16:08.422024  8351 debug-util.cc:398] Leaking SignalData structure 0x7b080020b400 after lost signal to thread 8039
W20260709 12:16:08.423342  8351 debug-util.cc:398] Leaking SignalData structure 0x7b08003e15c0 after lost signal to thread 8206
W20260709 12:16:08.424666  8351 debug-util.cc:398] Leaking SignalData structure 0x7b080018f2e0 after lost signal to thread 8280
W20260709 12:16:08.425796  8351 debug-util.cc:398] Leaking SignalData structure 0x7b0800344b20 after lost signal to thread 8354
W20260709 12:16:08.430112  8351 debug-util.cc:398] Leaking SignalData structure 0x7b0800109a60 after lost signal to thread 9002
W20260709 12:16:08.430464  8351 debug-util.cc:398] Leaking SignalData structure 0x7b080034ba60 after lost signal to thread 9018
I20260709 12:16:08.608090  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:08.683502  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:08.703919  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:08.704734  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:08.785833  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:08.847734  2017 tablet_server.cc:179] TabletServer@127.1.248.65:34153 shutting down...
W20260709 12:16:08.865859  8293 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 190 similar messages]
W20260709 12:16:08.914211  8293 consensus_peers.cc:597] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:08.964370  8145 consensus_peers.cc:597] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:08.965929  8145 consensus_peers.cc:597] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:08.972241  8145 consensus_peers.cc:597] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:08.980434  8145 consensus_peers.cc:597] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:08.986266  8145 consensus_peers.cc:597] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:09.004521  8145 consensus_peers.cc:597] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:09.005496  8145 consensus_peers.cc:597] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.010006  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:09.014137  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.015342  2017 raft_consensus.cc:2243] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.016111  2017 raft_consensus.cc:2272] T 78aedf68b2244597bed9a1046869df3e P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.019492  8219 consensus_peers.cc:597] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.023991  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.025331  2017 raft_consensus.cc:2243] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.025943  2017 raft_consensus.cc:2272] T 2f7f51cbe52e4c4c99fc31b081f4372a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.027697  8293 consensus_peers.cc:597] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.029435  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.032343  2017 raft_consensus.cc:2243] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.032930  2017 raft_consensus.cc:2272] T 0cfe39df11664509bf085d1f7cc21724 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.033066  8219 consensus_peers.cc:597] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.036417  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.037483  2017 raft_consensus.cc:2243] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.038156  2017 raft_consensus.cc:2272] T cc189c974f5542a682c54f9bde0483a1 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.042507  8293 consensus_peers.cc:597] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.055253  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.059824  2017 raft_consensus.cc:2243] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.060520  2017 raft_consensus.cc:2272] T e6fc1fe247f341ed91a83cf61e4529f3 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.063123  8293 consensus_peers.cc:597] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.064069  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.077630  2017 raft_consensus.cc:2243] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:09.078773  2017 raft_consensus.cc:2272] T 64f48f739c824c7f8ba5295113a92212 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.084105  8293 consensus_peers.cc:597] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.086251  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.087374  2017 raft_consensus.cc:2243] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.088579  2017 raft_consensus.cc:2272] T 1c8e6e90970441fdad02bb1119456dea P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.091951  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.092988  2017 raft_consensus.cc:2243] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.093617  2017 raft_consensus.cc:2272] T eb422c1b757045358366d25d227e95ec P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.094102  8293 consensus_peers.cc:597] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.097098  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.098115  2017 raft_consensus.cc:2243] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:09.099159  2017 raft_consensus.cc:2272] T e76a73968afd4c25951776edaf3da243 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.102713  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.103891  2017 raft_consensus.cc:2243] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.104532  2017 raft_consensus.cc:2272] T 9895082ba16e461b8ca83550f065f98c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.108403  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.109428  2017 raft_consensus.cc:2243] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:09.110595  2017 raft_consensus.cc:2272] T d6dee16badf54437bc48a2f623d62066 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.110858  8145 consensus_peers.cc:597] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.114531  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.115572  2017 raft_consensus.cc:2243] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.116134  2017 raft_consensus.cc:2272] T da3dcd2b92f84d1899b354f41bc21714 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.117865  8219 consensus_peers.cc:597] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:09.118556  8219 consensus_peers.cc:597] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.119398  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.120376  2017 raft_consensus.cc:2243] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:16:09.120656  8219 consensus_peers.cc:597] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.121490  2017 raft_consensus.cc:2272] T 6c24a2a517f14bd4a4c0887718468265 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.125002  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.125989  2017 raft_consensus.cc:2243] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.126573  2017 raft_consensus.cc:2272] T a9c3e4c9802147f59a86d193db6f981a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.130002  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.130954  2017 raft_consensus.cc:2243] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.131631  2017 raft_consensus.cc:2272] T 676232727c4f42c28fd5608fbeb3f634 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.132367  8219 consensus_peers.cc:597] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.135196  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.136224  2017 raft_consensus.cc:2243] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:09.137246  2017 raft_consensus.cc:2272] T ae828d825348490eb62b74680a762deb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.140267  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.141186  2017 raft_consensus.cc:2243] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:09.142226  2017 raft_consensus.cc:2272] T 2d02767f53ba4da998190270c72317fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.143014  8219 consensus_peers.cc:597] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.145640  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.146749  2017 raft_consensus.cc:2243] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.147418  2017 raft_consensus.cc:2272] T 3cff31edfc694b9b94b47e932c3940f9 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.149842  8293 consensus_peers.cc:597] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.150851  2017 tablet_replica.cc:333] stopping tablet replica
W20260709 12:16:09.151281  8293 consensus_peers.cc:597] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.151852  2017 raft_consensus.cc:2243] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.152523  2017 raft_consensus.cc:2272] T 279bf9ef43054f1e83e60ed4dd074176 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.155961  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.156867  2017 raft_consensus.cc:2243] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.157492  2017 raft_consensus.cc:2272] T acd20020a2924e31be0f16636e76efa7 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.160950  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.161952  2017 raft_consensus.cc:2243] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.162535  2017 raft_consensus.cc:2272] T 4df02ba9540747b5a8c99951df903897 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.165681  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.166518  2017 raft_consensus.cc:2243] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.167084  2017 raft_consensus.cc:2272] T 97dbd2f663574037a43ecf0219ef1c48 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.170084  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.170974  2017 raft_consensus.cc:2243] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.171617  2017 raft_consensus.cc:2272] T 385f9fa3d1004f2f820b3f26592cbd1a P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.174815  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.175711  2017 raft_consensus.cc:2243] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:09.176810  2017 raft_consensus.cc:2272] T 14a6107537934605a85ad9af15618125 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.179883  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.180801  2017 raft_consensus.cc:2243] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.181380  2017 raft_consensus.cc:2272] T 544e8410d33f4f21851df79c3d646d76 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.185237  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.186080  2017 raft_consensus.cc:2243] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.186666  2017 raft_consensus.cc:2272] T 642643c6b8a74401860aad4b969f9131 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.189603  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.190363  2017 raft_consensus.cc:2243] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:09.191285  2017 raft_consensus.cc:2272] T c92346b4a0134497acbb92c4f885a4fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.193928  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.194674  2017 raft_consensus.cc:2243] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.195156  2017 raft_consensus.cc:2272] T f0b09c2f447345459284f96e85c1af52 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.198010  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.198742  2017 raft_consensus.cc:2243] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.199256  2017 raft_consensus.cc:2272] T a85f56f39a20454d8ddeffad93e935a8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.202356  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.203246  2017 raft_consensus.cc:2243] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.203807  2017 raft_consensus.cc:2272] T 6da9a7d0425b4dd09d6615567d1fc738 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.207137  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.207986  2017 raft_consensus.cc:2243] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.208557  2017 raft_consensus.cc:2272] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.211892  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.212664  2017 raft_consensus.cc:2243] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.213183  2017 raft_consensus.cc:2272] T 008c85279d534f24a2dd08e7bbd167cb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.215860  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.216715  2017 raft_consensus.cc:2243] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.217314  2017 raft_consensus.cc:2272] T 879b385c0a08435a943ff307ac8fb275 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.220345  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.221156  2017 raft_consensus.cc:2243] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.221735  2017 raft_consensus.cc:2272] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.224819  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.225616  2017 raft_consensus.cc:2243] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:09.226575  2017 raft_consensus.cc:2272] T 2dbe350f2e414cbf85acf51562f960ad P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.229314  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.230062  2017 raft_consensus.cc:2243] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:09.231011  2017 raft_consensus.cc:2272] T 97e9145ea32c46a686276c9ecfb4ee19 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.233750  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.234498  2017 raft_consensus.cc:2243] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:09.234663  8145 consensus_peers.cc:597] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.235021  2017 raft_consensus.cc:2272] T 4586406114304e5a9209b76096a2f1ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.236977  8219 consensus_peers.cc:597] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.238391  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.239236  2017 raft_consensus.cc:2243] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.239778  2017 raft_consensus.cc:2272] T 8d921491df994357a386e8d378ccfd09 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.242933  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.243703  2017 raft_consensus.cc:2243] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:09.244652  2017 raft_consensus.cc:2272] T c8349f261931413588e7bbd0421e52fb P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.247468  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.248153  2017 raft_consensus.cc:2243] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:09.249073  2017 raft_consensus.cc:2272] T 7f68e739edae4a70821a0646a5db9431 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.251832  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.252633  2017 raft_consensus.cc:2243] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.253144  2017 raft_consensus.cc:2272] T 710d05d6f10242a7b13561b37f5eae08 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.256294  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.257052  2017 raft_consensus.cc:2243] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:09.258126  2017 raft_consensus.cc:2272] T 6d552c1db4b14ac89628e14ac27582ba P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.262055  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.262817  2017 raft_consensus.cc:2243] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.263299  2017 raft_consensus.cc:2272] T ed7d8ef97f464b0db4ddc179e9202157 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.266177  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.266891  2017 raft_consensus.cc:2243] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:09.268357  2017 raft_consensus.cc:2272] T 7bf040fefc954e70b0098614c1c1a09c P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:09.271186  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:09.271840  2017 raft_consensus.cc:2243] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:09.272476  2017 raft_consensus.cc:2272] T 7014425193644424abe3ad50857b4051 P ee6a7bcc0bc742dda6ce79fbd49d6e49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:09.365371  8219 consensus_peers.cc:597] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:09.367239  8219 consensus_peers.cc:597] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:09.385807  8145 consensus_peers.cc:597] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:09.386412  8145 consensus_peers.cc:597] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:09.388777  8145 consensus_peers.cc:597] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:09.481491  8293 consensus_peers.cc:597] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:10.033437  9213 raft_consensus.cc:493] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.033946  9213 raft_consensus.cc:515] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:10.036162  9213 leader_election.cc:290] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:10.037783  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:16:10.042200  8293 leader_election.cc:336] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.042621  8293 leader_election.cc:304] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.044807  9214 raft_consensus.cc:2749] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:10.109030  9165 raft_consensus.cc:493] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.109817  9165 raft_consensus.cc:515] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.115545  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae828d825348490eb62b74680a762deb" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:10.117383  9165 leader_election.cc:290] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
W20260709 12:16:10.117820  8145 leader_election.cc:336] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.118264  8145 leader_election.cc:304] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.119340  9165 raft_consensus.cc:2749] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:10.187062  9213 raft_consensus.cc:493] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.187682  9213 raft_consensus.cc:515] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.190706  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dee16badf54437bc48a2f623d62066" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:10.190974  9213 leader_election.cc:290] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
W20260709 12:16:10.197774  8293 leader_election.cc:336] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.198329  8293 leader_election.cc:304] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.199542  9213 raft_consensus.cc:2749] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:10.210474  9165 raft_consensus.cc:493] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.211120  9165 raft_consensus.cc:515] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.214187  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:10.214641  9165 leader_election.cc:290] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:10.217166  9213 raft_consensus.cc:493] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.217831  9213 raft_consensus.cc:515] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.220587  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:10.223006  9213 leader_election.cc:290] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
W20260709 12:16:10.221633  8145 leader_election.cc:336] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.225286  9201 raft_consensus.cc:493] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.227231  9201 raft_consensus.cc:515] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.228686  9206 raft_consensus.cc:493] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.229475  9201 leader_election.cc:290] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:10.229270  9206 raft_consensus.cc:515] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.231173  8145 leader_election.cc:304] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b02838a902c44ea49d8d94181285b20e; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.233434  9215 raft_consensus.cc:2749] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:10.234441  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:16:10.236186  9206 leader_election.cc:290] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
W20260709 12:16:10.237534  8293 leader_election.cc:336] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.238109  8293 leader_election.cc:304] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.238688  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a6107537934605a85ad9af15618125" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:16:10.238927  9213 raft_consensus.cc:2749] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:10.242550  9206 raft_consensus.cc:493] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
W20260709 12:16:10.243119  8219 leader_election.cc:336] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.243098  9206 raft_consensus.cc:515] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.243963  8219 leader_election.cc:304] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
W20260709 12:16:10.244974  8219 leader_election.cc:336] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.245419  8219 leader_election.cc:304] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.248703  9171 raft_consensus.cc:2749] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:10.249451  9171 raft_consensus.cc:2749] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:10.254725  9206 leader_election.cc:290] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:10.259366  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:16:10.262539  9206 raft_consensus.cc:493] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.263325  9206 raft_consensus.cc:515] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
W20260709 12:16:10.265102  8219 leader_election.cc:336] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.265622  8219 leader_election.cc:304] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.265966  9206 leader_election.cc:290] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.266434  9201 raft_consensus.cc:2749] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:10.268826  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02767f53ba4da998190270c72317fb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:16:10.290129  9201 raft_consensus.cc:493] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.290709  9201 raft_consensus.cc:515] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.293874  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae828d825348490eb62b74680a762deb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:16:10.294512  8180 raft_consensus.cc:2468] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 2.
I20260709 12:16:10.295780  8222 leader_election.cc:304] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:16:10.298429  9206 raft_consensus.cc:2804] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:10.298866  9206 raft_consensus.cc:493] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.299247  9206 raft_consensus.cc:3060] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.305068  9213 raft_consensus.cc:493] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.305670  9213 raft_consensus.cc:515] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.308573  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:10.308717  9201 leader_election.cc:290] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:10.310628  9213 leader_election.cc:290] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
W20260709 12:16:10.316418  8293 leader_election.cc:336] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.317016  8293 leader_election.cc:304] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.317842  9213 raft_consensus.cc:2749] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:10.322695  9171 raft_consensus.cc:493] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.323345  9171 raft_consensus.cc:515] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.325662  9171 leader_election.cc:290] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.326198  9171 raft_consensus.cc:493] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.326678  9171 raft_consensus.cc:515] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
W20260709 12:16:10.337062  8219 leader_election.cc:336] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.337657  8219 leader_election.cc:304] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: 9058059c81534bc4b58c5329d5734dcc, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.337785  9213 raft_consensus.cc:493] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.338382  9213 raft_consensus.cc:515] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:10.338861  9206 raft_consensus.cc:515] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.340588  9213 leader_election.cc:290] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:10.341877  9201 raft_consensus.cc:2749] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:10.343036  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:16:10.346359  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:16:10.347023  8330 raft_consensus.cc:2468] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 3.
I20260709 12:16:10.349112  9206 leader_election.cc:290] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:10.354028  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dee16badf54437bc48a2f623d62066" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:16:10.354758  8327 raft_consensus.cc:2468] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 2.
I20260709 12:16:10.338413  9171 leader_election.cc:290] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.361729  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae828d825348490eb62b74680a762deb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:16:10.362421  8180 raft_consensus.cc:3060] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.374421  8219 leader_election.cc:304] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:16:10.375860  8180 raft_consensus.cc:2468] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 3.
I20260709 12:16:10.377339  8222 leader_election.cc:304] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:16:10.378207  9201 raft_consensus.cc:2804] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:10.378724  9201 raft_consensus.cc:493] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.378929  9206 raft_consensus.cc:2804] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:10.379158  9201 raft_consensus.cc:3060] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.379593  9206 raft_consensus.cc:697] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 3 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:10.380579  9206 consensus_queue.cc:237] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:16:10.381580  8293 leader_election.cc:336] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.383306  8293 leader_election.cc:304] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.386132  9214 raft_consensus.cc:2749] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:10.390864  2017 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8983)
I20260709 12:16:10.393218  9201 raft_consensus.cc:515] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.399093  8219 leader_election.cc:304] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:16:10.400013  9206 raft_consensus.cc:2804] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:10.400431  9206 raft_consensus.cc:493] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.400837  9206 raft_consensus.cc:3060] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.401072  8004 catalog_manager.cc:5697] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 2 to 3, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:10.407907  9215 raft_consensus.cc:493] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.408506  9215 raft_consensus.cc:515] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
W20260709 12:16:10.408818  8219 leader_election.cc:336] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.409561  9206 raft_consensus.cc:515] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
W20260709 12:16:10.410109  8219 leader_election.cc:336] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:16:10.410909  8219 leader_election.cc:336] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:16:10.411693  8219 leader_election.cc:336] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.414429  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf040fefc954e70b0098614c1c1a09c" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:10.415156  8323 raft_consensus.cc:3060] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.416889  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:16:10.417614  8328 raft_consensus.cc:2468] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 2.
I20260709 12:16:10.419888  8145 leader_election.cc:304] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:16:10.421871  9206 leader_election.cc:290] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.422176  9165 raft_consensus.cc:2804] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:10.422650  9165 raft_consensus.cc:493] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.421005  9215 leader_election.cc:290] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.423123  9165 raft_consensus.cc:3060] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:10.432744  8145 leader_election.cc:336] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.395408  9201 leader_election.cc:290] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.442040  9165 raft_consensus.cc:515] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:10.444725  9165 leader_election.cc:290] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.448356  8323 raft_consensus.cc:2468] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 4.
I20260709 12:16:10.456825  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8349f261931413588e7bbd0421e52fb" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:10.457433  8327 raft_consensus.cc:3060] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.457825  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dee16badf54437bc48a2f623d62066" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:10.458516  8323 raft_consensus.cc:3060] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.463774  8219 leader_election.cc:304] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:16:10.468406  9201 raft_consensus.cc:2804] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:10.469009  9201 raft_consensus.cc:697] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 4 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:10.469935  9201 consensus_queue.cc:237] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.473060  8327 raft_consensus.cc:2468] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 3.
I20260709 12:16:10.483040  9206 raft_consensus.cc:493] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
W20260709 12:16:10.483338  8219 leader_election.cc:336] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.483719  9206 raft_consensus.cc:515] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:16:10.484362  8219 leader_election.cc:336] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.485340  9215 raft_consensus.cc:493] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.486119  9206 leader_election.cc:290] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.486023  9215 raft_consensus.cc:515] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:10.488008  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:16:10.488412  9206 raft_consensus.cc:493] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.488833  8177 raft_consensus.cc:2468] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 2.
I20260709 12:16:10.488947  9215 leader_election.cc:290] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.490232  8222 leader_election.cc:304] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:16:10.489037  9206 raft_consensus.cc:515] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.491358  9208 raft_consensus.cc:2804] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:10.491755  9208 raft_consensus.cc:493] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.492118  9208 raft_consensus.cc:3060] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:10.493185  8145 leader_election.cc:336] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.493646  9206 leader_election.cc:290] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:10.495141  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:16:10.496002  8327 raft_consensus.cc:2468] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 2.
I20260709 12:16:10.496658  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d552c1db4b14ac89628e14ac27582ba" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
I20260709 12:16:10.497511  9171 raft_consensus.cc:493] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.497867  9213 raft_consensus.cc:493] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.498046  9171 raft_consensus.cc:515] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.498360  9213 raft_consensus.cc:515] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.500146  9171 leader_election.cc:290] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.504558  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76a73968afd4c25951776edaf3da243" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:10.500404  9213 leader_election.cc:290] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
W20260709 12:16:10.513064  8293 leader_election.cc:336] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.513566  8293 leader_election.cc:304] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: 66af1447f2c64ebda5448a760d5d7718, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.515251  9214 raft_consensus.cc:2749] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:10.521625  9208 raft_consensus.cc:515] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.522469  9201 raft_consensus.cc:493] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.526696  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:16:10.533247  8328 raft_consensus.cc:2468] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 3.
I20260709 12:16:10.529006  8323 raft_consensus.cc:2468] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 3.
I20260709 12:16:10.534770  9201 raft_consensus.cc:515] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.536502  8145 leader_election.cc:304] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.543911  9202 raft_consensus.cc:2804] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:10.544416  9202 raft_consensus.cc:697] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 3 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:16:10.544843  8145 leader_election.cc:304] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:16:10.545140  8219 leader_election.cc:304] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:16:10.545892  9168 raft_consensus.cc:2804] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:10.546315  9168 raft_consensus.cc:493] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.546697  9168 raft_consensus.cc:3060] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.547338  9206 raft_consensus.cc:2804] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:10.547840  9206 raft_consensus.cc:493] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.548221  9206 raft_consensus.cc:3060] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.549568  9165 raft_consensus.cc:493] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.539075  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe350f2e414cbf85acf51562f960ad" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e"
I20260709 12:16:10.550098  9165 raft_consensus.cc:515] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.550487  8177 raft_consensus.cc:3060] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.553617  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a6107537934605a85ad9af15618125" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:10.554250  8252 raft_consensus.cc:2468] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 2.
I20260709 12:16:10.555593  8148 leader_election.cc:304] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:16:10.541872  9208 leader_election.cc:290] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 election: Requested vote from peers b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.545387  9202 consensus_queue.cc:237] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:10.537503  9201 leader_election.cc:290] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
W20260709 12:16:10.556741  8145 leader_election.cc:336] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.556835  8219 leader_election.cc:304] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.563203  9215 raft_consensus.cc:2804] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:10.563678  9215 raft_consensus.cc:493] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.564067  9215 raft_consensus.cc:3060] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:10.568430  8145 leader_election.cc:336] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.555955  9206 raft_consensus.cc:515] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.570631  8177 raft_consensus.cc:2468] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 3.
I20260709 12:16:10.572033  8222 leader_election.cc:304] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:16:10.573041  9221 raft_consensus.cc:493] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.572758  9201 raft_consensus.cc:2804] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:10.573344  9206 leader_election.cc:290] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.573632  9221 raft_consensus.cc:515] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.573853  9201 raft_consensus.cc:697] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 3 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:10.576316  9221 leader_election.cc:290] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.578251  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02767f53ba4da998190270c72317fb" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:10.579181  8252 raft_consensus.cc:2468] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 2.
I20260709 12:16:10.580731  8296 leader_election.cc:304] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:16:10.581552  9221 raft_consensus.cc:2804] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:10.582047  9221 raft_consensus.cc:493] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.582582  9221 raft_consensus.cc:3060] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.557708  9165 leader_election.cc:290] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:10.585784  9165 raft_consensus.cc:493] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.586444  9165 raft_consensus.cc:515] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.576138  9201 consensus_queue.cc:237] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.588416  9168 raft_consensus.cc:515] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:10.594234  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c92346b4a0134497acbb92c4f885a4fb" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:10.595084  8327 raft_consensus.cc:3060] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.606513  8327 raft_consensus.cc:2468] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 4.
I20260709 12:16:10.603974  9208 raft_consensus.cc:2804] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:10.603912  9213 raft_consensus.cc:493] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.609141  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76a73968afd4c25951776edaf3da243" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:16:10.613430  9215 raft_consensus.cc:515] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:16:10.614449  8293 leader_election.cc:336] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.620616  9215 leader_election.cc:290] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:10.612607  9213 raft_consensus.cc:515] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
W20260709 12:16:10.627205  8145 leader_election.cc:336] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.627012  8003 catalog_manager.cc:5697] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 2 to 3, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 3 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:10.628445  9213 leader_election.cc:290] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:10.634799  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a6107537934605a85ad9af15618125" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:10.635630  8255 raft_consensus.cc:3060] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.612839  9202 raft_consensus.cc:493] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.632628  8323 raft_consensus.cc:2468] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 2.
I20260709 12:16:10.648804  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f48f739c824c7f8ba5295113a92212" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:10.649595  8327 raft_consensus.cc:3060] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.657021  9165 leader_election.cc:290] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:10.632642  9221 raft_consensus.cc:515] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.647007  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b02838a902c44ea49d8d94181285b20e" is_pre_election: true
W20260709 12:16:10.661537  8219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.68:44023, user_credentials={real_user=slave}} blocked reactor thread for 51867.7us
I20260709 12:16:10.662330  8219 leader_election.cc:304] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:16:10.663326  8219 leader_election.cc:304] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
W20260709 12:16:10.664397  8293 leader_election.cc:336] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.667763  9168 leader_election.cc:290] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.667892  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:10.668591  8252 raft_consensus.cc:2468] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 2.
I20260709 12:16:10.665393  9206 raft_consensus.cc:2804] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:10.671327  8148 leader_election.cc:304] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: 
I20260709 12:16:10.672308  9225 raft_consensus.cc:2804] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:10.672822  9225 raft_consensus.cc:493] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.673282  9225 raft_consensus.cc:3060] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:10.678517  8145 leader_election.cc:336] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.678800  9206 raft_consensus.cc:697] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 4 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
W20260709 12:16:10.679380  8145 leader_election.cc:336] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.680181  9206 consensus_queue.cc:237] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.681529  8296 leader_election.cc:304] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.684433  8327 raft_consensus.cc:2468] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 3.
I20260709 12:16:10.685043  8255 raft_consensus.cc:2468] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 3.
I20260709 12:16:10.683594  9214 raft_consensus.cc:2749] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:10.687692  8145 leader_election.cc:304] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.687717  8148 leader_election.cc:304] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.690562  9216 raft_consensus.cc:2804] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:10.691026  9216 raft_consensus.cc:493] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.691371  9165 raft_consensus.cc:2804] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:10.691936  9165 raft_consensus.cc:697] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 3 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:16:10.692749  9165 consensus_queue.cc:237] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:10.691392  9216 raft_consensus.cc:3060] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:10.688130  8219 leader_election.cc:336] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:16:10.705982  8219 leader_election.cc:336] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.706632  8219 leader_election.cc:304] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.653896  9202 raft_consensus.cc:515] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.708423  9215 raft_consensus.cc:2804] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:10.686661  9208 raft_consensus.cc:697] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 3 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:10.722313  9221 leader_election.cc:290] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 election: Requested vote from peers 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.729166  9202 leader_election.cc:290] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:10.728767  9208 consensus_queue.cc:237] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.730784  9206 raft_consensus.cc:2749] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:10.731768  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02767f53ba4da998190270c72317fb" candidate_uuid: "9058059c81534bc4b58c5329d5734dcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:10.732350  8255 raft_consensus.cc:3060] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.683267  9225 raft_consensus.cc:515] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:16:10.731359  8219 leader_election.cc:336] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.721067  9215 raft_consensus.cc:697] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 3 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:16:10.745551  9224 raft_consensus.cc:493] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
W20260709 12:16:10.752930  8293 leader_election.cc:336] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.745846  9165 raft_consensus.cc:493] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.771610  8255 raft_consensus.cc:2468] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9058059c81534bc4b58c5329d5734dcc in term 3.
I20260709 12:16:10.772795  8296 leader_election.cc:304] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
W20260709 12:16:10.770619  8219 leader_election.cc:336] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:16:10.774080  8219 leader_election.cc:336] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:16:10.775108  8219 leader_election.cc:336] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.778767  9165 raft_consensus.cc:515] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.786644  9165 leader_election.cc:290] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:10.788409  9225 leader_election.cc:290] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:10.778033  9214 raft_consensus.cc:2804] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:10.793761  9214 raft_consensus.cc:697] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 3 LEADER]: Becoming Leader. State: Replica: 9058059c81534bc4b58c5329d5734dcc, State: Running, Role: LEADER
I20260709 12:16:10.794683  9214 consensus_queue.cc:237] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.795912  9215 consensus_queue.cc:237] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:16:10.803331  8148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.67:40315, user_credentials={real_user=slave}} blocked reactor thread for 115676us
I20260709 12:16:10.805634  9216 raft_consensus.cc:515] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.806146  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:10.808193  8252 raft_consensus.cc:2468] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 3.
I20260709 12:16:10.809733  9216 leader_election.cc:290] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
W20260709 12:16:10.815661  8145 leader_election.cc:336] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:16:10.816458  8145 leader_election.cc:336] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:16:10.817050  8145 leader_election.cc:336] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.818331  8174 raft_consensus.cc:1275] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:10.820906  9230 consensus_queue.cc:1048] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:10.776798  9224 raft_consensus.cc:515] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:10.828814  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d552c1db4b14ac89628e14ac27582ba" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718" is_pre_election: true
I20260709 12:16:10.829459  8252 raft_consensus.cc:2468] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 2.
I20260709 12:16:10.829777  9224 leader_election.cc:290] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.833413  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c24a2a517f14bd4a4c0887718468265" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:10.834174  8255 raft_consensus.cc:3060] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.835497  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc" is_pre_election: true
I20260709 12:16:10.836117  8327 raft_consensus.cc:2468] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 3.
W20260709 12:16:10.836686  8145 leader_election.cc:336] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.837587  8145 leader_election.cc:304] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.839875  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76a73968afd4c25951776edaf3da243" candidate_uuid: "66af1447f2c64ebda5448a760d5d7718" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:10.840467  8327 raft_consensus.cc:3060] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.840780  9224 raft_consensus.cc:2804] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:10.841239  9224 raft_consensus.cc:493] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.841645  9224 raft_consensus.cc:3060] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.849577  8327 raft_consensus.cc:2468] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66af1447f2c64ebda5448a760d5d7718 in term 3.
I20260709 12:16:10.848420  8003 catalog_manager.cc:5697] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc reported cstate change: term changed from 2 to 3, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 9058059c81534bc4b58c5329d5734dcc (127.1.248.68). New cstate: current_term: 3 leader_uuid: "9058059c81534bc4b58c5329d5734dcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:10.853330  8148 leader_election.cc:304] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.855325  8148 leader_election.cc:304] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.860409  9235 raft_consensus.cc:2804] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:10.860785  9235 raft_consensus.cc:493] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.861138  9235 raft_consensus.cc:3060] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.858995  8219 leader_election.cc:304] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, 9058059c81534bc4b58c5329d5734dcc; no voters: 
I20260709 12:16:10.863618  9208 raft_consensus.cc:2804] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:10.864068  9208 raft_consensus.cc:697] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 3 LEADER]: Becoming Leader. State: Replica: 66af1447f2c64ebda5448a760d5d7718, State: Running, Role: LEADER
I20260709 12:16:10.864871  9208 consensus_queue.cc:237] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } }
I20260709 12:16:10.858289  9225 raft_consensus.cc:2804] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:10.867329  9225 raft_consensus.cc:493] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee6a7bcc0bc742dda6ce79fbd49d6e49)
I20260709 12:16:10.867738  9225 raft_consensus.cc:3060] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.875201  8004 catalog_manager.cc:5697] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 3 to 4, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 4 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:10.880441  8004 catalog_manager.cc:5697] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 2 to 3, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:10.884023  8255 raft_consensus.cc:2468] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 3.
I20260709 12:16:10.884624  8004 catalog_manager.cc:5697] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 2 to 3, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:10.886291  8219 leader_election.cc:336] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.886644  8004 catalog_manager.cc:5697] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 3 to 4, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 4 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:10.894400  8148 leader_election.cc:304] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.895743  9234 raft_consensus.cc:2804] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:10.896224  9234 raft_consensus.cc:697] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 3 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:16:10.897089  9234 consensus_queue.cc:237] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.912406  9235 raft_consensus.cc:515] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
W20260709 12:16:10.915916  8219 consensus_peers.cc:597] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:10.929576  9224 raft_consensus.cc:515] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
W20260709 12:16:10.931937  8219 consensus_peers.cc:597] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:10.939635  9225 raft_consensus.cc:515] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:10.945967  9235 leader_election.cc:290] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:10.948369  9225 leader_election.cc:290] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 4 election: Requested vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315)
I20260709 12:16:10.951922  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d552c1db4b14ac89628e14ac27582ba" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:10.952638  8252 raft_consensus.cc:3060] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:10.954046  8145 leader_election.cc:336] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
W20260709 12:16:10.955935  8145 leader_election.cc:336] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:10.963671  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e9145ea32c46a686276c9ecfb4ee19" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66af1447f2c64ebda5448a760d5d7718"
I20260709 12:16:10.964474  8255 raft_consensus.cc:3060] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.964759  9224 leader_election.cc:290] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 4 election: Requested vote from peers 9058059c81534bc4b58c5329d5734dcc (127.1.248.68:44023), ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153)
I20260709 12:16:10.952306  8004 catalog_manager.cc:5697] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 reported cstate change: term changed from 2 to 3, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "66af1447f2c64ebda5448a760d5d7718" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:10.965564  8003 catalog_manager.cc:5697] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 2 to 3, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 3 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:10.967496  8003 catalog_manager.cc:5697] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 2 to 3, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 3 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:10.973616  8255 raft_consensus.cc:2468] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 4.
I20260709 12:16:10.970093  8252 raft_consensus.cc:2468] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 3.
I20260709 12:16:10.977715  8327 raft_consensus.cc:1275] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Refusing update from remote peer b02838a902c44ea49d8d94181285b20e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:10.997037  8148 leader_election.cc:304] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:10.987226  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f68e739edae4a70821a0646a5db9431" candidate_uuid: "b02838a902c44ea49d8d94181285b20e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9058059c81534bc4b58c5329d5734dcc"
I20260709 12:16:10.997900  8323 raft_consensus.cc:3060] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.998095  9215 raft_consensus.cc:2804] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:10.998808  9215 raft_consensus.cc:697] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 4 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:16:10.999729  9215 consensus_queue.cc:237] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:11.007903  8323 raft_consensus.cc:2468] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02838a902c44ea49d8d94181285b20e in term 4.
W20260709 12:16:11.009970  8145 leader_election.cc:336] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:11.010016  9224 consensus_queue.cc:1048] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:11.010941  8148 leader_election.cc:304] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66af1447f2c64ebda5448a760d5d7718, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:11.023653  9224 raft_consensus.cc:2804] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:11.024897  9224 raft_consensus.cc:697] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 3 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:16:11.025911  9224 consensus_queue.cc:237] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } }
I20260709 12:16:11.030843  8145 leader_election.cc:304] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc, b02838a902c44ea49d8d94181285b20e; no voters: ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:11.038699  9215 raft_consensus.cc:2804] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:11.042977  8174 raft_consensus.cc:1275] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:11.045056  9215 raft_consensus.cc:697] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 4 LEADER]: Becoming Leader. State: Replica: b02838a902c44ea49d8d94181285b20e, State: Running, Role: LEADER
I20260709 12:16:11.056113  9215 consensus_queue.cc:237] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:11.058591  8004 catalog_manager.cc:5697] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 2 to 3, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 3 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.061561  9208 consensus_queue.cc:1048] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:11.060539  8323 raft_consensus.cc:1275] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 4 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:11.064432  9208 consensus_queue.cc:1048] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:11.061540  8004 catalog_manager.cc:5697] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 3 to 4, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 4 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:11.082862  8145 consensus_peers.cc:597] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.115414  8219 consensus_peers.cc:597] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.118468  8004 catalog_manager.cc:5697] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 2 to 3, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 3 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.120122  8004 catalog_manager.cc:5697] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e reported cstate change: term changed from 3 to 4, leader changed from ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65) to b02838a902c44ea49d8d94181285b20e (127.1.248.66). New cstate: current_term: 4 leader_uuid: "b02838a902c44ea49d8d94181285b20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:11.142206  8219 consensus_peers.cc:597] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.185281  8323 raft_consensus.cc:1275] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Refusing update from remote peer b02838a902c44ea49d8d94181285b20e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:11.186867  9224 consensus_queue.cc:1048] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:16:11.187794  8145 consensus_peers.cc:597] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.217414  8323 raft_consensus.cc:1275] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 4 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:11.227525  9229 consensus_queue.cc:1048] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:16:11.268324  8145 consensus_peers.cc:597] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.289016  8327 raft_consensus.cc:1275] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:11.295698  9216 consensus_queue.cc:1048] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:16:11.298581  8219 consensus_peers.cc:597] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.366536  8293 consensus_peers.cc:597] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.369807  8293 consensus_peers.cc:597] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.391494  2017 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8983)
I20260709 12:16:11.417969  8255 raft_consensus.cc:1275] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Refusing update from remote peer b02838a902c44ea49d8d94181285b20e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:11.420506  9224 consensus_queue.cc:1048] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:11.430397  8252 raft_consensus.cc:1275] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Refusing update from remote peer 9058059c81534bc4b58c5329d5734dcc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:11.433473  8327 raft_consensus.cc:1275] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Refusing update from remote peer 66af1447f2c64ebda5448a760d5d7718: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:16:11.435257  8219 consensus_peers.cc:597] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:11.438862  9214 consensus_queue.cc:1048] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:11.440317  9171 consensus_queue.cc:1048] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:11.460258  8256 raft_consensus.cc:1275] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Refusing update from remote peer b02838a902c44ea49d8d94181285b20e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:16:11.458473  8145 consensus_peers.cc:597] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:11.463634  9236 consensus_queue.cc:1048] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:16:11.470106  8145 consensus_peers.cc:597] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.477419  8293 consensus_peers.cc:597] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.480065  8145 consensus_peers.cc:597] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.481829  8293 consensus_peers.cc:597] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:11.488798  8256 raft_consensus.cc:1275] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 4 FOLLOWER]: Refusing update from remote peer b02838a902c44ea49d8d94181285b20e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:11.490739  9224 consensus_queue.cc:1048] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:16:11.496093  8219 consensus_peers.cc:597] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.497970  8293 consensus_peers.cc:597] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.504918  8145 consensus_peers.cc:597] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.505483  8145 consensus_peers.cc:597] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.512370  8219 consensus_peers.cc:597] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:11.537555  8251 raft_consensus.cc:1275] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Refusing update from remote peer b02838a902c44ea49d8d94181285b20e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:11.541345  9215 consensus_queue.cc:1048] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66af1447f2c64ebda5448a760d5d7718" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:16:11.544541  8293 consensus_peers.cc:597] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.556149  8145 consensus_peers.cc:597] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.560225  8145 consensus_peers.cc:597] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:11.563316  8327 raft_consensus.cc:1275] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 4 FOLLOWER]: Refusing update from remote peer b02838a902c44ea49d8d94181285b20e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:11.566109  9224 consensus_queue.cc:1048] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:16:11.589666  8293 consensus_peers.cc:597] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.592568  8293 consensus_peers.cc:597] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.593360  8145 consensus_peers.cc:597] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.607733  8145 consensus_peers.cc:597] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.631507  8219 consensus_peers.cc:597] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.653707  8219 consensus_peers.cc:597] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.655853  8145 consensus_peers.cc:597] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.668263  8219 consensus_peers.cc:597] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.686328  8293 consensus_peers.cc:597] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.689285  8145 consensus_peers.cc:597] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.721354  8145 consensus_peers.cc:597] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.721832  8219 consensus_peers.cc:597] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.750516  8145 consensus_peers.cc:597] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.799590  8219 consensus_peers.cc:597] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.848436  8145 consensus_peers.cc:597] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.868377  8219 consensus_peers.cc:597] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.874063  8219 consensus_peers.cc:597] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:11.912498  8219 consensus_peers.cc:597] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.017549  8145 consensus_peers.cc:597] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.065268  8145 consensus_peers.cc:597] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.114166  8293 consensus_peers.cc:597] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.392000  2017 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8983)
W20260709 12:16:13.314530  8219 consensus_peers.cc:597] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.393319  2017 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8983)
W20260709 12:16:13.426136  8219 consensus_peers.cc:597] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.525848  8219 consensus_peers.cc:597] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.528013  8145 consensus_peers.cc:597] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.549070  8219 consensus_peers.cc:597] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.566059  8145 consensus_peers.cc:597] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.582006  8219 consensus_peers.cc:597] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.616566  8293 consensus_peers.cc:597] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:13.636487  8145 consensus_peers.cc:597] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:13.682245  8293 consensus_peers.cc:597] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:13.791162  8145 consensus_peers.cc:597] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.805496  8293 consensus_peers.cc:597] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:13.811745  8219 consensus_peers.cc:597] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:13.824839  8293 consensus_peers.cc:597] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:13.852259  8145 consensus_peers.cc:597] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:13.866721  8293 consensus_peers.cc:597] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:13.867372  8293 consensus_peers.cc:597] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.896248  8219 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111) [suppressed 434 similar messages]
W20260709 12:16:13.918649  8145 consensus_peers.cc:597] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:13.924899  8145 consensus_peers.cc:597] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.933876  8145 consensus_peers.cc:597] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.992211  8293 consensus_peers.cc:597] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:13.995972  8145 consensus_peers.cc:597] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:14.008042  8145 consensus_peers.cc:597] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.036226  8145 consensus_peers.cc:597] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.051748  8145 consensus_peers.cc:597] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:14.076675  2017 tablet_server.cc:196] TabletServer@127.1.248.65:34153 shutdown complete.
W20260709 12:16:14.093204  8293 consensus_peers.cc:597] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.125006  8219 consensus_peers.cc:597] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.145411  8219 consensus_peers.cc:597] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.147053  8219 consensus_peers.cc:597] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.152877  8145 consensus_peers.cc:597] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.166972  8145 consensus_peers.cc:597] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.177446  8293 consensus_peers.cc:597] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.181607  8219 consensus_peers.cc:597] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:14.183959  2017 tablet_server.cc:179] TabletServer@127.1.248.66:0 shutting down...
W20260709 12:16:14.186869  8145 consensus_peers.cc:597] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.197652  8296 consensus_peers.cc:597] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.199194  8219 consensus_peers.cc:597] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.201416  8222 consensus_peers.cc:597] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.202754  8219 consensus_peers.cc:597] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.208092  8222 consensus_peers.cc:597] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.209201  8296 consensus_peers.cc:597] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.224124  8296 consensus_peers.cc:597] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.224804  8296 consensus_peers.cc:597] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:14.254845  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:16:14.255820  8145 consensus_peers.cc:597] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:14.256197  2017 tablet_replica.cc:333] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.257017  2017 raft_consensus.cc:2243] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.257927  2017 raft_consensus.cc:2272] T c8349f261931413588e7bbd0421e52fb P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.261291  2017 tablet_replica.cc:333] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.262274  2017 raft_consensus.cc:2243] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.263520  2017 raft_consensus.cc:2272] T 710d05d6f10242a7b13561b37f5eae08 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.266568  2017 tablet_replica.cc:333] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.267521  2017 raft_consensus.cc:2243] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.268128  2017 raft_consensus.cc:2272] T 008c85279d534f24a2dd08e7bbd167cb P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.270679  2017 tablet_replica.cc:333] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.271551  2017 raft_consensus.cc:2243] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.272401  2017 raft_consensus.cc:2272] T 7f68e739edae4a70821a0646a5db9431 P b02838a902c44ea49d8d94181285b20e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.274483  2017 tablet_replica.cc:333] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.275076  2017 raft_consensus.cc:2243] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.276213  2017 raft_consensus.cc:2272] T b2eac4b35b3646478eb5d30222e9ec59 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.279073  2017 tablet_replica.cc:333] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.280007  2017 raft_consensus.cc:2243] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.280582  2017 raft_consensus.cc:2272] T ae828d825348490eb62b74680a762deb P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:14.280616  8222 consensus_peers.cc:597] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:14.283800  2017 tablet_replica.cc:333] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.284689  2017 raft_consensus.cc:2243] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.285228  2017 raft_consensus.cc:2272] T c6d0c551bc6b4d279dbcf6d09ea8d741 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.288623  2017 tablet_replica.cc:333] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.289392  2017 raft_consensus.cc:2243] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.290248  2017 raft_consensus.cc:2272] T 8d921491df994357a386e8d378ccfd09 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:14.291071  8219 consensus_peers.cc:597] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:14.292778  2017 tablet_replica.cc:333] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.293921  2017 raft_consensus.cc:2243] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.294610  2017 raft_consensus.cc:2272] T 1c09223f8a6c4f7fb844bce6937e86f4 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.296788  2017 tablet_replica.cc:333] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.297427  2017 raft_consensus.cc:2243] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.297845  2017 raft_consensus.cc:2272] T f0b09c2f447345459284f96e85c1af52 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.300064  2017 tablet_replica.cc:333] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.300822  2017 raft_consensus.cc:2243] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.301781  2017 raft_consensus.cc:2272] T 78aedf68b2244597bed9a1046869df3e P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.304394  2017 tablet_replica.cc:333] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.305009  2017 raft_consensus.cc:2243] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.305884  2017 raft_consensus.cc:2272] T 7f64ebcb5be64da88badd16aa178cd4a P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.308831  2017 tablet_replica.cc:333] T 2f7f51cbe52e4c4c99fc31b081f4372a P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
W20260709 12:16:14.309624  8145 consensus_peers.cc:597] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:14.309711  2017 raft_consensus.cc:2243] T 2f7f51cbe52e4c4c99fc31b081f4372a P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.310616  2017 raft_consensus.cc:2272] T 2f7f51cbe52e4c4c99fc31b081f4372a P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.313632  2017 tablet_replica.cc:333] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.314457  2017 raft_consensus.cc:2243] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.315678  2017 raft_consensus.cc:2272] T 64f48f739c824c7f8ba5295113a92212 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.318266  2017 tablet_replica.cc:333] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.318922  2017 raft_consensus.cc:2243] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.319396  2017 raft_consensus.cc:2272] T da3dcd2b92f84d1899b354f41bc21714 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.321691  2017 tablet_replica.cc:333] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.322295  2017 raft_consensus.cc:2243] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.322741  2017 raft_consensus.cc:2272] T 74d6768968ae4371bbc6973eaf2851d7 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.324775  2017 tablet_replica.cc:333] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.325309  2017 raft_consensus.cc:2243] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.326148  2017 raft_consensus.cc:2272] T 6c24a2a517f14bd4a4c0887718468265 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.328576  2017 tablet_replica.cc:333] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.329387  2017 raft_consensus.cc:2243] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.330386  2017 raft_consensus.cc:2272] T 544e8410d33f4f21851df79c3d646d76 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.333448  2017 tablet_replica.cc:333] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.334270  2017 raft_consensus.cc:2243] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.335354  2017 raft_consensus.cc:2272] T 325569f077184e418663d6e5e3f6fd3b P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:14.337821  8222 consensus_peers.cc:597] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:14.338240  2017 tablet_replica.cc:333] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.339110  2017 raft_consensus.cc:2243] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.340168  2017 raft_consensus.cc:2272] T cc189c974f5542a682c54f9bde0483a1 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.342774  2017 tablet_replica.cc:333] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
W20260709 12:16:14.343036  8219 consensus_peers.cc:597] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:14.343585  2017 raft_consensus.cc:2243] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.344130  2017 raft_consensus.cc:2272] T b546c0cac1bd49e787e00b8c1d8e9eea P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.346356  2017 tablet_replica.cc:333] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.346978  2017 raft_consensus.cc:2243] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.347375  2017 raft_consensus.cc:2272] T 19bbb2e8c1a44e4183322858438fa0b4 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.349551  2017 tablet_replica.cc:333] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.350275  2017 raft_consensus.cc:2243] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.350752  2017 raft_consensus.cc:2272] T ac5c04cc27ba4d1dbb26c919321fbfa9 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.353017  2017 tablet_replica.cc:333] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.353835  2017 raft_consensus.cc:2243] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.354342  2017 raft_consensus.cc:2272] T 2041e92a156540d1854b8b4cccdb3ee8 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.357136  2017 tablet_replica.cc:333] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.357961  2017 raft_consensus.cc:2243] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:16:14.358034  8296 consensus_peers.cc:597] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:14.359418  2017 raft_consensus.cc:2272] T eb422c1b757045358366d25d227e95ec P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.362227  2017 tablet_replica.cc:333] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
W20260709 12:16:14.362700  8222 consensus_peers.cc:597] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:14.362883  2017 raft_consensus.cc:2243] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.364027  2017 raft_consensus.cc:2272] T ed7d8ef97f464b0db4ddc179e9202157 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.366639  2017 tablet_replica.cc:333] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.367491  2017 raft_consensus.cc:2243] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.368620  2017 raft_consensus.cc:2272] T 6d552c1db4b14ac89628e14ac27582ba P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.370954  2017 tablet_replica.cc:333] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.371551  2017 raft_consensus.cc:2243] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.372040  2017 raft_consensus.cc:2272] T 471683504fd94afab642c0a780a8833c P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.374046  2017 tablet_replica.cc:333] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.374584  2017 raft_consensus.cc:2243] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.375011  2017 raft_consensus.cc:2272] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.377017  2017 tablet_replica.cc:333] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.377568  2017 raft_consensus.cc:2243] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.378369  2017 raft_consensus.cc:2272] T 97e9145ea32c46a686276c9ecfb4ee19 P b02838a902c44ea49d8d94181285b20e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.380602  2017 tablet_replica.cc:333] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.381426  2017 raft_consensus.cc:2243] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.382037  2017 raft_consensus.cc:2272] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.384936  2017 tablet_replica.cc:333] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.385737  2017 raft_consensus.cc:2243] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.386365  2017 raft_consensus.cc:2272] T 6da9a7d0425b4dd09d6615567d1fc738 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.388890  2017 tablet_replica.cc:333] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.389611  2017 raft_consensus.cc:2243] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.390506  2017 raft_consensus.cc:2272] T e6fc1fe247f341ed91a83cf61e4529f3 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.393236  2017 tablet_replica.cc:333] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.393982  2017 raft_consensus.cc:2243] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.394572  2017 raft_consensus.cc:2272] T e54e3337256948f3b81b2ac605542399 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.402122  2017 tablet_replica.cc:333] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.403843  2017 raft_consensus.cc:2243] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.405220  2017 raft_consensus.cc:2272] T a9c3e4c9802147f59a86d193db6f981a P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.409335  2017 tablet_replica.cc:333] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.410137  2017 raft_consensus.cc:2243] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.411158  2017 raft_consensus.cc:2272] T 279bf9ef43054f1e83e60ed4dd074176 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:14.412737  8222 consensus_peers.cc:597] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:14.413853  2017 tablet_replica.cc:333] T 8c617ad97f8c44009de3d3d47311ad6a P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
W20260709 12:16:14.414134  8222 consensus_peers.cc:597] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:14.414742  2017 raft_consensus.cc:2243] T 8c617ad97f8c44009de3d3d47311ad6a P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.415349  2017 raft_consensus.cc:2272] T 8c617ad97f8c44009de3d3d47311ad6a P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.418042  2017 tablet_replica.cc:333] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.418610  2017 raft_consensus.cc:2243] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.419395  2017 raft_consensus.cc:2272] T 3cff31edfc694b9b94b47e932c3940f9 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.421675  2017 tablet_replica.cc:333] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.422233  2017 raft_consensus.cc:2243] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.422717  2017 raft_consensus.cc:2272] T 2dbe350f2e414cbf85acf51562f960ad P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:14.424804  8296 consensus_peers.cc:597] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:14.425446  2017 tablet_replica.cc:333] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.426206  2017 raft_consensus.cc:2243] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.427059  2017 raft_consensus.cc:2272] T 14a6107537934605a85ad9af15618125 P b02838a902c44ea49d8d94181285b20e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.429600  2017 tablet_replica.cc:333] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.430265  2017 raft_consensus.cc:2243] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.430768  2017 raft_consensus.cc:2272] T 9e8ee678c5a84a93befee23e8e48c8ea P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.433424  2017 tablet_replica.cc:333] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.433982  2017 raft_consensus.cc:2243] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.434769  2017 raft_consensus.cc:2272] T 0cfe39df11664509bf085d1f7cc21724 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.436779  2017 tablet_replica.cc:333] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.437345  2017 raft_consensus.cc:2243] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.437760  2017 raft_consensus.cc:2272] T 4df02ba9540747b5a8c99951df903897 P b02838a902c44ea49d8d94181285b20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.439797  2017 tablet_replica.cc:333] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e: stopping tablet replica
I20260709 12:16:14.440248  2017 raft_consensus.cc:2243] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.440672  2017 raft_consensus.cc:2272] T acd20020a2924e31be0f16636e76efa7 P b02838a902c44ea49d8d94181285b20e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:14.463419  8296 consensus_peers.cc:597] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.502415  8222 consensus_peers.cc:597] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:14.530447  2017 tablet_server.cc:196] TabletServer@127.1.248.66:0 shutdown complete.
W20260709 12:16:14.539027  8222 consensus_peers.cc:597] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:42019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.562038  8222 consensus_peers.cc:597] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:42019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.573328  8296 consensus_peers.cc:597] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:42019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.587998  8222 consensus_peers.cc:597] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:42019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.606528  8219 consensus_peers.cc:597] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:14.650776  2017 tablet_server.cc:179] TabletServer@127.1.248.67:0 shutting down...
W20260709 12:16:14.693401  8219 consensus_peers.cc:597] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.704401  8296 consensus_peers.cc:597] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:42019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.705691  8296 consensus_peers.cc:597] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:42019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.711894  8296 consensus_peers.cc:597] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc -> Peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Couldn't send request to peer b02838a902c44ea49d8d94181285b20e. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:42019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.713701  8296 consensus_peers.cc:597] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc -> Peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Couldn't send request to peer 66af1447f2c64ebda5448a760d5d7718. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.714330  8296 consensus_peers.cc:597] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc -> Peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Couldn't send request to peer 66af1447f2c64ebda5448a760d5d7718. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.731741  8296 consensus_peers.cc:597] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc -> Peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Couldn't send request to peer 66af1447f2c64ebda5448a760d5d7718. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:14.742156  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:14.743408  2017 tablet_replica.cc:333] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.744457  2017 raft_consensus.cc:2243] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.745555  2017 raft_consensus.cc:2272] T e76a73968afd4c25951776edaf3da243 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.753849  2017 tablet_replica.cc:333] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.754827  2017 raft_consensus.cc:2243] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.756372  2017 raft_consensus.cc:2272] T 2041e92a156540d1854b8b4cccdb3ee8 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.761363  2017 tablet_replica.cc:333] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.762333  2017 raft_consensus.cc:2243] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.763386  2017 raft_consensus.cc:2272] T 008c85279d534f24a2dd08e7bbd167cb P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.766474  2017 tablet_replica.cc:333] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.767367  2017 raft_consensus.cc:2243] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.768527  2017 raft_consensus.cc:2272] T 879b385c0a08435a943ff307ac8fb275 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.771667  2017 tablet_replica.cc:333] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.772643  2017 raft_consensus.cc:2243] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.773319  2017 raft_consensus.cc:2272] T 385f9fa3d1004f2f820b3f26592cbd1a P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:14.773662  8296 consensus_peers.cc:597] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc -> Peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Couldn't send request to peer 66af1447f2c64ebda5448a760d5d7718. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:14.776369  2017 tablet_replica.cc:333] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.777379  2017 raft_consensus.cc:2243] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.777997  2017 raft_consensus.cc:2272] T b2eac4b35b3646478eb5d30222e9ec59 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.781381  2017 tablet_replica.cc:333] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.782280  2017 raft_consensus.cc:2243] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.783370  2017 raft_consensus.cc:2272] T 1c09223f8a6c4f7fb844bce6937e86f4 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.786006  2017 tablet_replica.cc:333] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.786832  2017 raft_consensus.cc:2243] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.787911  2017 raft_consensus.cc:2272] T 1b9383c8a3a24a0ba2d5b8d5e1006a50 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.790793  2017 tablet_replica.cc:333] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.791947  2017 raft_consensus.cc:2243] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.792636  2017 raft_consensus.cc:2272] T 97dbd2f663574037a43ecf0219ef1c48 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.795699  2017 tablet_replica.cc:333] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.796772  2017 raft_consensus.cc:2243] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.797961  2017 raft_consensus.cc:2272] T a85f56f39a20454d8ddeffad93e935a8 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.801187  2017 tablet_replica.cc:333] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.802232  2017 raft_consensus.cc:2243] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.802908  2017 raft_consensus.cc:2272] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.805961  2017 tablet_replica.cc:333] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.807013  2017 raft_consensus.cc:2243] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.808182  2017 raft_consensus.cc:2272] T 642643c6b8a74401860aad4b969f9131 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.811383  2017 tablet_replica.cc:333] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.812433  2017 raft_consensus.cc:2243] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.813561  2017 raft_consensus.cc:2272] T c92346b4a0134497acbb92c4f885a4fb P 66af1447f2c64ebda5448a760d5d7718 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.816547  2017 tablet_replica.cc:333] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.817467  2017 raft_consensus.cc:2243] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.818152  2017 raft_consensus.cc:2272] T 544e8410d33f4f21851df79c3d646d76 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.821202  2017 tablet_replica.cc:333] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.822180  2017 raft_consensus.cc:2243] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.822778  2017 raft_consensus.cc:2272] T 325569f077184e418663d6e5e3f6fd3b P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.826022  2017 tablet_replica.cc:333] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.827035  2017 raft_consensus.cc:2243] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.827651  2017 raft_consensus.cc:2272] T 7f64ebcb5be64da88badd16aa178cd4a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.830869  2017 tablet_replica.cc:333] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.831852  2017 raft_consensus.cc:2243] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.832962  2017 raft_consensus.cc:2272] T 2f7f51cbe52e4c4c99fc31b081f4372a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.836040  2017 tablet_replica.cc:333] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.836968  2017 raft_consensus.cc:2243] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.837563  2017 raft_consensus.cc:2272] T b546c0cac1bd49e787e00b8c1d8e9eea P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.840653  2017 tablet_replica.cc:333] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.841565  2017 raft_consensus.cc:2243] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.842180  2017 raft_consensus.cc:2272] T 19bbb2e8c1a44e4183322858438fa0b4 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.845321  2017 tablet_replica.cc:333] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.846292  2017 raft_consensus.cc:2243] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.846932  2017 raft_consensus.cc:2272] T ed7d8ef97f464b0db4ddc179e9202157 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.849875  2017 tablet_replica.cc:333] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.850780  2017 raft_consensus.cc:2243] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.852070  2017 raft_consensus.cc:2272] T 7bf040fefc954e70b0098614c1c1a09c P 66af1447f2c64ebda5448a760d5d7718 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.855207  2017 tablet_replica.cc:333] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
W20260709 12:16:14.855394  8296 consensus_peers.cc:597] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc -> Peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Couldn't send request to peer 66af1447f2c64ebda5448a760d5d7718. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:14.856213  2017 raft_consensus.cc:2243] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.856918  2017 raft_consensus.cc:2272] T 471683504fd94afab642c0a780a8833c P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.860111  2017 tablet_replica.cc:333] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.861091  2017 raft_consensus.cc:2243] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.861718  2017 raft_consensus.cc:2272] T 6d552c1db4b14ac89628e14ac27582ba P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.864709  2017 tablet_replica.cc:333] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.865602  2017 raft_consensus.cc:2243] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.866652  2017 raft_consensus.cc:2272] T 4586406114304e5a9209b76096a2f1ba P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.869484  2017 tablet_replica.cc:333] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.870368  2017 raft_consensus.cc:2243] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.871006  2017 raft_consensus.cc:2272] T 97e9145ea32c46a686276c9ecfb4ee19 P 66af1447f2c64ebda5448a760d5d7718 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.874006  2017 tablet_replica.cc:333] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.874914  2017 raft_consensus.cc:2243] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.876134  2017 raft_consensus.cc:2272] T d6dee16badf54437bc48a2f623d62066 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.879338  2017 tablet_replica.cc:333] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.880285  2017 raft_consensus.cc:2243] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.881517  2017 raft_consensus.cc:2272] T 9895082ba16e461b8ca83550f065f98c P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.884689  2017 tablet_replica.cc:333] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.885582  2017 raft_consensus.cc:2243] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.886216  2017 raft_consensus.cc:2272] T 279bf9ef43054f1e83e60ed4dd074176 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.889231  2017 tablet_replica.cc:333] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.890129  2017 raft_consensus.cc:2243] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.890746  2017 raft_consensus.cc:2272] T 3cff31edfc694b9b94b47e932c3940f9 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.893752  2017 tablet_replica.cc:333] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.894640  2017 raft_consensus.cc:2243] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.895284  2017 raft_consensus.cc:2272] T 8c617ad97f8c44009de3d3d47311ad6a P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.898406  2017 tablet_replica.cc:333] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.899256  2017 raft_consensus.cc:2243] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.900391  2017 raft_consensus.cc:2272] T da3dcd2b92f84d1899b354f41bc21714 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.903486  2017 tablet_replica.cc:333] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.904390  2017 raft_consensus.cc:2243] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.905046  2017 raft_consensus.cc:2272] T 6c24a2a517f14bd4a4c0887718468265 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.908113  2017 tablet_replica.cc:333] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.909000  2017 raft_consensus.cc:2243] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.910249  2017 raft_consensus.cc:2272] T 74d6768968ae4371bbc6973eaf2851d7 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:14.912030  8293 consensus_peers.cc:597] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc -> Peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Couldn't send request to peer ee6a7bcc0bc742dda6ce79fbd49d6e49. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:14.913307  2017 tablet_replica.cc:333] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.914744  2017 raft_consensus.cc:2243] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.915416  2017 raft_consensus.cc:2272] T 676232727c4f42c28fd5608fbeb3f634 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.918423  2017 tablet_replica.cc:333] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.919286  2017 raft_consensus.cc:2243] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.920390  2017 raft_consensus.cc:2272] T 9e8ee678c5a84a93befee23e8e48c8ea P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.923168  2017 tablet_replica.cc:333] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.924034  2017 raft_consensus.cc:2243] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.924614  2017 raft_consensus.cc:2272] T 14a6107537934605a85ad9af15618125 P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.927306  2017 tablet_replica.cc:333] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.928120  2017 raft_consensus.cc:2243] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.929169  2017 raft_consensus.cc:2272] T 1c8e6e90970441fdad02bb1119456dea P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.932041  2017 tablet_replica.cc:333] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.932917  2017 raft_consensus.cc:2243] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.933493  2017 raft_consensus.cc:2272] T e54e3337256948f3b81b2ac605542399 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.936582  2017 tablet_replica.cc:333] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.937333  2017 raft_consensus.cc:2243] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.938482  2017 raft_consensus.cc:2272] T ae828d825348490eb62b74680a762deb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.941346  2017 tablet_replica.cc:333] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.942180  2017 raft_consensus.cc:2243] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.942791  2017 raft_consensus.cc:2272] T 2d02767f53ba4da998190270c72317fb P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.945884  2017 tablet_replica.cc:333] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.946724  2017 raft_consensus.cc:2243] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.947723  2017 raft_consensus.cc:2272] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.950589  2017 tablet_replica.cc:333] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.951413  2017 raft_consensus.cc:2243] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.952067  2017 raft_consensus.cc:2272] T 7014425193644424abe3ad50857b4051 P 66af1447f2c64ebda5448a760d5d7718 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.955664  2017 tablet_replica.cc:333] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.956404  2017 raft_consensus.cc:2243] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.957443  2017 raft_consensus.cc:2272] T 2dbe350f2e414cbf85acf51562f960ad P 66af1447f2c64ebda5448a760d5d7718 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.960352  2017 tablet_replica.cc:333] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718: stopping tablet replica
I20260709 12:16:14.961100  2017 raft_consensus.cc:2243] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:14.961735  2017 raft_consensus.cc:2272] T 0cfe39df11664509bf085d1f7cc21724 P 66af1447f2c64ebda5448a760d5d7718 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:14.974876  8296 consensus_peers.cc:597] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc -> Peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Couldn't send request to peer 66af1447f2c64ebda5448a760d5d7718. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.977941  8296 consensus_peers.cc:597] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc -> Peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Couldn't send request to peer 66af1447f2c64ebda5448a760d5d7718. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.984668  8296 consensus_peers.cc:597] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc -> Peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Couldn't send request to peer 66af1447f2c64ebda5448a760d5d7718. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:14.986972  8296 consensus_peers.cc:597] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc -> Peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Couldn't send request to peer 66af1447f2c64ebda5448a760d5d7718. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:15.018587  8296 consensus_peers.cc:597] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc -> Peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Couldn't send request to peer 66af1447f2c64ebda5448a760d5d7718. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:15.032500  8296 consensus_peers.cc:597] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc -> Peer 66af1447f2c64ebda5448a760d5d7718 (127.1.248.67:40315): Couldn't send request to peer 66af1447f2c64ebda5448a760d5d7718. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:15.095240  2017 tablet_server.cc:196] TabletServer@127.1.248.67:0 shutdown complete.
I20260709 12:16:15.247937  9275 raft_consensus.cc:493] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b02838a902c44ea49d8d94181285b20e)
I20260709 12:16:15.249365  9275 raft_consensus.cc:515] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:15.253379  9275 leader_election.cc:290] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
W20260709 12:16:15.270053  8296 leader_election.cc:336] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Network error: Client connection negotiation failed: client connection to 127.1.248.66:42019: connect: Connection refused (error 111)
W20260709 12:16:15.271608  8293 leader_election.cc:336] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:15.272220  8293 leader_election.cc:304] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:15.275399  9265 raft_consensus.cc:2749] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:15.318492  2017 tablet_server.cc:179] TabletServer@127.1.248.68:0 shutting down...
I20260709 12:16:15.366384  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:15.367471  2017 tablet_replica.cc:333] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.368981  2017 raft_consensus.cc:2243] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.369917  2017 raft_consensus.cc:2272] T c8349f261931413588e7bbd0421e52fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.372985  2017 tablet_replica.cc:333] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.373701  2017 raft_consensus.cc:2243] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.374287  2017 raft_consensus.cc:2272] T 879b385c0a08435a943ff307ac8fb275 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.377699  2017 tablet_replica.cc:333] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.378553  2017 raft_consensus.cc:2243] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.379369  2017 raft_consensus.cc:2272] T 7f64ebcb5be64da88badd16aa178cd4a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.382745  2017 tablet_replica.cc:333] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.383586  2017 raft_consensus.cc:2243] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.384338  2017 raft_consensus.cc:2272] T 710d05d6f10242a7b13561b37f5eae08 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.387910  2017 tablet_replica.cc:333] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.388923  2017 raft_consensus.cc:2243] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.390578  2017 raft_consensus.cc:2272] T 385f9fa3d1004f2f820b3f26592cbd1a P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.393177  2017 tablet_replica.cc:333] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.393854  2017 raft_consensus.cc:2243] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.394445  2017 raft_consensus.cc:2272] T b2eac4b35b3646478eb5d30222e9ec59 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.397729  2017 tablet_replica.cc:333] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.398509  2017 raft_consensus.cc:2243] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.399307  2017 raft_consensus.cc:2272] T 7f68e739edae4a70821a0646a5db9431 P 9058059c81534bc4b58c5329d5734dcc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.402886  2017 tablet_replica.cc:333] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.403844  2017 raft_consensus.cc:2243] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.404948  2017 raft_consensus.cc:2272] T f0b09c2f447345459284f96e85c1af52 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.407353  2017 tablet_replica.cc:333] T 8d921491df994357a386e8d378ccfd09 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.408056  2017 raft_consensus.cc:2243] T 8d921491df994357a386e8d378ccfd09 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.408728  2017 raft_consensus.cc:2272] T 8d921491df994357a386e8d378ccfd09 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.411695  2017 tablet_replica.cc:333] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.412323  2017 raft_consensus.cc:2243] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.412937  2017 raft_consensus.cc:2272] T 1c09223f8a6c4f7fb844bce6937e86f4 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.415259  2017 tablet_replica.cc:333] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.415920  2017 raft_consensus.cc:2243] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.416929  2017 raft_consensus.cc:2272] T ac5c04cc27ba4d1dbb26c919321fbfa9 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.419035  2017 tablet_replica.cc:333] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.419715  2017 raft_consensus.cc:2243] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.420328  2017 raft_consensus.cc:2272] T a85f56f39a20454d8ddeffad93e935a8 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.422736  2017 tablet_replica.cc:333] T 642643c6b8a74401860aad4b969f9131 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.423384  2017 raft_consensus.cc:2243] T 642643c6b8a74401860aad4b969f9131 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.424039  2017 raft_consensus.cc:2272] T 642643c6b8a74401860aad4b969f9131 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.426270  2017 tablet_replica.cc:333] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.426882  2017 raft_consensus.cc:2243] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.427616  2017 raft_consensus.cc:2272] T c92346b4a0134497acbb92c4f885a4fb P 9058059c81534bc4b58c5329d5734dcc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.430100  2017 tablet_replica.cc:333] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.430691  2017 raft_consensus.cc:2243] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.431281  2017 raft_consensus.cc:2272] T 325569f077184e418663d6e5e3f6fd3b P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.433715  2017 tablet_replica.cc:333] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.434312  2017 raft_consensus.cc:2243] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.434919  2017 raft_consensus.cc:2272] T 1c8e6e90970441fdad02bb1119456dea P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.437258  2017 tablet_replica.cc:333] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.437853  2017 raft_consensus.cc:2243] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.438537  2017 raft_consensus.cc:2272] T 64f48f739c824c7f8ba5295113a92212 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.441056  2017 tablet_replica.cc:333] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.441620  2017 raft_consensus.cc:2243] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.442258  2017 raft_consensus.cc:2272] T cc189c974f5542a682c54f9bde0483a1 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.444671  2017 tablet_replica.cc:333] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.445272  2017 raft_consensus.cc:2243] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.445787  2017 raft_consensus.cc:2272] T 78aedf68b2244597bed9a1046869df3e P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.448254  2017 tablet_replica.cc:333] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.448822  2017 raft_consensus.cc:2243] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.450165  2017 raft_consensus.cc:2272] T b546c0cac1bd49e787e00b8c1d8e9eea P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.452579  2017 tablet_replica.cc:333] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.453207  2017 raft_consensus.cc:2243] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.454239  2017 raft_consensus.cc:2272] T 19bbb2e8c1a44e4183322858438fa0b4 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.456689  2017 tablet_replica.cc:333] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.457465  2017 raft_consensus.cc:2243] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.458238  2017 raft_consensus.cc:2272] T 9895082ba16e461b8ca83550f065f98c P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.461274  2017 tablet_replica.cc:333] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.461884  2017 raft_consensus.cc:2243] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.462642  2017 raft_consensus.cc:2272] T d6dee16badf54437bc48a2f623d62066 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.465014  2017 tablet_replica.cc:333] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.465727  2017 raft_consensus.cc:2243] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.465669  9275 raft_consensus.cc:493] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b02838a902c44ea49d8d94181285b20e)
I20260709 12:16:15.466723  2017 raft_consensus.cc:2272] T 7bf040fefc954e70b0098614c1c1a09c P 9058059c81534bc4b58c5329d5734dcc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.466676  9275 raft_consensus.cc:515] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:15.469899  2017 tablet_replica.cc:333] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.469785  9275 leader_election.cc:290] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:15.470994  2017 raft_consensus.cc:2243] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.472342  2017 raft_consensus.cc:2272] T 471683504fd94afab642c0a780a8833c P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:15.475030  8293 leader_election.cc:336] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:15.475677  2017 tablet_replica.cc:333] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
W20260709 12:16:15.475999  8296 leader_election.cc:336] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Network error: Client connection negotiation failed: client connection to 127.1.248.66:42019: connect: Connection refused (error 111)
I20260709 12:16:15.476428  8296 leader_election.cc:304] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:15.476603  2017 raft_consensus.cc:2243] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.477198  9275 raft_consensus.cc:2749] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:15.478217  2017 raft_consensus.cc:2272] T 2d02767f53ba4da998190270c72317fb P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.483673  2017 tablet_replica.cc:333] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.484306  2017 raft_consensus.cc:2243] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.485232  2017 raft_consensus.cc:2272] T e76a73968afd4c25951776edaf3da243 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.488528  2017 tablet_replica.cc:333] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.489293  2017 raft_consensus.cc:2243] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.489955  2017 raft_consensus.cc:2272] T 2041e92a156540d1854b8b4cccdb3ee8 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.492915  2017 tablet_replica.cc:333] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.493619  2017 raft_consensus.cc:2243] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.494390  2017 raft_consensus.cc:2272] T eb422c1b757045358366d25d227e95ec P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.497664  2017 tablet_replica.cc:333] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.498500  2017 raft_consensus.cc:2243] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.499348  2017 raft_consensus.cc:2272] T c6d0c551bc6b4d279dbcf6d09ea8d741 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.502449  2017 tablet_replica.cc:333] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.503311  2017 raft_consensus.cc:2243] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.504753  2017 raft_consensus.cc:2272] T 7014425193644424abe3ad50857b4051 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.507481  2017 tablet_replica.cc:333] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.508245  2017 raft_consensus.cc:2243] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.509326  2017 raft_consensus.cc:2272] T 6fee3a59c3aa4cc7aa1c7bbf41e4c0c8 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.511698  2017 tablet_replica.cc:333] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.512310  2017 raft_consensus.cc:2243] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.513286  2017 raft_consensus.cc:2272] T 6da9a7d0425b4dd09d6615567d1fc738 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.515753  2017 tablet_replica.cc:333] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.516330  2017 raft_consensus.cc:2243] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.517412  2017 raft_consensus.cc:2272] T 4df02ba9540747b5a8c99951df903897 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.519894  2017 tablet_replica.cc:333] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.520442  2017 raft_consensus.cc:2243] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.521364  2017 raft_consensus.cc:2272] T 97dbd2f663574037a43ecf0219ef1c48 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.523816  2017 tablet_replica.cc:333] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.524359  2017 raft_consensus.cc:2243] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.525250  2017 raft_consensus.cc:2272] T acd20020a2924e31be0f16636e76efa7 P 9058059c81534bc4b58c5329d5734dcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.527469  2017 tablet_replica.cc:333] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.527987  2017 raft_consensus.cc:2243] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.528908  2017 raft_consensus.cc:2272] T 8c617ad97f8c44009de3d3d47311ad6a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.531227  2017 tablet_replica.cc:333] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.531618  9275 raft_consensus.cc:493] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b02838a902c44ea49d8d94181285b20e)
I20260709 12:16:15.532029  2017 raft_consensus.cc:2243] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.532275  9275 raft_consensus.cc:515] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9058059c81534bc4b58c5329d5734dcc" member_type: VOTER last_known_addr { host: "127.1.248.68" port: 44023 } } peers { permanent_uuid: "ee6a7bcc0bc742dda6ce79fbd49d6e49" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 34153 } } peers { permanent_uuid: "b02838a902c44ea49d8d94181285b20e" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42019 } }
I20260709 12:16:15.533458  2017 raft_consensus.cc:2272] T e54e3337256948f3b81b2ac605542399 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.534794  9275 leader_election.cc:290] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153), b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019)
I20260709 12:16:15.536777  2017 tablet_replica.cc:333] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.537570  2017 raft_consensus.cc:2243] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.538268  2017 raft_consensus.cc:2272] T e6fc1fe247f341ed91a83cf61e4529f3 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:15.540683  8296 leader_election.cc:336] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02838a902c44ea49d8d94181285b20e (127.1.248.66:42019): Network error: Client connection negotiation failed: client connection to 127.1.248.66:42019: connect: Connection refused (error 111)
W20260709 12:16:15.541179  8293 leader_election.cc:336] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee6a7bcc0bc742dda6ce79fbd49d6e49 (127.1.248.65:34153): Network error: Client connection negotiation failed: client connection to 127.1.248.65:34153: connect: Connection refused (error 111)
I20260709 12:16:15.541656  8293 leader_election.cc:304] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9058059c81534bc4b58c5329d5734dcc; no voters: b02838a902c44ea49d8d94181285b20e, ee6a7bcc0bc742dda6ce79fbd49d6e49
I20260709 12:16:15.542446  9265 raft_consensus.cc:2749] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:15.544730  2017 tablet_replica.cc:333] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.545336  2017 raft_consensus.cc:2243] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.545797  2017 raft_consensus.cc:2272] T a9c3e4c9802147f59a86d193db6f981a P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.548105  2017 tablet_replica.cc:333] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.548653  2017 raft_consensus.cc:2243] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.549204  2017 raft_consensus.cc:2272] T 74d6768968ae4371bbc6973eaf2851d7 P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.551473  2017 tablet_replica.cc:333] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.552034  2017 raft_consensus.cc:2243] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.553033  2017 raft_consensus.cc:2272] T 676232727c4f42c28fd5608fbeb3f634 P 9058059c81534bc4b58c5329d5734dcc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.555656  2017 tablet_replica.cc:333] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.556181  2017 raft_consensus.cc:2243] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.556686  2017 raft_consensus.cc:2272] T 9e8ee678c5a84a93befee23e8e48c8ea P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.559213  2017 tablet_replica.cc:333] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc: stopping tablet replica
I20260709 12:16:15.559809  2017 raft_consensus.cc:2243] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.560396  2017 raft_consensus.cc:2272] T 4586406114304e5a9209b76096a2f1ba P 9058059c81534bc4b58c5329d5734dcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.667683  2017 tablet_server.cc:196] TabletServer@127.1.248.68:0 shutdown complete.
I20260709 12:16:15.737098  2017 master.cc:562] Master@127.1.248.126:46043 shutting down...
W20260709 12:16:15.766566  8053 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:16:15.767714  2017 raft_consensus.cc:2243] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.768460  2017 raft_consensus.cc:2272] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.768822  2017 tablet_replica.cc:333] T 00000000000000000000000000000000 P de43d4a3f3f646a889a53bee10415e84: stopping tablet replica
I20260709 12:16:15.791092  2017 master.cc:584] Master@127.1.248.126:46043 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36234 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:16:15.883920  2017 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.248.126:34829
I20260709 12:16:15.885046  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:15.891067  9278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.891238  9279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.891834  9281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:15.892524  2017 server_base.cc:1061] running on GCE node
I20260709 12:16:15.893632  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:15.893836  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:15.894016  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599375893981 us; error 0 us; skew 500 ppm
I20260709 12:16:15.894574  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:15.897069  2017 webserver.cc:533] Webserver started at http://127.1.248.126:46431/ using document root <none> and password file <none>
I20260709 12:16:15.897573  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:15.897764  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:15.898046  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:15.899345  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/master-0-root/instance:
uuid: "0f61ecbd836e4370acd4c3ede787eea8"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-z9f9"
I20260709 12:16:15.903983  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:15.907394  9286 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.908259  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:16:15.908560  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/master-0-root
uuid: "0f61ecbd836e4370acd4c3ede787eea8"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-z9f9"
I20260709 12:16:15.908856  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:15.927230  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:15.928524  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:15.966982  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.126:34829
I20260709 12:16:15.967123  9337 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.126:34829 every 8 connection(s)
I20260709 12:16:15.971069  9338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:15.982309  9338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8: Bootstrap starting.
I20260709 12:16:15.987383  9338 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.991864  9338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8: No bootstrap required, opened a new log
I20260709 12:16:15.994129  9338 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f61ecbd836e4370acd4c3ede787eea8" member_type: VOTER }
I20260709 12:16:15.994520  9338 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.994783  9338 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f61ecbd836e4370acd4c3ede787eea8, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.995402  9338 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f61ecbd836e4370acd4c3ede787eea8" member_type: VOTER }
I20260709 12:16:15.995931  9338 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:15.996187  9338 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:15.996455  9338 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:16.001411  9338 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f61ecbd836e4370acd4c3ede787eea8" member_type: VOTER }
I20260709 12:16:16.002013  9338 leader_election.cc:304] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f61ecbd836e4370acd4c3ede787eea8; no voters: 
I20260709 12:16:16.003123  9338 leader_election.cc:290] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:16.003613  9341 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:16.004998  9341 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [term 1 LEADER]: Becoming Leader. State: Replica: 0f61ecbd836e4370acd4c3ede787eea8, State: Running, Role: LEADER
I20260709 12:16:16.005707  9341 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f61ecbd836e4370acd4c3ede787eea8" member_type: VOTER }
I20260709 12:16:16.006161  9338 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:16.011270  9343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f61ecbd836e4370acd4c3ede787eea8. Latest consensus state: current_term: 1 leader_uuid: "0f61ecbd836e4370acd4c3ede787eea8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f61ecbd836e4370acd4c3ede787eea8" member_type: VOTER } }
I20260709 12:16:16.012388  9343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:16.016675  9342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f61ecbd836e4370acd4c3ede787eea8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f61ecbd836e4370acd4c3ede787eea8" member_type: VOTER } }
I20260709 12:16:16.018422  9342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:16.019381  9347 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:16.025187  9347 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:16.028453  2017 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:16.034727  9347 catalog_manager.cc:1383] Generated new cluster ID: 8a693a0835af4a728f6aaa9b4671a68a
I20260709 12:16:16.035048  9347 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:16.062670  9347 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:16.063989  9347 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:16.076439  9347 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8: Generated new TSK 0
I20260709 12:16:16.077065  9347 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:16.095794  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:16.103518  9360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:16.104177  9359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:16.106170  9362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:16.106173  2017 server_base.cc:1061] running on GCE node
I20260709 12:16:16.107996  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:16.108280  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:16.108497  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599376108477 us; error 0 us; skew 500 ppm
I20260709 12:16:16.109349  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:16.112273  2017 webserver.cc:533] Webserver started at http://127.1.248.65:39449/ using document root <none> and password file <none>
I20260709 12:16:16.112771  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:16.112931  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:16.113245  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:16.114431  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-0-root/instance:
uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
format_stamp: "Formatted at 2026-07-09 12:16:16 on dist-test-slave-z9f9"
I20260709 12:16:16.118901  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:16:16.122275  9367 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.123136  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:16.123469  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-0-root
uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
format_stamp: "Formatted at 2026-07-09 12:16:16 on dist-test-slave-z9f9"
I20260709 12:16:16.123787  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:16.145123  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:16.146400  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:16.147927  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:16.150185  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:16.150413  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.150651  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:16.150851  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.190742  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.65:36775
I20260709 12:16:16.190856  9429 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.65:36775 every 8 connection(s)
I20260709 12:16:16.195915  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:16.202936  9434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:16.205566  9435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:16.207368  9437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:16.207964  2017 server_base.cc:1061] running on GCE node
I20260709 12:16:16.209263  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:16.209488  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:16.209669  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599376209650 us; error 0 us; skew 500 ppm
I20260709 12:16:16.210220  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:16.213097  2017 webserver.cc:533] Webserver started at http://127.1.248.66:46109/ using document root <none> and password file <none>
I20260709 12:16:16.213718  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:16.213965  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:16.214280  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:16.215082  9430 heartbeater.cc:344] Connected to a master server at 127.1.248.126:34829
I20260709 12:16:16.215569  9430 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:16.215878  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-1-root/instance:
uuid: "975239029ee743a49fda6ea39e29e39f"
format_stamp: "Formatted at 2026-07-09 12:16:16 on dist-test-slave-z9f9"
I20260709 12:16:16.216482  9430 heartbeater.cc:507] Master 127.1.248.126:34829 requested a full tablet report, sending...
I20260709 12:16:16.218880  9303 ts_manager.cc:194] Registered new tserver with Master: 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775)
I20260709 12:16:16.221278  9303 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40078
I20260709 12:16:16.221678  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:16.225548  9442 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.226325  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:16.226655  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-1-root
uuid: "975239029ee743a49fda6ea39e29e39f"
format_stamp: "Formatted at 2026-07-09 12:16:16 on dist-test-slave-z9f9"
I20260709 12:16:16.227021  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:16.249719  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:16.250919  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:16.252379  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:16.254594  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:16.254827  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.255106  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:16.255287  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.296502  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.66:34381
I20260709 12:16:16.296622  9504 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.66:34381 every 8 connection(s)
I20260709 12:16:16.301510  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:16.308626  9508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:16.310729  9509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:16.317116  9511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:16.319180  2017 server_base.cc:1061] running on GCE node
I20260709 12:16:16.319772  9505 heartbeater.cc:344] Connected to a master server at 127.1.248.126:34829
I20260709 12:16:16.320350  9505 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:16.321251  9505 heartbeater.cc:507] Master 127.1.248.126:34829 requested a full tablet report, sending...
I20260709 12:16:16.322759  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:16.323083  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:16.323300  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599376323277 us; error 0 us; skew 500 ppm
I20260709 12:16:16.323519  9303 ts_manager.cc:194] Registered new tserver with Master: 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:16.324108  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:16.325299  9303 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40092
I20260709 12:16:16.326924  2017 webserver.cc:533] Webserver started at http://127.1.248.67:45269/ using document root <none> and password file <none>
I20260709 12:16:16.327518  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:16.327736  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:16.328004  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:16.329236  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-2-root/instance:
uuid: "770f433b448e4c96b3f14cec38050f78"
format_stamp: "Formatted at 2026-07-09 12:16:16 on dist-test-slave-z9f9"
I20260709 12:16:16.333711  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:16:16.336979  9516 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.337705  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:16:16.338006  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-2-root
uuid: "770f433b448e4c96b3f14cec38050f78"
format_stamp: "Formatted at 2026-07-09 12:16:16 on dist-test-slave-z9f9"
I20260709 12:16:16.338294  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:16.356101  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:16.357259  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:16.358713  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:16.360996  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:16.361227  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.361461  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:16.361641  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.402274  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.67:39315
I20260709 12:16:16.402431  9578 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.67:39315 every 8 connection(s)
I20260709 12:16:16.419167  9579 heartbeater.cc:344] Connected to a master server at 127.1.248.126:34829
I20260709 12:16:16.419660  9579 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:16.420430  9579 heartbeater.cc:507] Master 127.1.248.126:34829 requested a full tablet report, sending...
I20260709 12:16:16.422399  9303 ts_manager.cc:194] Registered new tserver with Master: 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:16.422851  2017 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017217286s
I20260709 12:16:16.424276  9303 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40104
I20260709 12:16:16.449790  9303 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40120:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:16.452559  9303 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:16.537418  9544 tablet_service.cc:1511] Processing CreateTablet for tablet b53904db39454a01bd1dd16051716506 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:16.538452  9543 tablet_service.cc:1511] Processing CreateTablet for tablet 8eeca4a371974615b7d16370e49f34a0 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:16.540966  9542 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbb9d075ce04110939e34600a3caa61 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:16.543442  9541 tablet_service.cc:1511] Processing CreateTablet for tablet 0dcbf96644774836a52ff55eba9e0766 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:16.546648  9540 tablet_service.cc:1511] Processing CreateTablet for tablet 89d6d73e9bb74c36b31bd54999e07e6f (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:16.548975  9539 tablet_service.cc:1511] Processing CreateTablet for tablet f079c8824415477d9a1ea60887ae1595 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:16.552814  9538 tablet_service.cc:1511] Processing CreateTablet for tablet 4efc970631114a12a10fe7a5504a4d92 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:16.553383  9470 tablet_service.cc:1511] Processing CreateTablet for tablet b53904db39454a01bd1dd16051716506 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:16.554693  9470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53904db39454a01bd1dd16051716506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.538926  9544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53904db39454a01bd1dd16051716506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.555673  9390 tablet_service.cc:1511] Processing CreateTablet for tablet f079c8824415477d9a1ea60887ae1595 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:16.556450  9395 tablet_service.cc:1511] Processing CreateTablet for tablet b53904db39454a01bd1dd16051716506 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:16.556634  9469 tablet_service.cc:1511] Processing CreateTablet for tablet 8eeca4a371974615b7d16370e49f34a0 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:16.557142  9390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f079c8824415477d9a1ea60887ae1595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.558058  9469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eeca4a371974615b7d16370e49f34a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.558768  9394 tablet_service.cc:1511] Processing CreateTablet for tablet 8eeca4a371974615b7d16370e49f34a0 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:16.559775  9538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4efc970631114a12a10fe7a5504a4d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.560263  9394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eeca4a371974615b7d16370e49f34a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.561048  9539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f079c8824415477d9a1ea60887ae1595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.560691  9468 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbb9d075ce04110939e34600a3caa61 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:16.562135  9468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbb9d075ce04110939e34600a3caa61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.562270  9543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eeca4a371974615b7d16370e49f34a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.561965  9388 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae886ea3fe3417aa20ddd5c18bfa088 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:16.562428  9393 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbb9d075ce04110939e34600a3caa61 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:16.563331  9542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbb9d075ce04110939e34600a3caa61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.563385  9388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae886ea3fe3417aa20ddd5c18bfa088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.564564  9540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d6d73e9bb74c36b31bd54999e07e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.564194  9467 tablet_service.cc:1511] Processing CreateTablet for tablet 0dcbf96644774836a52ff55eba9e0766 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:16.564814  9392 tablet_service.cc:1511] Processing CreateTablet for tablet 0dcbf96644774836a52ff55eba9e0766 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:16.566205  9467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dcbf96644774836a52ff55eba9e0766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.565930  9466 tablet_service.cc:1511] Processing CreateTablet for tablet 89d6d73e9bb74c36b31bd54999e07e6f (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:16.566596  9392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dcbf96644774836a52ff55eba9e0766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.567296  9541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dcbf96644774836a52ff55eba9e0766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.568626  9465 tablet_service.cc:1511] Processing CreateTablet for tablet f079c8824415477d9a1ea60887ae1595 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:16.568970  9391 tablet_service.cc:1511] Processing CreateTablet for tablet 89d6d73e9bb74c36b31bd54999e07e6f (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:16.570694  9391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d6d73e9bb74c36b31bd54999e07e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.571539  9464 tablet_service.cc:1511] Processing CreateTablet for tablet 4efc970631114a12a10fe7a5504a4d92 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:16.560698  9389 tablet_service.cc:1511] Processing CreateTablet for tablet 4efc970631114a12a10fe7a5504a4d92 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:16.573590  9393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbb9d075ce04110939e34600a3caa61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.574702  9389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4efc970631114a12a10fe7a5504a4d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.567253  9466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d6d73e9bb74c36b31bd54999e07e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.575516  9395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53904db39454a01bd1dd16051716506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.576828  9465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f079c8824415477d9a1ea60887ae1595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.578190  9464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4efc970631114a12a10fe7a5504a4d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.580113  9387 tablet_service.cc:1511] Processing CreateTablet for tablet 3d6560cf2ae24bc18c29b8ee44880ce8 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:16.581869  9387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d6560cf2ae24bc18c29b8ee44880ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.585924  9463 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae886ea3fe3417aa20ddd5c18bfa088 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:16.587798  9463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae886ea3fe3417aa20ddd5c18bfa088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.599975  9462 tablet_service.cc:1511] Processing CreateTablet for tablet 3d6560cf2ae24bc18c29b8ee44880ce8 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:16.602065  9462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d6560cf2ae24bc18c29b8ee44880ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.610642  9537 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae886ea3fe3417aa20ddd5c18bfa088 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:16.612193  9537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae886ea3fe3417aa20ddd5c18bfa088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.627640  9386 tablet_service.cc:1511] Processing CreateTablet for tablet c47e4ef014534c2da755ca1ed4f2d9cf (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:16.631412  9461 tablet_service.cc:1511] Processing CreateTablet for tablet c47e4ef014534c2da755ca1ed4f2d9cf (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:16.632999  9461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47e4ef014534c2da755ca1ed4f2d9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.639806  9386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47e4ef014534c2da755ca1ed4f2d9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.658301  9536 tablet_service.cc:1511] Processing CreateTablet for tablet 3d6560cf2ae24bc18c29b8ee44880ce8 (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:16.659933  9536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d6560cf2ae24bc18c29b8ee44880ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.665390  9535 tablet_service.cc:1511] Processing CreateTablet for tablet c47e4ef014534c2da755ca1ed4f2d9cf (DEFAULT_TABLE table=test-workload [id=65cc50b473d148ff8e236dcf2f06ed66]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:16.667198  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47e4ef014534c2da755ca1ed4f2d9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.712641  9594 tablet_bootstrap.cc:492] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f: Bootstrap starting.
I20260709 12:16:16.723261  9595 tablet_bootstrap.cc:492] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78: Bootstrap starting.
I20260709 12:16:16.749953  9595 tablet_bootstrap.cc:654] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.773082  9594 tablet_bootstrap.cc:654] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.800657  9596 tablet_bootstrap.cc:492] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:16.811285  9596 tablet_bootstrap.cc:654] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.825268  9595 tablet_bootstrap.cc:492] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78: No bootstrap required, opened a new log
I20260709 12:16:16.825999  9596 tablet_bootstrap.cc:492] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5: No bootstrap required, opened a new log
I20260709 12:16:16.825999  9595 ts_tablet_manager.cc:1403] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.013s
I20260709 12:16:16.826784  9594 tablet_bootstrap.cc:492] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f: No bootstrap required, opened a new log
I20260709 12:16:16.827365  9594 ts_tablet_manager.cc:1403] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.025s
I20260709 12:16:16.827842  9596 ts_tablet_manager.cc:1403] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.015s
I20260709 12:16:16.829528  9595 raft_consensus.cc:359] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.830405  9595 raft_consensus.cc:385] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.830175  9594 raft_consensus.cc:359] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.830816  9595 raft_consensus.cc:740] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.831789  9595 consensus_queue.cc:260] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.831948  9596 raft_consensus.cc:359] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.832798  9596 raft_consensus.cc:385] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.833177  9596 raft_consensus.cc:740] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.834682  9579 heartbeater.cc:499] Master 127.1.248.126:34829 was elected leader, sending a full tablet report...
I20260709 12:16:16.834187  9596 consensus_queue.cc:260] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.830953  9594 raft_consensus.cc:385] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.835266  9595 ts_tablet_manager.cc:1434] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:16:16.835749  9594 raft_consensus.cc:740] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.836706  9595 tablet_bootstrap.cc:492] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78: Bootstrap starting.
I20260709 12:16:16.836757  9594 consensus_queue.cc:260] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.845602  9595 tablet_bootstrap.cc:654] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.847223  9430 heartbeater.cc:499] Master 127.1.248.126:34829 was elected leader, sending a full tablet report...
I20260709 12:16:16.848453  9596 ts_tablet_manager.cc:1434] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.020s	user 0.012s	sys 0.001s
I20260709 12:16:16.849967  9596 tablet_bootstrap.cc:492] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:16.861021  9596 tablet_bootstrap.cc:654] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.862603  9595 tablet_bootstrap.cc:492] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78: No bootstrap required, opened a new log
I20260709 12:16:16.863288  9595 ts_tablet_manager.cc:1403] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.008s
I20260709 12:16:16.867583  9595 raft_consensus.cc:359] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:16.868728  9595 raft_consensus.cc:385] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.869180  9595 raft_consensus.cc:740] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.870375  9595 consensus_queue.cc:260] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:16.873258  9595 ts_tablet_manager.cc:1434] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:16:16.873492  9596 tablet_bootstrap.cc:492] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5: No bootstrap required, opened a new log
I20260709 12:16:16.874107  9596 ts_tablet_manager.cc:1403] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.010s
I20260709 12:16:16.874432  9595 tablet_bootstrap.cc:492] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78: Bootstrap starting.
I20260709 12:16:16.877341  9596 raft_consensus.cc:359] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.878188  9596 raft_consensus.cc:385] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.878549  9596 raft_consensus.cc:740] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.879643  9596 consensus_queue.cc:260] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.882454  9596 ts_tablet_manager.cc:1434] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:16.882454  9595 tablet_bootstrap.cc:654] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.883821  9596 tablet_bootstrap.cc:492] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:16.884765  9505 heartbeater.cc:499] Master 127.1.248.126:34829 was elected leader, sending a full tablet report...
I20260709 12:16:16.885473  9594 ts_tablet_manager.cc:1434] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f: Time spent starting tablet: real 0.058s	user 0.032s	sys 0.020s
I20260709 12:16:16.886634  9594 tablet_bootstrap.cc:492] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f: Bootstrap starting.
I20260709 12:16:16.891901  9596 tablet_bootstrap.cc:654] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.893407  9594 tablet_bootstrap.cc:654] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.905417  9596 tablet_bootstrap.cc:492] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5: No bootstrap required, opened a new log
I20260709 12:16:16.906056  9596 ts_tablet_manager.cc:1403] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
W20260709 12:16:16.906888  9580 tablet.cc:2406] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:16.907558  9595 tablet_bootstrap.cc:492] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78: No bootstrap required, opened a new log
I20260709 12:16:16.908134  9595 ts_tablet_manager.cc:1403] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.003s
I20260709 12:16:16.909619  9596 raft_consensus.cc:359] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.910493  9596 raft_consensus.cc:385] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.910817  9596 raft_consensus.cc:740] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.911491  9595 raft_consensus.cc:359] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.911702  9596 consensus_queue.cc:260] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.912371  9595 raft_consensus.cc:385] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.912712  9595 raft_consensus.cc:740] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.914273  9596 ts_tablet_manager.cc:1434] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:16:16.916287  9596 tablet_bootstrap.cc:492] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:16.916083  9595 consensus_queue.cc:260] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.918586  9594 tablet_bootstrap.cc:492] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f: No bootstrap required, opened a new log
I20260709 12:16:16.919824  9594 ts_tablet_manager.cc:1403] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.005s
I20260709 12:16:16.922235  9594 raft_consensus.cc:359] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.922797  9594 raft_consensus.cc:385] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.923059  9594 raft_consensus.cc:740] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.918606  9595 ts_tablet_manager.cc:1434] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:16:16.923780  9594 consensus_queue.cc:260] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.924448  9595 tablet_bootstrap.cc:492] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78: Bootstrap starting.
I20260709 12:16:16.924937  9596 tablet_bootstrap.cc:654] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.926115  9594 ts_tablet_manager.cc:1434] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:16.927183  9594 tablet_bootstrap.cc:492] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f: Bootstrap starting.
I20260709 12:16:16.932587  9595 tablet_bootstrap.cc:654] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.933681  9594 tablet_bootstrap.cc:654] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.935985  9601 raft_consensus.cc:493] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.936805  9601 raft_consensus.cc:515] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.944253  9601 leader_election.cc:290] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:16.961230  9596 tablet_bootstrap.cc:492] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5: No bootstrap required, opened a new log
I20260709 12:16:16.962118  9596 ts_tablet_manager.cc:1403] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.002s
I20260709 12:16:16.962337  9595 tablet_bootstrap.cc:492] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78: No bootstrap required, opened a new log
I20260709 12:16:16.963133  9595 ts_tablet_manager.cc:1403] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.009s
I20260709 12:16:16.965857  9596 raft_consensus.cc:359] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.966213  9595 raft_consensus.cc:359] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.966966  9596 raft_consensus.cc:385] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.967236  9595 raft_consensus.cc:385] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.967356  9596 raft_consensus.cc:740] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.967711  9595 raft_consensus.cc:740] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.967978  9594 tablet_bootstrap.cc:492] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f: No bootstrap required, opened a new log
I20260709 12:16:16.968555  9594 ts_tablet_manager.cc:1403] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.000s
I20260709 12:16:16.968309  9596 consensus_queue.cc:260] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.968714  9595 consensus_queue.cc:260] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.970937  9596 ts_tablet_manager.cc:1434] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 12:16:16.972003  9596 tablet_bootstrap.cc:492] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:16.971711  9594 raft_consensus.cc:359] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.972479  9594 raft_consensus.cc:385] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.972776  9594 raft_consensus.cc:740] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.977501  9595 ts_tablet_manager.cc:1434] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:16:16.977813  9594 consensus_queue.cc:260] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.978971  9596 tablet_bootstrap.cc:654] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.980176  9594 ts_tablet_manager.cc:1434] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:16:16.981285  9594 tablet_bootstrap.cc:492] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f: Bootstrap starting.
I20260709 12:16:16.988333  9595 tablet_bootstrap.cc:492] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78: Bootstrap starting.
I20260709 12:16:16.990499  9596 tablet_bootstrap.cc:492] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5: No bootstrap required, opened a new log
I20260709 12:16:16.991078  9596 ts_tablet_manager.cc:1403] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 12:16:16.993580  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0" candidate_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f" is_pre_election: true
I20260709 12:16:16.994103  9596 raft_consensus.cc:359] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:16.994879  9596 raft_consensus.cc:385] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.995190  9596 raft_consensus.cc:740] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
W20260709 12:16:16.995371  9368 leader_election.cc:343] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:16.995312  9594 tablet_bootstrap.cc:654] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.996342  9596 consensus_queue.cc:260] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.001192  9601 raft_consensus.cc:493] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.001891  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0" candidate_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78" is_pre_election: true
I20260709 12:16:17.002266  9595 tablet_bootstrap.cc:654] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.001828  9601 raft_consensus.cc:515] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
W20260709 12:16:17.003731  9370 leader_election.cc:343] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.004657  9370 leader_election.cc:304] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 770f433b448e4c96b3f14cec38050f78, 975239029ee743a49fda6ea39e29e39f
I20260709 12:16:17.005455  9601 leader_election.cc:290] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:17.005466  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae886ea3fe3417aa20ddd5c18bfa088" candidate_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f" is_pre_election: true
I20260709 12:16:17.006348  9601 raft_consensus.cc:2749] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:17.007253  9368 leader_election.cc:343] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.008289  9596 ts_tablet_manager.cc:1434] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 12:16:17.009769  9596 tablet_bootstrap.cc:492] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:17.017584  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae886ea3fe3417aa20ddd5c18bfa088" candidate_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78" is_pre_election: true
I20260709 12:16:17.018302  9554 raft_consensus.cc:2468] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9952bfb8b4f94a3babf61207c8b8c8d5 in term 0.
I20260709 12:16:17.018759  9596 tablet_bootstrap.cc:654] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.020056  9595 tablet_bootstrap.cc:492] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78: No bootstrap required, opened a new log
I20260709 12:16:17.020642  9595 ts_tablet_manager.cc:1403] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.007s
I20260709 12:16:17.020081  9370 leader_election.cc:304] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 975239029ee743a49fda6ea39e29e39f
W20260709 12:16:17.023268  9351 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:17.023864  9615 raft_consensus.cc:2804] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.024493  9615 raft_consensus.cc:493] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.024986  9615 raft_consensus.cc:3060] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.026443  9595 raft_consensus.cc:359] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.027334  9595 raft_consensus.cc:385] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.027688  9595 raft_consensus.cc:740] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.028779  9595 consensus_queue.cc:260] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.031891  9596 tablet_bootstrap.cc:492] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5: No bootstrap required, opened a new log
I20260709 12:16:17.032730  9596 ts_tablet_manager.cc:1403] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 12:16:17.033218  9595 ts_tablet_manager.cc:1434] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:16:17.031903  9594 tablet_bootstrap.cc:492] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f: No bootstrap required, opened a new log
I20260709 12:16:17.033905  9594 ts_tablet_manager.cc:1403] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f: Time spent bootstrapping tablet: real 0.053s	user 0.024s	sys 0.013s
I20260709 12:16:17.034337  9595 tablet_bootstrap.cc:492] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78: Bootstrap starting.
I20260709 12:16:17.034152  9615 raft_consensus.cc:515] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.037169  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae886ea3fe3417aa20ddd5c18bfa088" candidate_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f"
I20260709 12:16:17.037359  9594 raft_consensus.cc:359] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.038246  9594 raft_consensus.cc:385] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.038596  9594 raft_consensus.cc:740] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Initialized, Role: FOLLOWER
W20260709 12:16:17.038658  9368 leader_election.cc:343] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.038772  9596 raft_consensus.cc:359] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.039731  9596 raft_consensus.cc:385] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.040109  9596 raft_consensus.cc:740] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.039837  9594 consensus_queue.cc:260] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.041143  9596 consensus_queue.cc:260] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.042981  9602 raft_consensus.cc:493] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.043641  9596 ts_tablet_manager.cc:1434] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:16:17.043514  9602 raft_consensus.cc:515] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.044770  9615 leader_election.cc:290] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 election: Requested vote from peers 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:17.045773  9596 tablet_bootstrap.cc:492] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:17.046137  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae886ea3fe3417aa20ddd5c18bfa088" candidate_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78"
I20260709 12:16:17.046761  9554 raft_consensus.cc:3060] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.050992  9595 tablet_bootstrap.cc:654] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.055992  9596 tablet_bootstrap.cc:654] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.052407  9602 leader_election.cc:290] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:17.070930  9554 raft_consensus.cc:2468] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9952bfb8b4f94a3babf61207c8b8c8d5 in term 1.
I20260709 12:16:17.072368  9370 leader_election.cc:304] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 975239029ee743a49fda6ea39e29e39f
I20260709 12:16:17.079988  9594 ts_tablet_manager.cc:1434] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.019s
I20260709 12:16:17.077623  9615 raft_consensus.cc:2804] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.081153  9594 tablet_bootstrap.cc:492] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f: Bootstrap starting.
I20260709 12:16:17.081156  9615 raft_consensus.cc:697] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 LEADER]: Becoming Leader. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Running, Role: LEADER
I20260709 12:16:17.082297  9615 consensus_queue.cc:237] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.085536  9600 raft_consensus.cc:493] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.086228  9600 raft_consensus.cc:515] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:17.088601  9594 tablet_bootstrap.cc:654] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.092590  9600 leader_election.cc:290] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381), 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775)
I20260709 12:16:17.108654  9600 raft_consensus.cc:493] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.109236  9600 raft_consensus.cc:515] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.113029  9596 tablet_bootstrap.cc:492] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5: No bootstrap required, opened a new log
I20260709 12:16:17.113646  9596 ts_tablet_manager.cc:1403] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.001s
I20260709 12:16:17.116106  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" is_pre_election: true
I20260709 12:16:17.116724  9596 raft_consensus.cc:359] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.117206  9405 raft_consensus.cc:2468] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 0.
I20260709 12:16:17.118860  9615 raft_consensus.cc:493] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.119563  9615 raft_consensus.cc:515] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.120324  9600 leader_election.cc:290] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:17.123291  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d6d73e9bb74c36b31bd54999e07e6f" candidate_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f" is_pre_election: true
I20260709 12:16:17.123557  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78" is_pre_election: true
W20260709 12:16:17.124935  9368 leader_election.cc:343] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.125973  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d6d73e9bb74c36b31bd54999e07e6f" candidate_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78" is_pre_election: true
W20260709 12:16:17.128271  9370 leader_election.cc:343] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.128943  9370 leader_election.cc:304] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 770f433b448e4c96b3f14cec38050f78, 975239029ee743a49fda6ea39e29e39f
I20260709 12:16:17.130093  9595 tablet_bootstrap.cc:492] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78: No bootstrap required, opened a new log
I20260709 12:16:17.130052  9601 raft_consensus.cc:2749] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.130815  9595 ts_tablet_manager.cc:1403] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78: Time spent bootstrapping tablet: real 0.097s	user 0.029s	sys 0.024s
I20260709 12:16:17.117561  9596 raft_consensus.cc:385] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.131955  9596 raft_consensus.cc:740] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.132534  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53904db39454a01bd1dd16051716506" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" is_pre_election: true
I20260709 12:16:17.132714  9596 consensus_queue.cc:260] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.133617  9615 leader_election.cc:290] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:17.134307  9404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efc970631114a12a10fe7a5504a4d92" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" is_pre_election: true
I20260709 12:16:17.134995  9404 raft_consensus.cc:2468] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 0.
I20260709 12:16:17.135200  9596 ts_tablet_manager.cc:1434] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 12:16:17.134025  9595 raft_consensus.cc:359] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.135918  9595 raft_consensus.cc:385] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:17.136137  9518 leader_election.cc:343] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.136262  9596 tablet_bootstrap.cc:492] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:17.137450  9518 leader_election.cc:304] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:17.138253  9594 tablet_bootstrap.cc:492] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f: No bootstrap required, opened a new log
I20260709 12:16:17.138299  9600 raft_consensus.cc:2804] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.138932  9594 ts_tablet_manager.cc:1403] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.030s
I20260709 12:16:17.139026  9600 raft_consensus.cc:493] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.139669  9600 raft_consensus.cc:3060] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.123907  9444 leader_election.cc:304] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
W20260709 12:16:17.140668  9445 leader_election.cc:343] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.141605  9302 catalog_manager.cc:5697] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:17.142254  9594 raft_consensus.cc:359] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.143043  9594 raft_consensus.cc:385] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.143371  9594 raft_consensus.cc:740] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.142390  9618 raft_consensus.cc:2804] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.144181  9594 consensus_queue.cc:260] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.144874  9618 raft_consensus.cc:493] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.145283  9618 raft_consensus.cc:3060] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.146585  9594 ts_tablet_manager.cc:1434] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:16:17.136313  9595 raft_consensus.cc:740] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.148082  9602 raft_consensus.cc:493] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.148422  9595 consensus_queue.cc:260] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.148597  9602 raft_consensus.cc:515] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.151121  9602 leader_election.cc:290] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:17.153355  9404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" is_pre_election: true
I20260709 12:16:17.153610  9618 raft_consensus.cc:515] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.154446  9404 raft_consensus.cc:2468] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 0.
I20260709 12:16:17.156365  9444 leader_election.cc:304] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:17.156790  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78" is_pre_election: true
I20260709 12:16:17.157508  9554 raft_consensus.cc:2468] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 0.
I20260709 12:16:17.157661  9594 tablet_bootstrap.cc:492] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f: Bootstrap starting.
I20260709 12:16:17.158293  9596 tablet_bootstrap.cc:654] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.157516  9602 raft_consensus.cc:2804] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.159125  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53904db39454a01bd1dd16051716506" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f" is_pre_election: true
I20260709 12:16:17.159577  9602 raft_consensus.cc:493] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.160504  9602 raft_consensus.cc:3060] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.161339  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efc970631114a12a10fe7a5504a4d92" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f" is_pre_election: true
I20260709 12:16:17.164459  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78"
I20260709 12:16:17.165067  9480 raft_consensus.cc:2468] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 0.
I20260709 12:16:17.162497  9404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
W20260709 12:16:17.162312  9517 leader_election.cc:343] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.165869  9404 raft_consensus.cc:3060] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.165961  9517 leader_election.cc:304] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78; no voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5
W20260709 12:16:17.166891  9445 leader_election.cc:343] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.173792  9594 tablet_bootstrap.cc:654] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.175529  9618 leader_election.cc:290] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:17.175153  9404 raft_consensus.cc:2468] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 1.
I20260709 12:16:17.179342  9444 leader_election.cc:304] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 770f433b448e4c96b3f14cec38050f78
I20260709 12:16:17.180532  9618 raft_consensus.cc:2804] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.182304  9600 raft_consensus.cc:515] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.184526  9602 raft_consensus.cc:515] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.198261  9596 tablet_bootstrap.cc:492] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5: No bootstrap required, opened a new log
I20260709 12:16:17.198947  9596 ts_tablet_manager.cc:1403] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.063s	user 0.005s	sys 0.012s
I20260709 12:16:17.200165  9404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efc970631114a12a10fe7a5504a4d92" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:17.200455  9595 ts_tablet_manager.cc:1434] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.030s
I20260709 12:16:17.200803  9404 raft_consensus.cc:3060] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.200739  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efc970631114a12a10fe7a5504a4d92" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f"
I20260709 12:16:17.201468  9480 raft_consensus.cc:3060] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.201689  9596 raft_consensus.cc:359] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.202486  9596 raft_consensus.cc:385] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.202742  9596 raft_consensus.cc:740] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.203442  9596 consensus_queue.cc:260] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.205080  9595 tablet_bootstrap.cc:492] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78: Bootstrap starting.
I20260709 12:16:17.205804  9596 ts_tablet_manager.cc:1434] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:16:17.206765  9596 tablet_bootstrap.cc:492] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:17.198274  9594 tablet_bootstrap.cc:492] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f: No bootstrap required, opened a new log
I20260709 12:16:17.207967  9594 ts_tablet_manager.cc:1403] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.009s
I20260709 12:16:17.208817  9404 raft_consensus.cc:2468] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 1.
I20260709 12:16:17.210073  9518 leader_election.cc:304] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:17.210590  9480 raft_consensus.cc:2468] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 1.
I20260709 12:16:17.212345  9596 tablet_bootstrap.cc:654] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.213886  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:17.192977  9630 raft_consensus.cc:2749] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.193885  9618 raft_consensus.cc:697] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Becoming Leader. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:17.214319  9629 raft_consensus.cc:2804] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.215879  9595 tablet_bootstrap.cc:654] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.215718  9618 consensus_queue.cc:237] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.214445  9594 raft_consensus.cc:359] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.221019  9594 raft_consensus.cc:385] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.221416  9594 raft_consensus.cc:740] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.214564  9405 raft_consensus.cc:3060] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.222421  9594 consensus_queue.cc:260] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.215004  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78"
I20260709 12:16:17.224192  9554 raft_consensus.cc:3060] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.215806  9629 raft_consensus.cc:697] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Becoming Leader. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:17.225473  9629 consensus_queue.cc:237] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.226306  9594 ts_tablet_manager.cc:1434] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:16:17.227823  9594 tablet_bootstrap.cc:492] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f: Bootstrap starting.
I20260709 12:16:17.235214  9595 tablet_bootstrap.cc:492] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78: No bootstrap required, opened a new log
I20260709 12:16:17.236052  9595 ts_tablet_manager.cc:1403] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.008s
I20260709 12:16:17.240383  9595 raft_consensus.cc:359] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.241374  9595 raft_consensus.cc:385] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.241748  9595 raft_consensus.cc:740] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.242427  9405 raft_consensus.cc:2468] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 1.
I20260709 12:16:17.243737  9444 leader_election.cc:304] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:17.244865  9633 raft_consensus.cc:2804] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.248724  9594 tablet_bootstrap.cc:654] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.214515  9600 leader_election.cc:290] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:17.215004  9602 leader_election.cc:290] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:17.250401  9629 raft_consensus.cc:493] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.251238  9629 raft_consensus.cc:515] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.242676  9595 consensus_queue.cc:260] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.254304  9554 raft_consensus.cc:2468] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 1.
I20260709 12:16:17.256456  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dcbf96644774836a52ff55eba9e0766" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" is_pre_election: true
I20260709 12:16:17.256528  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dcbf96644774836a52ff55eba9e0766" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f" is_pre_election: true
I20260709 12:16:17.257043  9595 ts_tablet_manager.cc:1434] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
W20260709 12:16:17.258348  9517 leader_election.cc:343] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.258518  9595 tablet_bootstrap.cc:492] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78: Bootstrap starting.
I20260709 12:16:17.257386  9629 leader_election.cc:290] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:17.260108  9405 raft_consensus.cc:2468] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 0.
I20260709 12:16:17.261698  9518 leader_election.cc:304] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 975239029ee743a49fda6ea39e29e39f
I20260709 12:16:17.262499  9633 raft_consensus.cc:697] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Becoming Leader. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:17.263176  9629 raft_consensus.cc:2804] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.263690  9629 raft_consensus.cc:493] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.263602  9633 consensus_queue.cc:237] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.269966  9595 tablet_bootstrap.cc:654] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.270057  9629 raft_consensus.cc:3060] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.271407  9600 raft_consensus.cc:493] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.272554  9600 raft_consensus.cc:515] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.273777  9596 tablet_bootstrap.cc:492] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5: No bootstrap required, opened a new log
I20260709 12:16:17.274251  9596 ts_tablet_manager.cc:1403] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.068s	user 0.027s	sys 0.035s
I20260709 12:16:17.274686  9600 leader_election.cc:290] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:17.277379  9594 tablet_bootstrap.cc:492] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f: No bootstrap required, opened a new log
I20260709 12:16:17.277204  9596 raft_consensus.cc:359] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:17.277281  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d6d73e9bb74c36b31bd54999e07e6f" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f" is_pre_election: true
I20260709 12:16:17.278052  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d6d73e9bb74c36b31bd54999e07e6f" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" is_pre_election: true
I20260709 12:16:17.278311  9480 raft_consensus.cc:2468] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 0.
I20260709 12:16:17.278910  9405 raft_consensus.cc:2468] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 0.
I20260709 12:16:17.278067  9594 ts_tablet_manager.cc:1403] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.002s
I20260709 12:16:17.279908  9517 leader_election.cc:304] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 975239029ee743a49fda6ea39e29e39f; no voters: 
I20260709 12:16:17.280834  9600 raft_consensus.cc:2804] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.281313  9600 raft_consensus.cc:493] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.281749  9600 raft_consensus.cc:3060] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.283187  9594 raft_consensus.cc:359] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:17.285760  9594 raft_consensus.cc:385] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.286144  9594 raft_consensus.cc:740] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.270170  9640 raft_consensus.cc:493] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.290071  9640 raft_consensus.cc:515] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.290673  9595 tablet_bootstrap.cc:492] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78: No bootstrap required, opened a new log
I20260709 12:16:17.289829  9301 catalog_manager.cc:5697] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f reported cstate change: term changed from 0 to 1, leader changed from <none> to 975239029ee743a49fda6ea39e29e39f (127.1.248.66). New cstate: current_term: 1 leader_uuid: "975239029ee743a49fda6ea39e29e39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:17.291527  9596 raft_consensus.cc:385] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.291837  9596 raft_consensus.cc:740] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.292567  9596 consensus_queue.cc:260] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:17.290904  9600 raft_consensus.cc:515] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.293807  9595 ts_tablet_manager.cc:1403] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.004s
I20260709 12:16:17.294113  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6560cf2ae24bc18c29b8ee44880ce8" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78" is_pre_election: true
I20260709 12:16:17.294811  9554 raft_consensus.cc:2468] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 0.
I20260709 12:16:17.295732  9404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d6d73e9bb74c36b31bd54999e07e6f" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:17.296065  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d6d73e9bb74c36b31bd54999e07e6f" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f"
I20260709 12:16:17.296379  9404 raft_consensus.cc:3060] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.296676  9480 raft_consensus.cc:3060] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.296306  9640 leader_election.cc:290] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:17.296088  9445 leader_election.cc:304] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 975239029ee743a49fda6ea39e29e39f; no voters: 
I20260709 12:16:17.300498  9640 raft_consensus.cc:2804] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.301070  9594 consensus_queue.cc:260] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:17.295782  9303 catalog_manager.cc:5697] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 770f433b448e4c96b3f14cec38050f78 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "770f433b448e4c96b3f14cec38050f78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:17.303797  9594 ts_tablet_manager.cc:1434] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 12:16:17.304881  9594 tablet_bootstrap.cc:492] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f: Bootstrap starting.
I20260709 12:16:17.306951  9480 raft_consensus.cc:2468] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 1.
I20260709 12:16:17.308372  9517 leader_election.cc:304] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 975239029ee743a49fda6ea39e29e39f; no voters: 
I20260709 12:16:17.309188  9630 raft_consensus.cc:2804] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.310664  9596 ts_tablet_manager.cc:1434] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:16:17.310997  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6560cf2ae24bc18c29b8ee44880ce8" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" is_pre_election: true
I20260709 12:16:17.311589  9594 tablet_bootstrap.cc:654] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.311743  9596 tablet_bootstrap.cc:492] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:17.312964  9404 raft_consensus.cc:2468] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 1.
I20260709 12:16:17.311769  9405 raft_consensus.cc:2468] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 0.
I20260709 12:16:17.301393  9595 raft_consensus.cc:359] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.315670  9600 leader_election.cc:290] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:17.315842  9595 raft_consensus.cc:385] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.316160  9595 raft_consensus.cc:740] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.318331  9595 consensus_queue.cc:260] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.319033  9596 tablet_bootstrap.cc:654] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.300870  9640 raft_consensus.cc:493] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.320461  9595 ts_tablet_manager.cc:1434] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:16:17.320571  9640 raft_consensus.cc:3060] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.321476  9595 tablet_bootstrap.cc:492] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78: Bootstrap starting.
I20260709 12:16:17.324139  9594 tablet_bootstrap.cc:492] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f: No bootstrap required, opened a new log
I20260709 12:16:17.324747  9594 ts_tablet_manager.cc:1403] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.010s
I20260709 12:16:17.326658  9630 raft_consensus.cc:697] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Becoming Leader. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:17.327814  9630 consensus_queue.cc:237] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.328222  9594 raft_consensus.cc:359] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.328912  9594 raft_consensus.cc:385] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.329211  9594 raft_consensus.cc:740] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.330189  9594 consensus_queue.cc:260] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.331557  9595 tablet_bootstrap.cc:654] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.334009  9596 tablet_bootstrap.cc:492] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5: No bootstrap required, opened a new log
I20260709 12:16:17.334635  9596 ts_tablet_manager.cc:1403] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.012s
I20260709 12:16:17.336400  9594 ts_tablet_manager.cc:1434] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:16:17.337415  9594 tablet_bootstrap.cc:492] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f: Bootstrap starting.
I20260709 12:16:17.338501  9596 raft_consensus.cc:359] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.339202  9596 raft_consensus.cc:385] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.339491  9596 raft_consensus.cc:740] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.340350  9596 consensus_queue.cc:260] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.344308  9596 ts_tablet_manager.cc:1434] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:16:17.348757  9594 tablet_bootstrap.cc:654] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.351758  9629 raft_consensus.cc:515] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.354851  9404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dcbf96644774836a52ff55eba9e0766" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:17.355389  9404 raft_consensus.cc:3060] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.357040  9595 tablet_bootstrap.cc:492] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78: No bootstrap required, opened a new log
I20260709 12:16:17.356312  9301 catalog_manager.cc:5697] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 770f433b448e4c96b3f14cec38050f78 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "770f433b448e4c96b3f14cec38050f78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:17.357681  9595 ts_tablet_manager.cc:1403] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.005s
I20260709 12:16:17.359922  9629 leader_election.cc:290] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:17.361094  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dcbf96644774836a52ff55eba9e0766" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f"
I20260709 12:16:17.361722  9480 raft_consensus.cc:3060] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.362308  9640 raft_consensus.cc:515] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.364578  9640 leader_election.cc:290] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:17.365724  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6560cf2ae24bc18c29b8ee44880ce8" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:17.366482  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6560cf2ae24bc18c29b8ee44880ce8" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78"
I20260709 12:16:17.366973  9594 tablet_bootstrap.cc:492] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f: No bootstrap required, opened a new log
I20260709 12:16:17.367298  9554 raft_consensus.cc:3060] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.367604  9594 ts_tablet_manager.cc:1403] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.000s
I20260709 12:16:17.370463  9594 raft_consensus.cc:359] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.371146  9594 raft_consensus.cc:385] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.371448  9594 raft_consensus.cc:740] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.370976  9303 catalog_manager.cc:5697] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f reported cstate change: term changed from 0 to 1, leader changed from <none> to 975239029ee743a49fda6ea39e29e39f (127.1.248.66). New cstate: current_term: 1 leader_uuid: "975239029ee743a49fda6ea39e29e39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:17.366307  9595 raft_consensus.cc:359] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.372759  9595 raft_consensus.cc:385] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.372355  9594 consensus_queue.cc:260] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.373266  9405 raft_consensus.cc:3060] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.373611  9595 raft_consensus.cc:740] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.374619  9594 ts_tablet_manager.cc:1434] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:17.375927  9594 tablet_bootstrap.cc:492] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f: Bootstrap starting.
I20260709 12:16:17.377810  9480 raft_consensus.cc:2468] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 1.
I20260709 12:16:17.374485  9595 consensus_queue.cc:260] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.380924  9517 leader_election.cc:304] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 975239029ee743a49fda6ea39e29e39f; no voters: 
I20260709 12:16:17.382294  9595 ts_tablet_manager.cc:1434] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 12:16:17.382383  9594 tablet_bootstrap.cc:654] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.379148  9404 raft_consensus.cc:2468] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 1.
I20260709 12:16:17.384438  9595 tablet_bootstrap.cc:492] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78: Bootstrap starting.
I20260709 12:16:17.388008  9629 raft_consensus.cc:2804] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.388583  9629 raft_consensus.cc:697] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Becoming Leader. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:17.389446  9629 consensus_queue.cc:237] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.391531  9595 tablet_bootstrap.cc:654] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.395299  9554 raft_consensus.cc:2468] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 1.
I20260709 12:16:17.395833  9594 tablet_bootstrap.cc:492] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f: No bootstrap required, opened a new log
I20260709 12:16:17.396354  9594 ts_tablet_manager.cc:1403] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.003s
I20260709 12:16:17.396806  9445 leader_election.cc:304] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 975239029ee743a49fda6ea39e29e39f; no voters: 
I20260709 12:16:17.397336  9405 raft_consensus.cc:2468] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 1.
I20260709 12:16:17.398058  9640 raft_consensus.cc:2804] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.398543  9640 raft_consensus.cc:697] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Becoming Leader. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:17.399444  9594 raft_consensus.cc:359] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.400457  9594 raft_consensus.cc:385] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.400995  9594 raft_consensus.cc:740] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.399505  9640 consensus_queue.cc:237] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.402124  9594 consensus_queue.cc:260] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.405125  9594 ts_tablet_manager.cc:1434] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:16:17.419538  9640 raft_consensus.cc:493] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.420847  9640 raft_consensus.cc:515] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:17.420099  9630 raft_consensus.cc:493] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.422672  9630 raft_consensus.cc:515] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.424225  9303 catalog_manager.cc:5697] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f reported cstate change: term changed from 0 to 1, leader changed from <none> to 975239029ee743a49fda6ea39e29e39f (127.1.248.66). New cstate: current_term: 1 leader_uuid: "975239029ee743a49fda6ea39e29e39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:17.424854  9595 tablet_bootstrap.cc:492] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78: No bootstrap required, opened a new log
I20260709 12:16:17.426364  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53904db39454a01bd1dd16051716506" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" is_pre_election: true
I20260709 12:16:17.424935  9640 leader_election.cc:290] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315), 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775)
I20260709 12:16:17.427096  9405 raft_consensus.cc:2468] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 0.
I20260709 12:16:17.426760  9595 ts_tablet_manager.cc:1403] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78: Time spent bootstrapping tablet: real 0.043s	user 0.025s	sys 0.011s
I20260709 12:16:17.428623  9444 leader_election.cc:304] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:17.429526  9633 raft_consensus.cc:2804] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.427187  9301 catalog_manager.cc:5697] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 770f433b448e4c96b3f14cec38050f78 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "770f433b448e4c96b3f14cec38050f78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:17.430054  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53904db39454a01bd1dd16051716506" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78" is_pre_election: true
I20260709 12:16:17.430853  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" is_pre_election: true
I20260709 12:16:17.430958  9595 raft_consensus.cc:359] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.431766  9405 raft_consensus.cc:2393] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 770f433b448e4c96b3f14cec38050f78 in current term 1: Already voted for candidate 975239029ee743a49fda6ea39e29e39f in this term.
I20260709 12:16:17.431845  9595 raft_consensus.cc:385] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.432356  9595 raft_consensus.cc:740] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.433135  9595 consensus_queue.cc:260] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.429899  9633 raft_consensus.cc:493] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.434628  9633 raft_consensus.cc:3060] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.434818  9630 leader_election.cc:290] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:17.435211  9595 ts_tablet_manager.cc:1434] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:16:17.427237  9640 raft_consensus.cc:493] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.435978  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f" is_pre_election: true
I20260709 12:16:17.435907  9640 raft_consensus.cc:515] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.430783  9554 raft_consensus.cc:2468] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 0.
I20260709 12:16:17.438473  9517 leader_election.cc:304] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78; no voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5
I20260709 12:16:17.439898  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae886ea3fe3417aa20ddd5c18bfa088" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" is_pre_election: true
I20260709 12:16:17.441105  9630 raft_consensus.cc:3060] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.442059  9640 leader_election.cc:290] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:17.444051  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae886ea3fe3417aa20ddd5c18bfa088" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78" is_pre_election: true
I20260709 12:16:17.444856  9554 raft_consensus.cc:2393] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 975239029ee743a49fda6ea39e29e39f in current term 1: Already voted for candidate 9952bfb8b4f94a3babf61207c8b8c8d5 in this term.
I20260709 12:16:17.445822  9633 raft_consensus.cc:515] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:17.448010  9633 leader_election.cc:290] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 election: Requested vote from peers 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315), 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775)
I20260709 12:16:17.449172  9630 raft_consensus.cc:2749] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.449061  9444 leader_election.cc:304] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 975239029ee743a49fda6ea39e29e39f; no voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5
I20260709 12:16:17.449504  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53904db39454a01bd1dd16051716506" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78"
I20260709 12:16:17.449936  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53904db39454a01bd1dd16051716506" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:17.451397  9633 raft_consensus.cc:3060] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.451761  9405 raft_consensus.cc:3060] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.451249  9554 raft_consensus.cc:3060] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.458068  9554 raft_consensus.cc:2468] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 1.
I20260709 12:16:17.458846  9633 raft_consensus.cc:2749] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.459252  9445 leader_election.cc:304] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 975239029ee743a49fda6ea39e29e39f; no voters: 
I20260709 12:16:17.459653  9405 raft_consensus.cc:2468] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 1.
I20260709 12:16:17.460338  9633 raft_consensus.cc:2804] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.460879  9633 raft_consensus.cc:697] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Becoming Leader. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:17.461618  9633 consensus_queue.cc:237] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:17.463935  9630 raft_consensus.cc:493] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.464542  9630 raft_consensus.cc:515] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.466642  9630 leader_election.cc:290] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:17.467396  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" is_pre_election: true
I20260709 12:16:17.467654  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f" is_pre_election: true
I20260709 12:16:17.468143  9405 raft_consensus.cc:2468] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 0.
I20260709 12:16:17.468302  9480 raft_consensus.cc:2468] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 0.
I20260709 12:16:17.469429  9517 leader_election.cc:304] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 975239029ee743a49fda6ea39e29e39f; no voters: 
I20260709 12:16:17.470141  9630 raft_consensus.cc:2804] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.470521  9630 raft_consensus.cc:493] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.471006  9630 raft_consensus.cc:3060] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.470511  9303 catalog_manager.cc:5697] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f reported cstate change: term changed from 0 to 1, leader changed from <none> to 975239029ee743a49fda6ea39e29e39f (127.1.248.66). New cstate: current_term: 1 leader_uuid: "975239029ee743a49fda6ea39e29e39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:17.476100  9615 consensus_queue.cc:1048] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:17.477691  9630 raft_consensus.cc:515] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.481078  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:17.481516  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f"
I20260709 12:16:17.482173  9480 raft_consensus.cc:3060] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.481669  9405 raft_consensus.cc:3060] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.489957  9480 raft_consensus.cc:2468] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 1.
I20260709 12:16:17.491262  9517 leader_election.cc:304] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 975239029ee743a49fda6ea39e29e39f; no voters: 
I20260709 12:16:17.491637  9630 leader_election.cc:290] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 1 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:17.491089  9405 raft_consensus.cc:2468] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 1.
I20260709 12:16:17.492779  9630 raft_consensus.cc:2804] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.493402  9630 raft_consensus.cc:697] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Becoming Leader. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:17.494343  9630 consensus_queue.cc:237] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.497994  9615 consensus_queue.cc:1048] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:17.509675  9301 catalog_manager.cc:5697] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 770f433b448e4c96b3f14cec38050f78 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "770f433b448e4c96b3f14cec38050f78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:17.554615  9633 raft_consensus.cc:493] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.555205  9633 raft_consensus.cc:515] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.557144  9633 leader_election.cc:290] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:17.557952  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47e4ef014534c2da755ca1ed4f2d9cf" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" is_pre_election: true
I20260709 12:16:17.558209  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47e4ef014534c2da755ca1ed4f2d9cf" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78" is_pre_election: true
I20260709 12:16:17.558557  9405 raft_consensus.cc:2468] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 0.
I20260709 12:16:17.558867  9554 raft_consensus.cc:2468] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 0.
I20260709 12:16:17.559679  9444 leader_election.cc:304] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:17.560482  9633 raft_consensus.cc:2804] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.560853  9633 raft_consensus.cc:493] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.561167  9633 raft_consensus.cc:3060] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.566388  9633 raft_consensus.cc:515] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.568150  9633 leader_election.cc:290] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:17.568965  9405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47e4ef014534c2da755ca1ed4f2d9cf" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:17.569183  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47e4ef014534c2da755ca1ed4f2d9cf" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78"
I20260709 12:16:17.569617  9405 raft_consensus.cc:3060] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.569733  9554 raft_consensus.cc:3060] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.576766  9405 raft_consensus.cc:2468] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 1.
I20260709 12:16:17.576766  9554 raft_consensus.cc:2468] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 1.
I20260709 12:16:17.578118  9445 leader_election.cc:304] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 975239029ee743a49fda6ea39e29e39f; no voters: 
I20260709 12:16:17.578775  9633 raft_consensus.cc:2804] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.579262  9633 raft_consensus.cc:697] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Becoming Leader. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:17.580082  9633 consensus_queue.cc:237] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:17.586872  9301 catalog_manager.cc:5697] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f reported cstate change: term changed from 0 to 1, leader changed from <none> to 975239029ee743a49fda6ea39e29e39f (127.1.248.66). New cstate: current_term: 1 leader_uuid: "975239029ee743a49fda6ea39e29e39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:17.609982  9633 consensus_queue.cc:1048] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:17.621906  9633 consensus_queue.cc:1048] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:17.657881  9630 consensus_queue.cc:1048] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:17.668488  9629 consensus_queue.cc:1048] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:17.692435  2017 ts_manager.cc:295] Set tserver state for 9952bfb8b4f94a3babf61207c8b8c8d5 to MAINTENANCE_MODE
I20260709 12:16:17.693147  2017 tablet_server.cc:179] TabletServer@127.1.248.65:0 shutting down...
I20260709 12:16:17.714231  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:17.715065  2017 tablet_replica.cc:333] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5: stopping tablet replica
I20260709 12:16:17.715871  2017 raft_consensus.cc:2243] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.716255  2017 raft_consensus.cc:2272] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.718122  2017 tablet_replica.cc:333] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5: stopping tablet replica
I20260709 12:16:17.718637  2017 raft_consensus.cc:2243] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.718956  2017 raft_consensus.cc:2272] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.720613  2017 tablet_replica.cc:333] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5: stopping tablet replica
I20260709 12:16:17.721112  2017 raft_consensus.cc:2243] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.721452  2017 raft_consensus.cc:2272] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.723629  2017 tablet_replica.cc:333] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5: stopping tablet replica
I20260709 12:16:17.724113  2017 raft_consensus.cc:2243] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.724447  2017 raft_consensus.cc:2272] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.726114  2017 tablet_replica.cc:333] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5: stopping tablet replica
I20260709 12:16:17.726612  2017 raft_consensus.cc:2243] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.726979  2017 raft_consensus.cc:2272] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.728852  2017 tablet_replica.cc:333] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5: stopping tablet replica
I20260709 12:16:17.729357  2017 raft_consensus.cc:2243] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.729668  2017 raft_consensus.cc:2272] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.731138  2017 tablet_replica.cc:333] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5: stopping tablet replica
I20260709 12:16:17.731674  2017 raft_consensus.cc:2243] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.732021  2017 raft_consensus.cc:2272] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.734057  2017 tablet_replica.cc:333] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5: stopping tablet replica
I20260709 12:16:17.734515  2017 raft_consensus.cc:2243] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.734843  2017 raft_consensus.cc:2272] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.736702  2017 tablet_replica.cc:333] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5: stopping tablet replica
I20260709 12:16:17.737149  2017 raft_consensus.cc:2243] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.737871  2017 raft_consensus.cc:2272] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.739970  2017 tablet_replica.cc:333] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5: stopping tablet replica
I20260709 12:16:17.740379  2017 raft_consensus.cc:2243] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.740690  2017 raft_consensus.cc:2272] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.759475  2017 tablet_server.cc:196] TabletServer@127.1.248.65:0 shutdown complete.
W20260709 12:16:17.771790  9518 consensus_peers.cc:597] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:17.798300  9629 consensus_queue.cc:1048] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:17.811216  9518 consensus_peers.cc:597] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:17.812119  9618 consensus_queue.cc:1048] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:17.826128  9444 consensus_peers.cc:597] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:17.859349  9640 consensus_queue.cc:1048] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:17.871397  9444 consensus_peers.cc:597] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:17.877326  9629 consensus_queue.cc:1048] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:17.890281  9518 consensus_peers.cc:597] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:17.955243  9600 consensus_queue.cc:1048] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:18.000110  9602 consensus_queue.cc:1048] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:18.011641  9444 consensus_peers.cc:597] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:18.024226  9351 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:18.106180  9633 consensus_queue.cc:1048] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:18.119076  9444 consensus_peers.cc:597] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:18.194945  9518 consensus_peers.cc:597] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:18.232296  9444 consensus_peers.cc:597] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:18.907246  9518 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111) [suppressed 173 similar messages]
I20260709 12:16:18.990527  9629 raft_consensus.cc:493] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9952bfb8b4f94a3babf61207c8b8c8d5)
I20260709 12:16:18.991505  9629 raft_consensus.cc:515] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:18.994532  9629 leader_election.cc:290] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:18.995754  9479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae886ea3fe3417aa20ddd5c18bfa088" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "975239029ee743a49fda6ea39e29e39f" is_pre_election: true
W20260709 12:16:18.999137  9518 leader_election.cc:336] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111)
I20260709 12:16:18.999670  9518 leader_election.cc:304] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78; no voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5
I20260709 12:16:19.000461  9629 raft_consensus.cc:2749] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:19.001765  9678 raft_consensus.cc:493] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9952bfb8b4f94a3babf61207c8b8c8d5)
I20260709 12:16:19.002279  9678 raft_consensus.cc:515] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:19.004881  9678 leader_election.cc:290] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:19.006420  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae886ea3fe3417aa20ddd5c18bfa088" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78" is_pre_election: true
I20260709 12:16:19.007221  9554 raft_consensus.cc:2468] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 1.
W20260709 12:16:19.008172  9444 leader_election.cc:336] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111)
I20260709 12:16:19.008924  9445 leader_election.cc:304] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 975239029ee743a49fda6ea39e29e39f; no voters: 9952bfb8b4f94a3babf61207c8b8c8d5
I20260709 12:16:19.009829  9678 raft_consensus.cc:2804] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:19.010229  9678 raft_consensus.cc:493] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9952bfb8b4f94a3babf61207c8b8c8d5)
I20260709 12:16:19.010677  9678 raft_consensus.cc:3060] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:19.018126  9678 raft_consensus.cc:515] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:19.020351  9678 leader_election.cc:290] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 2 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:19.021442  9554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae886ea3fe3417aa20ddd5c18bfa088" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "770f433b448e4c96b3f14cec38050f78"
I20260709 12:16:19.022073  9554 raft_consensus.cc:3060] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:19.024158  9444 leader_election.cc:336] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111)
W20260709 12:16:19.025395  9351 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:19.028106  9554 raft_consensus.cc:2468] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 2.
I20260709 12:16:19.029273  9445 leader_election.cc:304] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 975239029ee743a49fda6ea39e29e39f; no voters: 9952bfb8b4f94a3babf61207c8b8c8d5
I20260709 12:16:19.030395  9678 raft_consensus.cc:2804] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:19.030860  9678 raft_consensus.cc:697] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 2 LEADER]: Becoming Leader. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:19.031648  9678 consensus_queue.cc:237] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:19.039984  9301 catalog_manager.cc:5697] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f reported cstate change: term changed from 1 to 2, leader changed from 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65) to 975239029ee743a49fda6ea39e29e39f (127.1.248.66). New cstate: current_term: 2 leader_uuid: "975239029ee743a49fda6ea39e29e39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:19.561944  9554 raft_consensus.cc:1275] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Refusing update from remote peer 975239029ee743a49fda6ea39e29e39f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:19.563580  9678 consensus_queue.cc:1048] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:19.576805  9444 consensus_peers.cc:597] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:19.943305  9444 consensus_peers.cc:597] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:20.026531  9351 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:16:20.285485  9518 consensus_peers.cc:597] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:20.288237  9518 consensus_peers.cc:597] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:20.473212  9444 consensus_peers.cc:597] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:20.558713  9444 consensus_peers.cc:597] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:20.692742  9444 consensus_peers.cc:597] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:20.694967  9444 consensus_peers.cc:597] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:20.701591  9518 consensus_peers.cc:597] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:20.728257  9518 consensus_peers.cc:597] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:21.027647  9351 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:16:22.028661  9351 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:16:22.057317  9444 consensus_peers.cc:597] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:22.472124  9444 consensus_peers.cc:597] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:22.672964  9518 consensus_peers.cc:597] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:22.677266  9444 consensus_peers.cc:597] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:22.778566  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:22.785452  9691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:22.785898  9518 consensus_peers.cc:597] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:22.786257  9690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:22.792117  2017 server_base.cc:1061] running on GCE node
W20260709 12:16:22.794657  9693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:22.797284  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:22.797621  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:22.797865  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599382797845 us; error 0 us; skew 500 ppm
I20260709 12:16:22.798722  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:22.801851  2017 webserver.cc:533] Webserver started at http://127.1.248.65:39449/ using document root <none> and password file <none>
I20260709 12:16:22.802597  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:22.802845  2017 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:16:22.806859  2017 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:16:22.810515  9698 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:22.811478  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:22.811746  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-0-root
uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
format_stamp: "Formatted at 2026-07-09 12:16:16 on dist-test-slave-z9f9"
I20260709 12:16:22.811998  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599108657414-2017-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:22.835379  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:22.836386  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:22.838039  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:22.842509  9705 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:16:22.894112  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:16:22.894385  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.053s	user 0.001s	sys 0.001s
I20260709 12:16:22.894610  2017 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:16:22.899113  9705 tablet_bootstrap.cc:492] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:22.910435  9705 tablet_bootstrap.cc:492] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:22.911326  9705 tablet_bootstrap.cc:492] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap complete.
I20260709 12:16:22.912039  9705 ts_tablet_manager.cc:1403] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.006s
I20260709 12:16:22.914738  9705 raft_consensus.cc:359] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:22.915460  9705 raft_consensus.cc:740] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.916220  9705 consensus_queue.cc:260] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:22.918852  9705 ts_tablet_manager.cc:1434] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:16:22.919725  9705 tablet_bootstrap.cc:492] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:22.933084  9705 tablet_bootstrap.cc:492] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:22.933943  9705 tablet_bootstrap.cc:492] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap complete.
I20260709 12:16:22.934650  9705 ts_tablet_manager.cc:1403] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:16:22.937227  9705 raft_consensus.cc:359] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:22.937937  9705 raft_consensus.cc:740] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.938648  9705 consensus_queue.cc:260] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:22.940659  9705 ts_tablet_manager.cc:1434] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:16:22.941480  9705 tablet_bootstrap.cc:492] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:22.948871  2017 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:16:22.949240  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.055s	user 0.052s	sys 0.001s
W20260709 12:16:22.950467  9518 consensus_peers.cc:597] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:22.954936  9705 tablet_bootstrap.cc:492] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:22.955858  9705 tablet_bootstrap.cc:492] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap complete.
I20260709 12:16:22.956519  9705 ts_tablet_manager.cc:1403] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.002s
I20260709 12:16:22.960191  9705 raft_consensus.cc:359] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:22.961042  9705 raft_consensus.cc:740] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.962021  9705 consensus_queue.cc:260] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:22.964730  9705 ts_tablet_manager.cc:1434] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:16:22.965765  9705 tablet_bootstrap.cc:492] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:22.980726  9705 tablet_bootstrap.cc:492] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:22.981448  9705 tablet_bootstrap.cc:492] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap complete.
I20260709 12:16:22.982031  9705 ts_tablet_manager.cc:1403] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:16:22.983963  9705 raft_consensus.cc:359] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:22.984570  9705 raft_consensus.cc:740] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.985316  9705 consensus_queue.cc:260] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:22.987288  9705 ts_tablet_manager.cc:1434] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:22.987953  9705 tablet_bootstrap.cc:492] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:22.998214  9705 tablet_bootstrap.cc:492] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:22.998974  9705 tablet_bootstrap.cc:492] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap complete.
I20260709 12:16:22.999603  9705 ts_tablet_manager.cc:1403] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:16:23.001453  9705 raft_consensus.cc:359] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:23.002046  9705 raft_consensus.cc:740] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.002702  9705 consensus_queue.cc:260] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:23.004277  9705 ts_tablet_manager.cc:1434] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:16:23.004943  9705 tablet_bootstrap.cc:492] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:23.007036  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.65:36775
I20260709 12:16:23.007148  9767 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.65:36775 every 8 connection(s)
I20260709 12:16:23.012636  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:23.028347  9705 tablet_bootstrap.cc:492] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:16:23.029739  9351 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:23.029739  9705 tablet_bootstrap.cc:492] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap complete.
I20260709 12:16:23.031986  9705 ts_tablet_manager.cc:1403] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.005s
I20260709 12:16:23.034706  9705 raft_consensus.cc:359] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:23.035385  9705 raft_consensus.cc:740] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.036137  9705 consensus_queue.cc:260] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:23.038160  9705 ts_tablet_manager.cc:1434] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:23.038980  9705 tablet_bootstrap.cc:492] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:23.039934  9768 heartbeater.cc:344] Connected to a master server at 127.1.248.126:34829
I20260709 12:16:23.040464  9768 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:23.041435  9768 heartbeater.cc:507] Master 127.1.248.126:34829 requested a full tablet report, sending...
I20260709 12:16:23.045380  9479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
mode: GRACEFUL
new_leader_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:33360
I20260709 12:16:23.046145  9479 raft_consensus.cc:606] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Received request to transfer leadership to TS 770f433b448e4c96b3f14cec38050f78
I20260709 12:16:23.048156  9303 ts_manager.cc:194] Re-registered known tserver with Master: 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775)
I20260709 12:16:23.050971  9479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b53904db39454a01bd1dd16051716506"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
mode: GRACEFUL
new_leader_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:33360
I20260709 12:16:23.051671  9479 raft_consensus.cc:606] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Received request to transfer leadership to TS 770f433b448e4c96b3f14cec38050f78
I20260709 12:16:23.053293  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:23.053941  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:23.054677  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:23.056456  9705 tablet_bootstrap.cc:492] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:23.057199  9705 tablet_bootstrap.cc:492] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap complete.
I20260709 12:16:23.057724  9705 ts_tablet_manager.cc:1403] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:16:23.059551  9705 raft_consensus.cc:359] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:23.060050  9705 raft_consensus.cc:740] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.060336  9303 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33620
I20260709 12:16:23.060647  9705 consensus_queue.cc:260] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:23.062336  9705 ts_tablet_manager.cc:1434] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:23.063122  9705 tablet_bootstrap.cc:492] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:23.064101  9768 heartbeater.cc:499] Master 127.1.248.126:34829 was elected leader, sending a full tablet report...
I20260709 12:16:23.075037  9705 tablet_bootstrap.cc:492] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:23.075923  9705 tablet_bootstrap.cc:492] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap complete.
I20260709 12:16:23.076598  9705 ts_tablet_manager.cc:1403] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:16:23.078938  9705 raft_consensus.cc:359] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:23.079468  9705 raft_consensus.cc:740] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.080204  9705 consensus_queue.cc:260] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:23.082264  9705 ts_tablet_manager.cc:1434] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:23.082893  9705 tablet_bootstrap.cc:492] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:23.095391  9705 tablet_bootstrap.cc:492] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:23.096346  9705 tablet_bootstrap.cc:492] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap complete.
I20260709 12:16:23.096874  9705 ts_tablet_manager.cc:1403] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.006s
I20260709 12:16:23.098768  9705 raft_consensus.cc:359] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:23.099277  9705 raft_consensus.cc:740] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.099879  9705 consensus_queue.cc:260] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:23.101357  9705 ts_tablet_manager.cc:1434] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:16:23.101999  9705 tablet_bootstrap.cc:492] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap starting.
I20260709 12:16:23.106633  9685 raft_consensus.cc:993] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f: : Instructing follower 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:23.107230  9689 raft_consensus.cc:1081] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Signalling peer 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:23.108929  9553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b53904db39454a01bd1dd16051716506"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:16:23.109555  9553 raft_consensus.cc:493] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:23.109935  9553 raft_consensus.cc:3060] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.113796  9705 tablet_bootstrap.cc:492] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:23.114480  9705 tablet_bootstrap.cc:492] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5: Bootstrap complete.
I20260709 12:16:23.115012  9705 ts_tablet_manager.cc:1403] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 12:16:23.116380  9553 raft_consensus.cc:515] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:23.116750  9705 raft_consensus.cc:359] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:23.117386  9705 raft_consensus.cc:740] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9952bfb8b4f94a3babf61207c8b8c8d5, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.118026  9705 consensus_queue.cc:260] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:23.119288  9479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53904db39454a01bd1dd16051716506" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "975239029ee743a49fda6ea39e29e39f"
I20260709 12:16:23.119966  9705 ts_tablet_manager.cc:1434] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:16:23.119406  9742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53904db39454a01bd1dd16051716506" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:23.120441  9479 raft_consensus.cc:3055] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:23.120641  9742 raft_consensus.cc:3060] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.120772  9479 raft_consensus.cc:740] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:23.121692  9479 consensus_queue.cc:260] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:23.122826  9479 raft_consensus.cc:3060] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.119014  9553 leader_election.cc:290] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 2 election: Requested vote from peers 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381), 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775)
I20260709 12:16:23.128438  9742 raft_consensus.cc:2468] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 2.
I20260709 12:16:23.129729  9518 leader_election.cc:304] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:23.130613  9629 raft_consensus.cc:2804] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:23.131147  9479 raft_consensus.cc:2468] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 2.
I20260709 12:16:23.131907  9629 raft_consensus.cc:697] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Becoming Leader. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:23.132777  9629 consensus_queue.cc:237] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:23.140377  9303 catalog_manager.cc:5697] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 reported cstate change: term changed from 1 to 2, leader changed from 975239029ee743a49fda6ea39e29e39f (127.1.248.66) to 770f433b448e4c96b3f14cec38050f78 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "770f433b448e4c96b3f14cec38050f78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.249162  9685 raft_consensus.cc:993] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f: : Instructing follower 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:23.249603  9685 raft_consensus.cc:1081] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Signalling peer 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:23.251133  9553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:16:23.251768  9553 raft_consensus.cc:493] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:23.252116  9553 raft_consensus.cc:3060] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.259586  9553 raft_consensus.cc:515] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:23.261642  9553 leader_election.cc:290] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 2 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:23.262329  9742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:23.262734  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "975239029ee743a49fda6ea39e29e39f"
I20260709 12:16:23.263003  9742 raft_consensus.cc:3060] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.263381  9480 raft_consensus.cc:3055] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:23.263777  9480 raft_consensus.cc:740] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:23.264475  9480 consensus_queue.cc:260] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:23.265528  9480 raft_consensus.cc:3060] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.268461  9742 raft_consensus.cc:2468] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 2.
I20260709 12:16:23.269536  9518 leader_election.cc:304] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:23.270278  9782 raft_consensus.cc:2804] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:23.270814  9782 raft_consensus.cc:697] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Becoming Leader. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:23.271862  9480 raft_consensus.cc:2468] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 2.
I20260709 12:16:23.271762  9782 consensus_queue.cc:237] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:23.279906  9303 catalog_manager.cc:5697] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 reported cstate change: term changed from 1 to 2, leader changed from 975239029ee743a49fda6ea39e29e39f (127.1.248.66) to 770f433b448e4c96b3f14cec38050f78 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "770f433b448e4c96b3f14cec38050f78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.551429  9480 raft_consensus.cc:1275] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:23.553086  9782 consensus_queue.cc:1048] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:23.566862  9742 raft_consensus.cc:1275] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:23.568711  9629 consensus_queue.cc:1048] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.615841  9742 raft_consensus.cc:3060] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.862385  9742 raft_consensus.cc:1275] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:23.863920  9796 consensus_queue.cc:1048] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.874655  9480 raft_consensus.cc:1275] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:23.876410  9796 consensus_queue.cc:1048] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:24.030745  9351 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:24.064599  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:24.072619  9480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d6560cf2ae24bc18c29b8ee44880ce8"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
mode: GRACEFUL
new_leader_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:33360
I20260709 12:16:24.073143  9480 raft_consensus.cc:606] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Received request to transfer leadership to TS 770f433b448e4c96b3f14cec38050f78
I20260709 12:16:24.084877  9553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
mode: GRACEFUL
new_leader_uuid: "975239029ee743a49fda6ea39e29e39f"
 from {username='slave'} at 127.0.0.1:43416
I20260709 12:16:24.085500  9553 raft_consensus.cc:606] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Received request to transfer leadership to TS 975239029ee743a49fda6ea39e29e39f
I20260709 12:16:24.088284  9553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b53904db39454a01bd1dd16051716506"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
mode: GRACEFUL
new_leader_uuid: "975239029ee743a49fda6ea39e29e39f"
 from {username='slave'} at 127.0.0.1:43416
I20260709 12:16:24.088804  9553 raft_consensus.cc:606] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Received request to transfer leadership to TS 975239029ee743a49fda6ea39e29e39f
I20260709 12:16:24.089746  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:16:24.090237  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:24.090870  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:24.126257  9796 raft_consensus.cc:993] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78: : Instructing follower 975239029ee743a49fda6ea39e29e39f to start an election
I20260709 12:16:24.126848  9629 raft_consensus.cc:1081] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Signalling peer 975239029ee743a49fda6ea39e29e39f to start an election
I20260709 12:16:24.128439  9480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b53904db39454a01bd1dd16051716506"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
 from {username='slave'} at 127.0.0.1:36522
I20260709 12:16:24.129014  9480 raft_consensus.cc:493] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:24.129345  9480 raft_consensus.cc:3060] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:24.136152  9480 raft_consensus.cc:515] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:24.137817  9480 leader_election.cc:290] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 3 election: Requested vote from peers 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315), 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775)
I20260709 12:16:24.138525  9553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53904db39454a01bd1dd16051716506" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "770f433b448e4c96b3f14cec38050f78"
I20260709 12:16:24.138821  9741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53904db39454a01bd1dd16051716506" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:24.139186  9553 raft_consensus.cc:3055] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:24.139472  9741 raft_consensus.cc:3060] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:24.139611  9553 raft_consensus.cc:740] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:24.140513  9553 consensus_queue.cc:260] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:24.141598  9553 raft_consensus.cc:3060] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:24.145103  9741 raft_consensus.cc:2468] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 3.
I20260709 12:16:24.146158  9444 leader_election.cc:304] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:24.146870  9799 raft_consensus.cc:2804] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:24.146982  9553 raft_consensus.cc:2468] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 3.
I20260709 12:16:24.147282  9799 raft_consensus.cc:697] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 3 LEADER]: Becoming Leader. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:24.148455  9799 consensus_queue.cc:237] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } }
I20260709 12:16:24.154894  9303 catalog_manager.cc:5697] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f reported cstate change: term changed from 2 to 3, leader changed from 770f433b448e4c96b3f14cec38050f78 (127.1.248.67) to 975239029ee743a49fda6ea39e29e39f (127.1.248.66). New cstate: current_term: 3 leader_uuid: "975239029ee743a49fda6ea39e29e39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.271368  9685 raft_consensus.cc:993] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f: : Instructing follower 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:24.271863  9799 raft_consensus.cc:1081] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Signalling peer 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:24.273444  9553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d6560cf2ae24bc18c29b8ee44880ce8"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:16:24.273962  9553 raft_consensus.cc:493] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:24.274278  9553 raft_consensus.cc:3060] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:24.279419  9553 raft_consensus.cc:515] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:24.281205  9553 leader_election.cc:290] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 2 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:24.282040  9741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6560cf2ae24bc18c29b8ee44880ce8" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:24.282279  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6560cf2ae24bc18c29b8ee44880ce8" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "975239029ee743a49fda6ea39e29e39f"
I20260709 12:16:24.282655  9741 raft_consensus.cc:3060] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:24.282922  9480 raft_consensus.cc:3055] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:24.283301  9480 raft_consensus.cc:740] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:24.284216  9480 consensus_queue.cc:260] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:24.285283  9480 raft_consensus.cc:3060] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:24.289431  9741 raft_consensus.cc:2468] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 2.
I20260709 12:16:24.290735  9518 leader_election.cc:304] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:24.291657  9629 raft_consensus.cc:2804] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:24.292073  9629 raft_consensus.cc:697] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Becoming Leader. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:24.292613  9480 raft_consensus.cc:2468] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 2.
I20260709 12:16:24.292929  9629 consensus_queue.cc:237] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:24.301316  9303 catalog_manager.cc:5697] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 reported cstate change: term changed from 1 to 2, leader changed from 975239029ee743a49fda6ea39e29e39f (127.1.248.66) to 770f433b448e4c96b3f14cec38050f78 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "770f433b448e4c96b3f14cec38050f78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:24.353083  9629 raft_consensus.cc:993] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78: : Instructing follower 975239029ee743a49fda6ea39e29e39f to start an election
I20260709 12:16:24.353538  9629 raft_consensus.cc:1081] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Signalling peer 975239029ee743a49fda6ea39e29e39f to start an election
I20260709 12:16:24.354939  9480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
 from {username='slave'} at 127.0.0.1:36522
I20260709 12:16:24.355487  9480 raft_consensus.cc:493] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:24.355825  9480 raft_consensus.cc:3060] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:24.361265  9480 raft_consensus.cc:515] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:24.362905  9480 leader_election.cc:290] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 2 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:24.364043  9741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:24.364065  9553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "770f433b448e4c96b3f14cec38050f78"
I20260709 12:16:24.364619  9741 raft_consensus.cc:3060] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:24.364869  9553 raft_consensus.cc:3055] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:24.365299  9553 raft_consensus.cc:740] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:24.366016  9553 consensus_queue.cc:260] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:24.367069  9553 raft_consensus.cc:3060] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:24.369887  9741 raft_consensus.cc:2468] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 2.
I20260709 12:16:24.370903  9444 leader_election.cc:304] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:24.371616  9799 raft_consensus.cc:2804] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:24.372048  9799 raft_consensus.cc:697] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 2 LEADER]: Becoming Leader. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:24.372783  9799 consensus_queue.cc:237] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:24.373095  9553 raft_consensus.cc:2468] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 2.
I20260709 12:16:24.379822  9303 catalog_manager.cc:5697] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f reported cstate change: term changed from 1 to 2, leader changed from 770f433b448e4c96b3f14cec38050f78 (127.1.248.67) to 975239029ee743a49fda6ea39e29e39f (127.1.248.66). New cstate: current_term: 2 leader_uuid: "975239029ee743a49fda6ea39e29e39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.547899  9741 raft_consensus.cc:1275] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Refusing update from remote peer 975239029ee743a49fda6ea39e29e39f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:24.549081  9799 consensus_queue.cc:1048] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:24.559127  9553 raft_consensus.cc:1275] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Refusing update from remote peer 975239029ee743a49fda6ea39e29e39f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:24.560914  9799 consensus_queue.cc:1048] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:24.717566  9741 raft_consensus.cc:1275] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:24.718830  9803 consensus_queue.cc:1048] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:24.727375  9480 raft_consensus.cc:1275] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:24.729092  9803 consensus_queue.cc:1048] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:24.856309  9553 raft_consensus.cc:1275] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Refusing update from remote peer 975239029ee743a49fda6ea39e29e39f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:24.857872  9685 consensus_queue.cc:1048] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:24.866649  9741 raft_consensus.cc:1275] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Refusing update from remote peer 975239029ee743a49fda6ea39e29e39f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:24.868614  9799 consensus_queue.cc:1048] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:25.031831  9351 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:25.097244  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:25.104899  9553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
mode: GRACEFUL
new_leader_uuid: "975239029ee743a49fda6ea39e29e39f"
 from {username='slave'} at 127.0.0.1:43416
I20260709 12:16:25.105557  9553 raft_consensus.cc:606] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Received request to transfer leadership to TS 975239029ee743a49fda6ea39e29e39f
I20260709 12:16:25.108384  9480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
mode: GRACEFUL
new_leader_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:33360
I20260709 12:16:25.109057  9480 raft_consensus.cc:606] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 2 LEADER]: Received request to transfer leadership to TS 770f433b448e4c96b3f14cec38050f78
I20260709 12:16:25.152057  9480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
mode: GRACEFUL
new_leader_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:33360
I20260709 12:16:25.153144  9480 raft_consensus.cc:606] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Received request to transfer leadership to TS 770f433b448e4c96b3f14cec38050f78
I20260709 12:16:25.154911  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:16:25.156361  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:25.157403  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:25.371753  9685 raft_consensus.cc:993] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f: : Instructing follower 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:25.372258  9685 raft_consensus.cc:1081] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Signalling peer 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:25.374265  9553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:16:25.374923  9553 raft_consensus.cc:493] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.375270  9553 raft_consensus.cc:3060] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.383826  9553 raft_consensus.cc:515] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:25.385744  9553 leader_election.cc:290] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 2 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:25.387322  9741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:25.387595  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "975239029ee743a49fda6ea39e29e39f"
I20260709 12:16:25.388365  9741 raft_consensus.cc:3060] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.388422  9480 raft_consensus.cc:3055] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:25.388923  9480 raft_consensus.cc:740] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:25.390074  9480 consensus_queue.cc:260] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:25.391734  9480 raft_consensus.cc:3060] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.396240  9741 raft_consensus.cc:2468] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 2.
I20260709 12:16:25.397719  9518 leader_election.cc:304] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:25.398718  9822 raft_consensus.cc:2804] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:25.399259  9822 raft_consensus.cc:697] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Becoming Leader. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:25.400641  9480 raft_consensus.cc:2468] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 2.
I20260709 12:16:25.400669  9822 consensus_queue.cc:237] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:25.409327  9685 raft_consensus.cc:993] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f: : Instructing follower 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:25.410000  9689 raft_consensus.cc:1081] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 2 LEADER]: Signalling peer 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:25.410648  9821 raft_consensus.cc:993] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78: : Instructing follower 975239029ee743a49fda6ea39e29e39f to start an election
I20260709 12:16:25.411453  9821 raft_consensus.cc:1081] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Signalling peer 975239029ee743a49fda6ea39e29e39f to start an election
I20260709 12:16:25.413440  9480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
 from {username='slave'} at 127.0.0.1:36522
I20260709 12:16:25.413635  9553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:16:25.414078  9480 raft_consensus.cc:493] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.414237  9553 raft_consensus.cc:493] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.414579  9480 raft_consensus.cc:3060] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.414921  9553 raft_consensus.cc:3060] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.414296  9301 catalog_manager.cc:5697] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 reported cstate change: term changed from 1 to 2, leader changed from 975239029ee743a49fda6ea39e29e39f (127.1.248.66) to 770f433b448e4c96b3f14cec38050f78 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "770f433b448e4c96b3f14cec38050f78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:25.423632  9480 raft_consensus.cc:515] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:25.423822  9553 raft_consensus.cc:515] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:25.426806  9553 leader_election.cc:290] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 3 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:25.427649  9741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:25.428439  9741 raft_consensus.cc:3060] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.428143  9479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "975239029ee743a49fda6ea39e29e39f"
I20260709 12:16:25.429242  9479 raft_consensus.cc:3055] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:25.429414  9742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:25.429757  9479 raft_consensus.cc:740] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:25.430174  9742 raft_consensus.cc:3060] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.437469  9741 raft_consensus.cc:2468] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 3.
I20260709 12:16:25.439002  9518 leader_election.cc:304] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:25.431296  9479 consensus_queue.cc:260] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:25.440191  9822 raft_consensus.cc:2804] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:25.440758  9822 raft_consensus.cc:697] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 3 LEADER]: Becoming Leader. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:25.441516  9553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "770f433b448e4c96b3f14cec38050f78"
I20260709 12:16:25.442257  9553 raft_consensus.cc:3055] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:25.442028  9822 consensus_queue.cc:237] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:25.442610  9553 raft_consensus.cc:740] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:25.443697  9553 consensus_queue.cc:260] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:25.445006  9553 raft_consensus.cc:3060] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.446450  9480 leader_election.cc:290] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 3 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:25.449620  9742 raft_consensus.cc:2468] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 3.
I20260709 12:16:25.450459  9479 raft_consensus.cc:3060] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.451071  9444 leader_election.cc:304] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:25.452557  9689 raft_consensus.cc:2804] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:25.453224  9689 raft_consensus.cc:697] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 3 LEADER]: Becoming Leader. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:25.454419  9689 consensus_queue.cc:237] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:25.462934  9479 raft_consensus.cc:2468] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 3.
I20260709 12:16:25.465238  9553 raft_consensus.cc:2468] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 3.
I20260709 12:16:25.474274  9303 catalog_manager.cc:5697] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f reported cstate change: term changed from 2 to 3, leader changed from 770f433b448e4c96b3f14cec38050f78 (127.1.248.67) to 975239029ee743a49fda6ea39e29e39f (127.1.248.66). New cstate: current_term: 3 leader_uuid: "975239029ee743a49fda6ea39e29e39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.476985  9301 catalog_manager.cc:5697] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 reported cstate change: term changed from 2 to 3, leader changed from 975239029ee743a49fda6ea39e29e39f (127.1.248.66) to 770f433b448e4c96b3f14cec38050f78 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "770f433b448e4c96b3f14cec38050f78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:25.857977  9479 raft_consensus.cc:1275] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.859217  9822 consensus_queue.cc:1048] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.868587  9742 raft_consensus.cc:1275] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.871464  9553 raft_consensus.cc:1275] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Refusing update from remote peer 975239029ee743a49fda6ea39e29e39f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.872907  9821 consensus_queue.cc:1048] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.873459  9689 consensus_queue.cc:1048] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.889544  9479 raft_consensus.cc:1275] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.891925  9821 consensus_queue.cc:1048] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:25.893396  9742 raft_consensus.cc:1275] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Refusing update from remote peer 975239029ee743a49fda6ea39e29e39f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.896143  9799 consensus_queue.cc:1048] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:25.931746  9742 raft_consensus.cc:1275] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.934818  9803 consensus_queue.cc:1048] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:16:26.033010  9351 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:26.166170  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:26.173377  9479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
mode: GRACEFUL
new_leader_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:33360
I20260709 12:16:26.173961  9479 raft_consensus.cc:606] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 3 LEADER]: Received request to transfer leadership to TS 770f433b448e4c96b3f14cec38050f78
I20260709 12:16:26.176527  9553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89d6d73e9bb74c36b31bd54999e07e6f"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
mode: GRACEFUL
new_leader_uuid: "975239029ee743a49fda6ea39e29e39f"
 from {username='slave'} at 127.0.0.1:43416
I20260709 12:16:26.176990  9553 raft_consensus.cc:606] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Received request to transfer leadership to TS 975239029ee743a49fda6ea39e29e39f
I20260709 12:16:26.179545  9553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
mode: GRACEFUL
new_leader_uuid: "975239029ee743a49fda6ea39e29e39f"
 from {username='slave'} at 127.0.0.1:43416
I20260709 12:16:26.179975  9553 raft_consensus.cc:606] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Received request to transfer leadership to TS 975239029ee743a49fda6ea39e29e39f
I20260709 12:16:26.181113  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:16:26.181639  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:26.182214  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:26.309684  9685 raft_consensus.cc:993] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f: : Instructing follower 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:26.310382  9835 raft_consensus.cc:1081] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 3 LEADER]: Signalling peer 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:26.311949  9553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:16:26.312404  9553 raft_consensus.cc:493] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:26.312775  9553 raft_consensus.cc:3060] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:26.318176  9553 raft_consensus.cc:515] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:26.320257  9553 leader_election.cc:290] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 4 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:26.321048  9742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:26.321249  9479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbb9d075ce04110939e34600a3caa61" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "975239029ee743a49fda6ea39e29e39f"
I20260709 12:16:26.321712  9742 raft_consensus.cc:3060] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:26.321969  9479 raft_consensus.cc:3055] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:26.322351  9479 raft_consensus.cc:740] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:26.323115  9479 consensus_queue.cc:260] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:26.324167  9479 raft_consensus.cc:3060] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:26.327968  9742 raft_consensus.cc:2468] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 4.
I20260709 12:16:26.329372  9518 leader_election.cc:304] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:26.329586  9822 raft_consensus.cc:993] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78: : Instructing follower 975239029ee743a49fda6ea39e29e39f to start an election
I20260709 12:16:26.330153  9803 raft_consensus.cc:1081] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Signalling peer 975239029ee743a49fda6ea39e29e39f to start an election
I20260709 12:16:26.330335  9822 raft_consensus.cc:2804] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:26.330888  9822 raft_consensus.cc:697] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 4 LEADER]: Becoming Leader. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:26.331261  9479 raft_consensus.cc:2468] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 4.
I20260709 12:16:26.331985  9480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
 from {username='slave'} at 127.0.0.1:36522
I20260709 12:16:26.331808  9822 consensus_queue.cc:237] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:26.332603  9480 raft_consensus.cc:493] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:26.333012  9480 raft_consensus.cc:3060] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:26.339264  9480 raft_consensus.cc:515] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:26.339239  9303 catalog_manager.cc:5697] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 reported cstate change: term changed from 3 to 4, leader changed from 975239029ee743a49fda6ea39e29e39f (127.1.248.66) to 770f433b448e4c96b3f14cec38050f78 (127.1.248.67). New cstate: current_term: 4 leader_uuid: "770f433b448e4c96b3f14cec38050f78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:26.341444  9480 leader_election.cc:290] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 3 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:26.342178  9742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:26.342864  9742 raft_consensus.cc:3060] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:26.342768  9553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "770f433b448e4c96b3f14cec38050f78"
I20260709 12:16:26.343596  9553 raft_consensus.cc:3055] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:26.343941  9553 raft_consensus.cc:740] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:26.344774  9553 consensus_queue.cc:260] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:26.346110  9553 raft_consensus.cc:3060] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:26.350484  9742 raft_consensus.cc:2468] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 3.
I20260709 12:16:26.351811  9444 leader_election.cc:304] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:26.352671  9835 raft_consensus.cc:2804] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:26.353623  9553 raft_consensus.cc:2468] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 3.
I20260709 12:16:26.353852  9835 raft_consensus.cc:697] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 3 LEADER]: Becoming Leader. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:26.354831  9835 consensus_queue.cc:237] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:26.361570  9303 catalog_manager.cc:5697] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f reported cstate change: term changed from 2 to 3, leader changed from 770f433b448e4c96b3f14cec38050f78 (127.1.248.67) to 975239029ee743a49fda6ea39e29e39f (127.1.248.66). New cstate: current_term: 3 leader_uuid: "975239029ee743a49fda6ea39e29e39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.446800  9821 raft_consensus.cc:993] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78: : Instructing follower 975239029ee743a49fda6ea39e29e39f to start an election
I20260709 12:16:26.447242  9822 raft_consensus.cc:1081] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Signalling peer 975239029ee743a49fda6ea39e29e39f to start an election
I20260709 12:16:26.448589  9480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89d6d73e9bb74c36b31bd54999e07e6f"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
 from {username='slave'} at 127.0.0.1:36522
I20260709 12:16:26.448976  9480 raft_consensus.cc:493] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:26.449225  9480 raft_consensus.cc:3060] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:26.454600  9480 raft_consensus.cc:515] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:26.456137  9480 leader_election.cc:290] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 2 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:26.456911  9742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d6d73e9bb74c36b31bd54999e07e6f" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:26.457135  9553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d6d73e9bb74c36b31bd54999e07e6f" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "770f433b448e4c96b3f14cec38050f78"
I20260709 12:16:26.457620  9742 raft_consensus.cc:3060] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:26.457736  9553 raft_consensus.cc:3055] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:26.458165  9553 raft_consensus.cc:740] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:26.458952  9553 consensus_queue.cc:260] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:26.459955  9553 raft_consensus.cc:3060] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:26.462982  9742 raft_consensus.cc:2468] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 2.
I20260709 12:16:26.464031  9444 leader_election.cc:304] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:26.464766  9835 raft_consensus.cc:2804] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:26.464824  9553 raft_consensus.cc:2468] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 2.
I20260709 12:16:26.465302  9835 raft_consensus.cc:697] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [term 2 LEADER]: Becoming Leader. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:26.466426  9835 consensus_queue.cc:237] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:26.474205  9303 catalog_manager.cc:5697] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f reported cstate change: term changed from 1 to 2, leader changed from 770f433b448e4c96b3f14cec38050f78 (127.1.248.67) to 975239029ee743a49fda6ea39e29e39f (127.1.248.66). New cstate: current_term: 2 leader_uuid: "975239029ee743a49fda6ea39e29e39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.863368  9741 raft_consensus.cc:1275] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 4 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:26.864727  9821 consensus_queue.cc:1048] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:26.874574  9480 raft_consensus.cc:1275] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 4 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:26.876214  9821 consensus_queue.cc:1048] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:26.878185  9553 raft_consensus.cc:1275] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Refusing update from remote peer 975239029ee743a49fda6ea39e29e39f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:26.880383  9685 consensus_queue.cc:1048] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:26.891283  9741 raft_consensus.cc:1275] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Refusing update from remote peer 975239029ee743a49fda6ea39e29e39f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:26.895123  9847 consensus_queue.cc:1048] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:26.963016  9553 raft_consensus.cc:1275] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Refusing update from remote peer 975239029ee743a49fda6ea39e29e39f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:26.964290  9847 consensus_queue.cc:1048] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:26.976085  9741 raft_consensus.cc:1275] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Refusing update from remote peer 975239029ee743a49fda6ea39e29e39f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:26.977386  9835 consensus_queue.cc:1048] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:27.033919  9351 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:27.188370  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:27.195470  9480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ae886ea3fe3417aa20ddd5c18bfa088"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
mode: GRACEFUL
new_leader_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:33360
I20260709 12:16:27.195976  9480 raft_consensus.cc:606] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 2 LEADER]: Received request to transfer leadership to TS 770f433b448e4c96b3f14cec38050f78
I20260709 12:16:27.198559  9553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
mode: GRACEFUL
new_leader_uuid: "975239029ee743a49fda6ea39e29e39f"
 from {username='slave'} at 127.0.0.1:43416
I20260709 12:16:27.199033  9553 raft_consensus.cc:606] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 3 LEADER]: Received request to transfer leadership to TS 975239029ee743a49fda6ea39e29e39f
I20260709 12:16:27.201176  9480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
mode: GRACEFUL
new_leader_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:33360
I20260709 12:16:27.201596  9480 raft_consensus.cc:606] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 3 LEADER]: Received request to transfer leadership to TS 770f433b448e4c96b3f14cec38050f78
I20260709 12:16:27.202540  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:16:27.203024  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:27.203646  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:27.284570  9849 raft_consensus.cc:993] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f: : Instructing follower 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:27.285190  9835 raft_consensus.cc:1081] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 2 LEADER]: Signalling peer 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:27.286623  9553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ae886ea3fe3417aa20ddd5c18bfa088"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:16:27.287092  9553 raft_consensus.cc:493] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:27.287400  9553 raft_consensus.cc:3060] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:27.294668  9553 raft_consensus.cc:515] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:27.296355  9553 leader_election.cc:290] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 3 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:27.297194  9741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae886ea3fe3417aa20ddd5c18bfa088" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:27.297331  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae886ea3fe3417aa20ddd5c18bfa088" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "975239029ee743a49fda6ea39e29e39f"
I20260709 12:16:27.297871  9741 raft_consensus.cc:3060] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:27.297950  9480 raft_consensus.cc:3055] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:27.298383  9480 raft_consensus.cc:740] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:27.299104  9480 consensus_queue.cc:260] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:27.300103  9480 raft_consensus.cc:3060] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:27.304486  9741 raft_consensus.cc:2468] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 3.
I20260709 12:16:27.304894  9480 raft_consensus.cc:2468] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 3.
I20260709 12:16:27.305887  9518 leader_election.cc:304] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:27.306859  9821 raft_consensus.cc:2804] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:27.307444  9821 raft_consensus.cc:697] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 3 LEADER]: Becoming Leader. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:27.308646  9821 consensus_queue.cc:237] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:27.316144  9303 catalog_manager.cc:5697] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 reported cstate change: term changed from 2 to 3, leader changed from 975239029ee743a49fda6ea39e29e39f (127.1.248.66) to 770f433b448e4c96b3f14cec38050f78 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "770f433b448e4c96b3f14cec38050f78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:27.325954  9821 raft_consensus.cc:993] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78: : Instructing follower 975239029ee743a49fda6ea39e29e39f to start an election
I20260709 12:16:27.326543  9822 raft_consensus.cc:1081] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 3 LEADER]: Signalling peer 975239029ee743a49fda6ea39e29e39f to start an election
I20260709 12:16:27.328408  9480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0"
dest_uuid: "975239029ee743a49fda6ea39e29e39f"
 from {username='slave'} at 127.0.0.1:36522
I20260709 12:16:27.328987  9480 raft_consensus.cc:493] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:27.329269  9480 raft_consensus.cc:3060] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:27.334316  9480 raft_consensus.cc:515] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:27.336061  9480 leader_election.cc:290] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 4 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 770f433b448e4c96b3f14cec38050f78 (127.1.248.67:39315)
I20260709 12:16:27.336862  9741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:27.337121  9553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eeca4a371974615b7d16370e49f34a0" candidate_uuid: "975239029ee743a49fda6ea39e29e39f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "770f433b448e4c96b3f14cec38050f78"
I20260709 12:16:27.337442  9741 raft_consensus.cc:3060] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:27.337838  9553 raft_consensus.cc:3055] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:27.338110  9553 raft_consensus.cc:740] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:27.338743  9553 consensus_queue.cc:260] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:27.339676  9553 raft_consensus.cc:3060] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:27.342713  9741 raft_consensus.cc:2468] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 4.
I20260709 12:16:27.343847  9444 leader_election.cc:304] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 975239029ee743a49fda6ea39e29e39f, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:27.344566  9553 raft_consensus.cc:2468] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 975239029ee743a49fda6ea39e29e39f in term 4.
I20260709 12:16:27.344559  9835 raft_consensus.cc:2804] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:27.345288  9835 raft_consensus.cc:697] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 4 LEADER]: Becoming Leader. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:27.346092  9835 consensus_queue.cc:237] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:27.353124  9303 catalog_manager.cc:5697] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f reported cstate change: term changed from 3 to 4, leader changed from 770f433b448e4c96b3f14cec38050f78 (127.1.248.67) to 975239029ee743a49fda6ea39e29e39f (127.1.248.66). New cstate: current_term: 4 leader_uuid: "975239029ee743a49fda6ea39e29e39f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.385517  9849 raft_consensus.cc:993] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f: : Instructing follower 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:27.385933  9835 raft_consensus.cc:1081] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 3 LEADER]: Signalling peer 770f433b448e4c96b3f14cec38050f78 to start an election
I20260709 12:16:27.387300  9553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595"
dest_uuid: "770f433b448e4c96b3f14cec38050f78"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:16:27.387800  9553 raft_consensus.cc:493] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:27.388077  9553 raft_consensus.cc:3060] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:27.392779  9553 raft_consensus.cc:515] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:27.394191  9553 leader_election.cc:290] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 4 election: Requested vote from peers 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775), 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381)
I20260709 12:16:27.395099  9741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5"
I20260709 12:16:27.395251  9480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f079c8824415477d9a1ea60887ae1595" candidate_uuid: "770f433b448e4c96b3f14cec38050f78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "975239029ee743a49fda6ea39e29e39f"
I20260709 12:16:27.395901  9741 raft_consensus.cc:3060] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:27.395967  9480 raft_consensus.cc:3055] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:27.396418  9480 raft_consensus.cc:740] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 975239029ee743a49fda6ea39e29e39f, State: Running, Role: LEADER
I20260709 12:16:27.397130  9480 consensus_queue.cc:260] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:27.398311  9480 raft_consensus.cc:3060] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:27.404881  9741 raft_consensus.cc:2468] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 4.
I20260709 12:16:27.406109  9480 raft_consensus.cc:2468] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770f433b448e4c96b3f14cec38050f78 in term 4.
I20260709 12:16:27.406168  9518 leader_election.cc:304] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770f433b448e4c96b3f14cec38050f78, 9952bfb8b4f94a3babf61207c8b8c8d5; no voters: 
I20260709 12:16:27.407066  9821 raft_consensus.cc:2804] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:27.407619  9821 raft_consensus.cc:697] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 4 LEADER]: Becoming Leader. State: Replica: 770f433b448e4c96b3f14cec38050f78, State: Running, Role: LEADER
I20260709 12:16:27.408483  9821 consensus_queue.cc:237] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } }
I20260709 12:16:27.414629  9303 catalog_manager.cc:5697] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 reported cstate change: term changed from 3 to 4, leader changed from 975239029ee743a49fda6ea39e29e39f (127.1.248.66) to 770f433b448e4c96b3f14cec38050f78 (127.1.248.67). New cstate: current_term: 4 leader_uuid: "770f433b448e4c96b3f14cec38050f78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:27.787472  9553 raft_consensus.cc:1275] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 4 FOLLOWER]: Refusing update from remote peer 975239029ee743a49fda6ea39e29e39f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:27.788578  9685 consensus_queue.cc:1048] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "770f433b448e4c96b3f14cec38050f78" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:27.799207  9741 raft_consensus.cc:1275] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 4 FOLLOWER]: Refusing update from remote peer 975239029ee743a49fda6ea39e29e39f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:27.800936  9685 consensus_queue.cc:1048] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:27.801719  9480 raft_consensus.cc:1275] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 4 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:27.803092  9821 consensus_queue.cc:1048] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:27.821542  9741 raft_consensus.cc:1275] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 4 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:27.821736  9742 raft_consensus.cc:1275] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:27.823609  9822 consensus_queue.cc:1048] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:27.825099  9480 raft_consensus.cc:1275] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Refusing update from remote peer 770f433b448e4c96b3f14cec38050f78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:27.825953  9822 consensus_queue.cc:1048] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9952bfb8b4f94a3babf61207c8b8c8d5" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:27.826829  9856 consensus_queue.cc:1048] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975239029ee743a49fda6ea39e29e39f" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 34381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:16:28.034945  9351 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:28.209964  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:28.239516  2017 tablet_server.cc:179] TabletServer@127.1.248.65:36775 shutting down...
W20260709 12:16:28.262214  9444 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 82 similar messages]
W20260709 12:16:28.268702  9444 consensus_peers.cc:597] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.272799  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:28.273720  2017 tablet_replica.cc:333] stopping tablet replica
W20260709 12:16:28.274329  9518 consensus_peers.cc:597] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.274940  2017 raft_consensus.cc:2243] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.275470  2017 raft_consensus.cc:2272] T 8eeca4a371974615b7d16370e49f34a0 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.279160  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.279929  2017 raft_consensus.cc:2243] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.280400  2017 raft_consensus.cc:2272] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.282955  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.283601  2017 raft_consensus.cc:2243] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.284102  2017 raft_consensus.cc:2272] T b53904db39454a01bd1dd16051716506 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.286545  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.287062  2017 raft_consensus.cc:2243] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.287563  2017 raft_consensus.cc:2272] T f079c8824415477d9a1ea60887ae1595 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.291112  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.292104  2017 raft_consensus.cc:2243] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:28.292500  9444 consensus_peers.cc:597] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.292688  2017 raft_consensus.cc:2272] T 4efc970631114a12a10fe7a5504a4d92 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.295608  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.296366  2017 raft_consensus.cc:2243] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.296972  2017 raft_consensus.cc:2272] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.299814  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.300611  2017 raft_consensus.cc:2243] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.301129  2017 raft_consensus.cc:2272] T 89d6d73e9bb74c36b31bd54999e07e6f P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.304433  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.305025  2017 raft_consensus.cc:2243] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.305473  2017 raft_consensus.cc:2272] T 1cbb9d075ce04110939e34600a3caa61 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.307861  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.308379  2017 raft_consensus.cc:2243] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.308830  2017 raft_consensus.cc:2272] T c47e4ef014534c2da755ca1ed4f2d9cf P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.311697  2017 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.312469  2017 raft_consensus.cc:2243] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.313102  2017 raft_consensus.cc:2272] T 0dcbf96644774836a52ff55eba9e0766 P 9952bfb8b4f94a3babf61207c8b8c8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.339090  2017 tablet_server.cc:196] TabletServer@127.1.248.65:36775 shutdown complete.
I20260709 12:16:28.365021  2017 tablet_server.cc:179] TabletServer@127.1.248.66:0 shutting down...
W20260709 12:16:28.379948  9517 consensus_peers.cc:597] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 -> Peer 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381): Couldn't send request to peer 975239029ee743a49fda6ea39e29e39f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.390359  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:28.391245  2017 tablet_replica.cc:333] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f: stopping tablet replica
I20260709 12:16:28.392349  2017 raft_consensus.cc:2243] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.393581  2017 raft_consensus.cc:2272] T 8eeca4a371974615b7d16370e49f34a0 P 975239029ee743a49fda6ea39e29e39f [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:28.397780  9518 consensus_peers.cc:597] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.399012  2017 tablet_replica.cc:333] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f: stopping tablet replica
I20260709 12:16:28.399935  2017 raft_consensus.cc:2243] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.400869  2017 raft_consensus.cc:2272] T c47e4ef014534c2da755ca1ed4f2d9cf P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.403065  2017 tablet_replica.cc:333] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f: stopping tablet replica
I20260709 12:16:28.403695  2017 raft_consensus.cc:2243] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.404089  2017 raft_consensus.cc:2272] T 0dcbf96644774836a52ff55eba9e0766 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.406219  2017 tablet_replica.cc:333] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f: stopping tablet replica
I20260709 12:16:28.406772  2017 raft_consensus.cc:2243] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.407737  2017 raft_consensus.cc:2272] T b53904db39454a01bd1dd16051716506 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.409708  2017 tablet_replica.cc:333] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f: stopping tablet replica
I20260709 12:16:28.410293  2017 raft_consensus.cc:2243] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.410812  2017 raft_consensus.cc:2272] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 975239029ee743a49fda6ea39e29e39f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.415339  2017 tablet_replica.cc:333] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f: stopping tablet replica
I20260709 12:16:28.416136  2017 raft_consensus.cc:2243] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.416706  2017 raft_consensus.cc:2272] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:28.417240  9518 consensus_peers.cc:597] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.419028  2017 tablet_replica.cc:333] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f: stopping tablet replica
I20260709 12:16:28.419700  2017 raft_consensus.cc:2243] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.420437  2017 raft_consensus.cc:2272] T 89d6d73e9bb74c36b31bd54999e07e6f P 975239029ee743a49fda6ea39e29e39f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.422854  2017 tablet_replica.cc:333] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f: stopping tablet replica
I20260709 12:16:28.423497  2017 raft_consensus.cc:2243] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.423961  2017 raft_consensus.cc:2272] T 4efc970631114a12a10fe7a5504a4d92 P 975239029ee743a49fda6ea39e29e39f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.426522  2017 tablet_replica.cc:333] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f: stopping tablet replica
I20260709 12:16:28.427094  2017 raft_consensus.cc:2243] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.427659  2017 raft_consensus.cc:2272] T 1cbb9d075ce04110939e34600a3caa61 P 975239029ee743a49fda6ea39e29e39f [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:28.429565  9517 consensus_peers.cc:597] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 -> Peer 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381): Couldn't send request to peer 975239029ee743a49fda6ea39e29e39f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.430402  2017 tablet_replica.cc:333] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f: stopping tablet replica
I20260709 12:16:28.430922  2017 raft_consensus.cc:2243] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.431304  2017 raft_consensus.cc:2272] T f079c8824415477d9a1ea60887ae1595 P 975239029ee743a49fda6ea39e29e39f [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:28.463922  9517 consensus_peers.cc:597] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 -> Peer 975239029ee743a49fda6ea39e29e39f (127.1.248.66:34381): Couldn't send request to peer 975239029ee743a49fda6ea39e29e39f. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:34381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.464516  2017 tablet_server.cc:196] TabletServer@127.1.248.66:0 shutdown complete.
W20260709 12:16:28.470923  9518 consensus_peers.cc:597] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:28.484892  9518 consensus_peers.cc:597] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.494318  2017 tablet_server.cc:179] TabletServer@127.1.248.67:0 shutting down...
I20260709 12:16:28.526152  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:28.527034  2017 tablet_replica.cc:333] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78: stopping tablet replica
I20260709 12:16:28.528010  2017 raft_consensus.cc:2243] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.528561  2017 raft_consensus.cc:2272] T 8eeca4a371974615b7d16370e49f34a0 P 770f433b448e4c96b3f14cec38050f78 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.532430  2017 tablet_replica.cc:333] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78: stopping tablet replica
I20260709 12:16:28.533344  2017 raft_consensus.cc:2243] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:16:28.533795  9518 consensus_peers.cc:597] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 -> Peer 9952bfb8b4f94a3babf61207c8b8c8d5 (127.1.248.65:36775): Couldn't send request to peer 9952bfb8b4f94a3babf61207c8b8c8d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.534265  2017 raft_consensus.cc:2272] T f079c8824415477d9a1ea60887ae1595 P 770f433b448e4c96b3f14cec38050f78 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.537530  2017 tablet_replica.cc:333] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78: stopping tablet replica
I20260709 12:16:28.538182  2017 raft_consensus.cc:2243] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.539009  2017 raft_consensus.cc:2272] T 3d6560cf2ae24bc18c29b8ee44880ce8 P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.541201  2017 tablet_replica.cc:333] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78: stopping tablet replica
I20260709 12:16:28.541770  2017 raft_consensus.cc:2243] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.542215  2017 raft_consensus.cc:2272] T 89d6d73e9bb74c36b31bd54999e07e6f P 770f433b448e4c96b3f14cec38050f78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.544297  2017 tablet_replica.cc:333] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78: stopping tablet replica
I20260709 12:16:28.544847  2017 raft_consensus.cc:2243] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.545442  2017 raft_consensus.cc:2272] T c47e4ef014534c2da755ca1ed4f2d9cf P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.547719  2017 tablet_replica.cc:333] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78: stopping tablet replica
I20260709 12:16:28.548255  2017 raft_consensus.cc:2243] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.549113  2017 raft_consensus.cc:2272] T 0dcbf96644774836a52ff55eba9e0766 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.551134  2017 tablet_replica.cc:333] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78: stopping tablet replica
I20260709 12:16:28.551769  2017 raft_consensus.cc:2243] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.552546  2017 raft_consensus.cc:2272] T 0ae886ea3fe3417aa20ddd5c18bfa088 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.554940  2017 tablet_replica.cc:333] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78: stopping tablet replica
I20260709 12:16:28.555560  2017 raft_consensus.cc:2243] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.556085  2017 raft_consensus.cc:2272] T b53904db39454a01bd1dd16051716506 P 770f433b448e4c96b3f14cec38050f78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.558141  2017 tablet_replica.cc:333] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78: stopping tablet replica
I20260709 12:16:28.558629  2017 raft_consensus.cc:2243] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.559384  2017 raft_consensus.cc:2272] T 1cbb9d075ce04110939e34600a3caa61 P 770f433b448e4c96b3f14cec38050f78 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.561287  2017 tablet_replica.cc:333] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78: stopping tablet replica
I20260709 12:16:28.561738  2017 raft_consensus.cc:2243] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.562584  2017 raft_consensus.cc:2272] T 4efc970631114a12a10fe7a5504a4d92 P 770f433b448e4c96b3f14cec38050f78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.596586  2017 tablet_server.cc:196] TabletServer@127.1.248.67:0 shutdown complete.
I20260709 12:16:28.622972  2017 master.cc:562] Master@127.1.248.126:34829 shutting down...
I20260709 12:16:28.647780  2017 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.648379  2017 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.648731  2017 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0f61ecbd836e4370acd4c3ede787eea8: stopping tablet replica
I20260709 12:16:28.668752  2017 master.cc:584] Master@127.1.248.126:34829 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12830 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:16:28.714450  2017 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.248.126:35733
I20260709 12:16:28.715701  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:28.721691  9873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:28.721760  9872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:28.722682  9875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:28.722872  2017 server_base.cc:1061] running on GCE node
I20260709 12:16:28.723938  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:28.724123  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:28.724237  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599388724226 us; error 0 us; skew 500 ppm
I20260709 12:16:28.724692  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:28.726989  2017 webserver.cc:533] Webserver started at http://127.1.248.126:33983/ using document root <none> and password file <none>
I20260709 12:16:28.727502  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:28.727679  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:28.727905  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:28.729055  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/master-0-root/instance:
uuid: "946e759a258a4f02a85cf21fafffe063"
format_stamp: "Formatted at 2026-07-09 12:16:28 on dist-test-slave-z9f9"
I20260709 12:16:28.733508  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:16:28.736940  9880 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:28.737720  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:16:28.738062  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/master-0-root
uuid: "946e759a258a4f02a85cf21fafffe063"
format_stamp: "Formatted at 2026-07-09 12:16:28 on dist-test-slave-z9f9"
I20260709 12:16:28.738354  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:28.774425  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:28.775944  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:28.822340  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.126:35733
I20260709 12:16:28.822440  9931 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.126:35733 every 8 connection(s)
I20260709 12:16:28.826596  9932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:28.838231  9932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063: Bootstrap starting.
I20260709 12:16:28.843369  9932 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:28.847640  9932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063: No bootstrap required, opened a new log
I20260709 12:16:28.849798  9932 raft_consensus.cc:359] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "946e759a258a4f02a85cf21fafffe063" member_type: VOTER }
I20260709 12:16:28.850165  9932 raft_consensus.cc:385] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:28.850350  9932 raft_consensus.cc:740] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946e759a258a4f02a85cf21fafffe063, State: Initialized, Role: FOLLOWER
I20260709 12:16:28.850912  9932 consensus_queue.cc:260] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "946e759a258a4f02a85cf21fafffe063" member_type: VOTER }
I20260709 12:16:28.851338  9932 raft_consensus.cc:399] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:28.851559  9932 raft_consensus.cc:493] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:28.851764  9932 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:28.856905  9932 raft_consensus.cc:515] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "946e759a258a4f02a85cf21fafffe063" member_type: VOTER }
I20260709 12:16:28.857412  9932 leader_election.cc:304] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 946e759a258a4f02a85cf21fafffe063; no voters: 
I20260709 12:16:28.858538  9932 leader_election.cc:290] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:28.858896  9935 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:28.860384  9935 raft_consensus.cc:697] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [term 1 LEADER]: Becoming Leader. State: Replica: 946e759a258a4f02a85cf21fafffe063, State: Running, Role: LEADER
I20260709 12:16:28.861086  9935 consensus_queue.cc:237] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "946e759a258a4f02a85cf21fafffe063" member_type: VOTER }
I20260709 12:16:28.861549  9932 sys_catalog.cc:565] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:28.866053  9937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 946e759a258a4f02a85cf21fafffe063. Latest consensus state: current_term: 1 leader_uuid: "946e759a258a4f02a85cf21fafffe063" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "946e759a258a4f02a85cf21fafffe063" member_type: VOTER } }
I20260709 12:16:28.866813  9937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:28.867712  9936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "946e759a258a4f02a85cf21fafffe063" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "946e759a258a4f02a85cf21fafffe063" member_type: VOTER } }
I20260709 12:16:28.868603  9936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:28.877499  9943 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:28.882776  9943 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:28.884518  2017 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:28.891615  9943 catalog_manager.cc:1383] Generated new cluster ID: 78290f131580464282a3b10ad1f53b7a
I20260709 12:16:28.891924  9943 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:28.919775  9943 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:28.921118  9943 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:28.941486  9943 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063: Generated new TSK 0
I20260709 12:16:28.942160  9943 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:28.950781  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:28.957244  9953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:28.958007  9954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:28.959928  9956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:28.962598  2017 server_base.cc:1061] running on GCE node
I20260709 12:16:28.963798  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:28.964036  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:28.964213  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599388964191 us; error 0 us; skew 500 ppm
I20260709 12:16:28.964787  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:28.967101  2017 webserver.cc:533] Webserver started at http://127.1.248.65:45989/ using document root <none> and password file <none>
I20260709 12:16:28.967660  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:28.967870  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:28.968142  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:28.969251  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-0-root/instance:
uuid: "9bfdac66fe3f45c8aadeb6136ea18991"
format_stamp: "Formatted at 2026-07-09 12:16:28 on dist-test-slave-z9f9"
I20260709 12:16:28.974059  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:16:28.977514  9961 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:28.978314  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:28.978612  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-0-root
uuid: "9bfdac66fe3f45c8aadeb6136ea18991"
format_stamp: "Formatted at 2026-07-09 12:16:28 on dist-test-slave-z9f9"
I20260709 12:16:28.978927  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:28.993024  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:28.994324  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:28.995834  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:28.998179  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:28.998414  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:28.998658  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:28.998854  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.041301  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.65:36449
I20260709 12:16:29.041404 10023 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.65:36449 every 8 connection(s)
I20260709 12:16:29.049616  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:29.059116 10028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:29.059654 10029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:29.064594 10024 heartbeater.cc:344] Connected to a master server at 127.1.248.126:35733
I20260709 12:16:29.065237 10024 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:29.066373 10024 heartbeater.cc:507] Master 127.1.248.126:35733 requested a full tablet report, sending...
I20260709 12:16:29.067907  2017 server_base.cc:1061] running on GCE node
I20260709 12:16:29.069022  9897 ts_manager.cc:194] Registered new tserver with Master: 9bfdac66fe3f45c8aadeb6136ea18991 (127.1.248.65:36449)
I20260709 12:16:29.071034  9897 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36770
W20260709 12:16:29.074681 10031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:29.075897  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:29.076148  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:29.076368  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599389076348 us; error 0 us; skew 500 ppm
I20260709 12:16:29.076952  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:29.079908  2017 webserver.cc:533] Webserver started at http://127.1.248.66:41519/ using document root <none> and password file <none>
I20260709 12:16:29.080493  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:29.080770  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:29.081045  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:29.082285  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-1-root/instance:
uuid: "ad111e2f1bd8464197863677c9091a57"
format_stamp: "Formatted at 2026-07-09 12:16:29 on dist-test-slave-z9f9"
I20260709 12:16:29.088555  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.008s
I20260709 12:16:29.093434 10036 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.094501  2017 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:16:29.094949  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-1-root
uuid: "ad111e2f1bd8464197863677c9091a57"
format_stamp: "Formatted at 2026-07-09 12:16:29 on dist-test-slave-z9f9"
I20260709 12:16:29.095319  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:29.116070  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:29.117309  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:29.118774  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:29.121147  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:29.121384  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.121635  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:29.121826  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.163337  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.66:33237
I20260709 12:16:29.163511 10098 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.66:33237 every 8 connection(s)
I20260709 12:16:29.168286  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:29.175889 10102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:29.176465 10103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:29.181429 10105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:29.183260 10099 heartbeater.cc:344] Connected to a master server at 127.1.248.126:35733
I20260709 12:16:29.183533  2017 server_base.cc:1061] running on GCE node
I20260709 12:16:29.183815 10099 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:29.184725  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:16:29.184785 10099 heartbeater.cc:507] Master 127.1.248.126:35733 requested a full tablet report, sending...
W20260709 12:16:29.185210  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:29.185438  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599389185420 us; error 0 us; skew 500 ppm
I20260709 12:16:29.186177  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:29.187388  9897 ts_manager.cc:194] Registered new tserver with Master: ad111e2f1bd8464197863677c9091a57 (127.1.248.66:33237)
I20260709 12:16:29.188942  2017 webserver.cc:533] Webserver started at http://127.1.248.67:38609/ using document root <none> and password file <none>
I20260709 12:16:29.189169  9897 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36786
I20260709 12:16:29.189535  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:29.189814  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:29.190100  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:29.191780  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-2-root/instance:
uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b"
format_stamp: "Formatted at 2026-07-09 12:16:29 on dist-test-slave-z9f9"
I20260709 12:16:29.196218  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:29.199354 10110 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.200210  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:16:29.200469  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-2-root
uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b"
format_stamp: "Formatted at 2026-07-09 12:16:29 on dist-test-slave-z9f9"
I20260709 12:16:29.200711  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599108657414-2017-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:29.220594  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:29.221899  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:29.223559  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:29.226042  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:29.226279  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.226557  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:29.226748  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.271118  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.67:39249
I20260709 12:16:29.271217 10172 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.67:39249 every 8 connection(s)
I20260709 12:16:29.286260 10173 heartbeater.cc:344] Connected to a master server at 127.1.248.126:35733
I20260709 12:16:29.286753 10173 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:29.287672 10173 heartbeater.cc:507] Master 127.1.248.126:35733 requested a full tablet report, sending...
I20260709 12:16:29.289805  9897 ts_manager.cc:194] Registered new tserver with Master: 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67:39249)
I20260709 12:16:29.290577  2017 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015974992s
I20260709 12:16:29.291288  9897 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36802
I20260709 12:16:29.318845  9897 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36816:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:29.321328  9897 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:29.367501  9989 tablet_service.cc:1511] Processing CreateTablet for tablet 4837c81987bb4c35b194e86a5602c451 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=72b1990a2a2441ca86a5aa5510a6d3fb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:16:29.368041  9988 tablet_service.cc:1511] Processing CreateTablet for tablet 17089f560a2548058166ec7bfc97fd14 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=72b1990a2a2441ca86a5aa5510a6d3fb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:16:29.369024  9989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4837c81987bb4c35b194e86a5602c451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.370918  9988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17089f560a2548058166ec7bfc97fd14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.378952 10063 tablet_service.cc:1511] Processing CreateTablet for tablet 17089f560a2548058166ec7bfc97fd14 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=72b1990a2a2441ca86a5aa5510a6d3fb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:16:29.380391 10063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17089f560a2548058166ec7bfc97fd14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.381369 10138 tablet_service.cc:1511] Processing CreateTablet for tablet 4837c81987bb4c35b194e86a5602c451 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=72b1990a2a2441ca86a5aa5510a6d3fb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:16:29.381851 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 17089f560a2548058166ec7bfc97fd14 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=72b1990a2a2441ca86a5aa5510a6d3fb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:16:29.382848 10138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4837c81987bb4c35b194e86a5602c451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.383466 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17089f560a2548058166ec7bfc97fd14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.378816 10064 tablet_service.cc:1511] Processing CreateTablet for tablet 4837c81987bb4c35b194e86a5602c451 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=72b1990a2a2441ca86a5aa5510a6d3fb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:16:29.384851 10064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4837c81987bb4c35b194e86a5602c451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.409957 10189 tablet_bootstrap.cc:492] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Bootstrap starting.
I20260709 12:16:29.412279 10188 tablet_bootstrap.cc:492] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991: Bootstrap starting.
I20260709 12:16:29.419634 10188 tablet_bootstrap.cc:654] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.420102 10189 tablet_bootstrap.cc:654] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.428297 10192 tablet_bootstrap.cc:492] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57: Bootstrap starting.
I20260709 12:16:29.434389 10188 tablet_bootstrap.cc:492] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991: No bootstrap required, opened a new log
I20260709 12:16:29.434616 10192 tablet_bootstrap.cc:654] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.434996 10188 ts_tablet_manager.cc:1403] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:16:29.435317 10189 tablet_bootstrap.cc:492] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b: No bootstrap required, opened a new log
I20260709 12:16:29.435902 10189 ts_tablet_manager.cc:1403] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.005s
I20260709 12:16:29.438529 10188 raft_consensus.cc:359] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.439385 10188 raft_consensus.cc:385] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.439708 10188 raft_consensus.cc:740] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bfdac66fe3f45c8aadeb6136ea18991, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.440959 10192 tablet_bootstrap.cc:492] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57: No bootstrap required, opened a new log
I20260709 12:16:29.440629 10188 consensus_queue.cc:260] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.440104 10189 raft_consensus.cc:359] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.441447 10192 ts_tablet_manager.cc:1403] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 12:16:29.441653 10189 raft_consensus.cc:385] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.442075 10189 raft_consensus.cc:740] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec5d5f9a9c641ba97b82b28d016ba5b, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.443262 10024 heartbeater.cc:499] Master 127.1.248.126:35733 was elected leader, sending a full tablet report...
I20260709 12:16:29.443850 10188 ts_tablet_manager.cc:1434] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:16:29.443910 10189 consensus_queue.cc:260] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.445120 10188 tablet_bootstrap.cc:492] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991: Bootstrap starting.
I20260709 12:16:29.445521 10195 raft_consensus.cc:493] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.446049 10195 raft_consensus.cc:515] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.446346 10192 raft_consensus.cc:359] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.447137 10192 raft_consensus.cc:385] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.447469 10192 raft_consensus.cc:740] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad111e2f1bd8464197863677c9091a57, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.448304 10192 consensus_queue.cc:260] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.450317 10099 heartbeater.cc:499] Master 127.1.248.126:35733 was elected leader, sending a full tablet report...
I20260709 12:16:29.450906 10192 ts_tablet_manager.cc:1434] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:16:29.452607 10188 tablet_bootstrap.cc:654] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.457602 10192 tablet_bootstrap.cc:492] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57: Bootstrap starting.
I20260709 12:16:29.464003 10192 tablet_bootstrap.cc:654] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.467851 10195 leader_election.cc:290] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bfdac66fe3f45c8aadeb6136ea18991 (127.1.248.65:36449), ad111e2f1bd8464197863677c9091a57 (127.1.248.66:33237)
I20260709 12:16:29.469580 10192 tablet_bootstrap.cc:492] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57: No bootstrap required, opened a new log
I20260709 12:16:29.470232 10192 ts_tablet_manager.cc:1403] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:16:29.472661 10189 ts_tablet_manager.cc:1434] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Time spent starting tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 12:16:29.473847 10173 heartbeater.cc:499] Master 127.1.248.126:35733 was elected leader, sending a full tablet report...
I20260709 12:16:29.473562 10192 raft_consensus.cc:359] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.474535 10192 raft_consensus.cc:385] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.474926 10192 raft_consensus.cc:740] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad111e2f1bd8464197863677c9091a57, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.475803 10192 consensus_queue.cc:260] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.478401 10188 tablet_bootstrap.cc:492] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991: No bootstrap required, opened a new log
I20260709 12:16:29.478961 10188 ts_tablet_manager.cc:1403] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.012s
I20260709 12:16:29.479899 10189 tablet_bootstrap.cc:492] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Bootstrap starting.
I20260709 12:16:29.480350 10192 ts_tablet_manager.cc:1434] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 12:16:29.482064 10188 raft_consensus.cc:359] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.482848 10188 raft_consensus.cc:385] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.483140 10188 raft_consensus.cc:740] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bfdac66fe3f45c8aadeb6136ea18991, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.484278 10188 consensus_queue.cc:260] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.483341 10194 raft_consensus.cc:493] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.486266 10194 raft_consensus.cc:515] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.487897 10189 tablet_bootstrap.cc:654] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.493913 10188 ts_tablet_manager.cc:1434] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.008s
I20260709 12:16:29.496928 10194 leader_election.cc:290] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad111e2f1bd8464197863677c9091a57 (127.1.248.66:33237), 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67:39249)
I20260709 12:16:29.500638  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4837c81987bb4c35b194e86a5602c451" candidate_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" is_pre_election: true
I20260709 12:16:29.501509  9999 raft_consensus.cc:2468] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec5d5f9a9c641ba97b82b28d016ba5b in term 0.
I20260709 12:16:29.507472 10111 leader_election.cc:304] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec5d5f9a9c641ba97b82b28d016ba5b, 9bfdac66fe3f45c8aadeb6136ea18991; no voters: 
I20260709 12:16:29.509414 10195 raft_consensus.cc:2804] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.509805 10195 raft_consensus.cc:493] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.510283 10195 raft_consensus.cc:3060] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.512833 10074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17089f560a2548058166ec7bfc97fd14" candidate_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad111e2f1bd8464197863677c9091a57" is_pre_election: true
I20260709 12:16:29.513653 10074 raft_consensus.cc:2468] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bfdac66fe3f45c8aadeb6136ea18991 in term 0.
I20260709 12:16:29.517884  9962 leader_election.cc:304] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bfdac66fe3f45c8aadeb6136ea18991, ad111e2f1bd8464197863677c9091a57; no voters: 
I20260709 12:16:29.518826 10194 raft_consensus.cc:2804] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.519197 10194 raft_consensus.cc:493] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.519603 10194 raft_consensus.cc:3060] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.520320 10148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17089f560a2548058166ec7bfc97fd14" candidate_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" is_pre_election: true
W20260709 12:16:29.521811  9964 leader_election.cc:343] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.521407 10195 raft_consensus.cc:515] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.523408 10074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4837c81987bb4c35b194e86a5602c451" candidate_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad111e2f1bd8464197863677c9091a57" is_pre_election: true
I20260709 12:16:29.524144 10074 raft_consensus.cc:2468] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec5d5f9a9c641ba97b82b28d016ba5b in term 0.
I20260709 12:16:29.524690  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4837c81987bb4c35b194e86a5602c451" candidate_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bfdac66fe3f45c8aadeb6136ea18991"
I20260709 12:16:29.525203  9999 raft_consensus.cc:3060] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.527921 10074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4837c81987bb4c35b194e86a5602c451" candidate_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad111e2f1bd8464197863677c9091a57"
I20260709 12:16:29.528231 10195 leader_election.cc:290] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [CANDIDATE]: Term 1 election: Requested vote from peers 9bfdac66fe3f45c8aadeb6136ea18991 (127.1.248.65:36449), ad111e2f1bd8464197863677c9091a57 (127.1.248.66:33237)
I20260709 12:16:29.528168 10194 raft_consensus.cc:515] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.528599 10074 raft_consensus.cc:3060] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.531117 10073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17089f560a2548058166ec7bfc97fd14" candidate_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad111e2f1bd8464197863677c9091a57"
I20260709 12:16:29.531801 10073 raft_consensus.cc:3060] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.532317  9999 raft_consensus.cc:2468] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec5d5f9a9c641ba97b82b28d016ba5b in term 1.
I20260709 12:16:29.533654 10111 leader_election.cc:304] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec5d5f9a9c641ba97b82b28d016ba5b, 9bfdac66fe3f45c8aadeb6136ea18991; no voters: 
I20260709 12:16:29.534614 10189 tablet_bootstrap.cc:492] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b: No bootstrap required, opened a new log
I20260709 12:16:29.534561 10195 raft_consensus.cc:2804] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.535277 10195 raft_consensus.cc:697] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 LEADER]: Becoming Leader. State: Replica: 5ec5d5f9a9c641ba97b82b28d016ba5b, State: Running, Role: LEADER
I20260709 12:16:29.535375 10189 ts_tablet_manager.cc:1403] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.003s
I20260709 12:16:29.536226 10195 consensus_queue.cc:237] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.537870 10074 raft_consensus.cc:2468] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec5d5f9a9c641ba97b82b28d016ba5b in term 1.
I20260709 12:16:29.539275 10189 raft_consensus.cc:359] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.540105 10189 raft_consensus.cc:385] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.540489 10189 raft_consensus.cc:740] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec5d5f9a9c641ba97b82b28d016ba5b, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.541450 10189 consensus_queue.cc:260] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.543310 10148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17089f560a2548058166ec7bfc97fd14" candidate_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b"
I20260709 12:16:29.543844 10189 ts_tablet_manager.cc:1434] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:29.543944 10148 raft_consensus.cc:3060] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.541481 10073 raft_consensus.cc:2468] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bfdac66fe3f45c8aadeb6136ea18991 in term 1.
I20260709 12:16:29.545459 10194 leader_election.cc:290] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [CANDIDATE]: Term 1 election: Requested vote from peers ad111e2f1bd8464197863677c9091a57 (127.1.248.66:33237), 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67:39249)
I20260709 12:16:29.545928  9962 leader_election.cc:304] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bfdac66fe3f45c8aadeb6136ea18991, ad111e2f1bd8464197863677c9091a57; no voters: 
I20260709 12:16:29.546710 10194 raft_consensus.cc:2804] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.547217 10194 raft_consensus.cc:697] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 LEADER]: Becoming Leader. State: Replica: 9bfdac66fe3f45c8aadeb6136ea18991, State: Running, Role: LEADER
I20260709 12:16:29.546412  9896 catalog_manager.cc:5697] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67). New cstate: current_term: 1 leader_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:29.548051 10194 consensus_queue.cc:237] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.551558 10148 raft_consensus.cc:2468] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bfdac66fe3f45c8aadeb6136ea18991 in term 1.
I20260709 12:16:29.557253  9897 catalog_manager.cc:5697] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bfdac66fe3f45c8aadeb6136ea18991 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.625633  9896 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36826:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:29.627777  9896 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:29.654467  9989 tablet_service.cc:1511] Processing CreateTablet for tablet 7c193c72c4f24dc8ad8b142f2cda1db6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5119f537264745b5b368d35cc03dffe4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:16:29.655980  9989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c193c72c4f24dc8ad8b142f2cda1db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.656006 10063 tablet_service.cc:1511] Processing CreateTablet for tablet 7c193c72c4f24dc8ad8b142f2cda1db6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5119f537264745b5b368d35cc03dffe4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:16:29.657487 10063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c193c72c4f24dc8ad8b142f2cda1db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.657342 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 7c193c72c4f24dc8ad8b142f2cda1db6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5119f537264745b5b368d35cc03dffe4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:16:29.658641 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c193c72c4f24dc8ad8b142f2cda1db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.658702  9988 tablet_service.cc:1511] Processing CreateTablet for tablet 14c33abfbc3c4330be1fdd9639ba6041 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5119f537264745b5b368d35cc03dffe4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:16:29.660040  9988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c33abfbc3c4330be1fdd9639ba6041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.672951 10064 tablet_service.cc:1511] Processing CreateTablet for tablet 14c33abfbc3c4330be1fdd9639ba6041 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5119f537264745b5b368d35cc03dffe4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:16:29.674393 10064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c33abfbc3c4330be1fdd9639ba6041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.680747 10188 tablet_bootstrap.cc:492] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991: Bootstrap starting.
I20260709 12:16:29.681347 10138 tablet_service.cc:1511] Processing CreateTablet for tablet 14c33abfbc3c4330be1fdd9639ba6041 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5119f537264745b5b368d35cc03dffe4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:16:29.682791 10138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c33abfbc3c4330be1fdd9639ba6041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.688972 10188 tablet_bootstrap.cc:654] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.694291 10192 tablet_bootstrap.cc:492] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57: Bootstrap starting.
I20260709 12:16:29.701231 10188 tablet_bootstrap.cc:492] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991: No bootstrap required, opened a new log
I20260709 12:16:29.701843 10188 ts_tablet_manager.cc:1403] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:16:29.702826 10192 tablet_bootstrap.cc:654] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.705256 10188 raft_consensus.cc:359] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.706156 10188 raft_consensus.cc:385] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.706501 10188 raft_consensus.cc:740] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bfdac66fe3f45c8aadeb6136ea18991, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.706862 10189 tablet_bootstrap.cc:492] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Bootstrap starting.
I20260709 12:16:29.707386 10188 consensus_queue.cc:260] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.710100 10188 ts_tablet_manager.cc:1434] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:16:29.711535 10188 tablet_bootstrap.cc:492] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991: Bootstrap starting.
I20260709 12:16:29.712199 10192 tablet_bootstrap.cc:492] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57: No bootstrap required, opened a new log
I20260709 12:16:29.712738 10192 ts_tablet_manager.cc:1403] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.002s
I20260709 12:16:29.716449 10189 tablet_bootstrap.cc:654] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.716322 10192 raft_consensus.cc:359] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.717094 10192 raft_consensus.cc:385] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.717424 10192 raft_consensus.cc:740] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad111e2f1bd8464197863677c9091a57, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.718559 10188 tablet_bootstrap.cc:654] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.718358 10192 consensus_queue.cc:260] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.721231 10192 ts_tablet_manager.cc:1434] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:29.721724 10197 raft_consensus.cc:493] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.722293 10197 raft_consensus.cc:515] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.722316 10192 tablet_bootstrap.cc:492] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57: Bootstrap starting.
I20260709 12:16:29.724992 10197 leader_election.cc:290] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bfdac66fe3f45c8aadeb6136ea18991 (127.1.248.65:36449), 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67:39249)
I20260709 12:16:29.733742 10192 tablet_bootstrap.cc:654] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.745555 10148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c193c72c4f24dc8ad8b142f2cda1db6" candidate_uuid: "ad111e2f1bd8464197863677c9091a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" is_pre_election: true
W20260709 12:16:29.747702 10039 leader_election.cc:343] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:29.748929 10192 tablet_bootstrap.cc:492] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57: No bootstrap required, opened a new log
I20260709 12:16:29.749729 10192 ts_tablet_manager.cc:1403] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 12:16:29.753927 10192 raft_consensus.cc:359] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.754962 10192 raft_consensus.cc:385] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.755347 10192 raft_consensus.cc:740] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad111e2f1bd8464197863677c9091a57, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.756042  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c193c72c4f24dc8ad8b142f2cda1db6" candidate_uuid: "ad111e2f1bd8464197863677c9091a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" is_pre_election: true
I20260709 12:16:29.756356 10192 consensus_queue.cc:260] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.756832  9999 raft_consensus.cc:2468] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad111e2f1bd8464197863677c9091a57 in term 0.
I20260709 12:16:29.757665 10189 tablet_bootstrap.cc:492] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b: No bootstrap required, opened a new log
I20260709 12:16:29.758294 10189 ts_tablet_manager.cc:1403] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Time spent bootstrapping tablet: real 0.052s	user 0.028s	sys 0.003s
I20260709 12:16:29.758780 10188 tablet_bootstrap.cc:492] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991: No bootstrap required, opened a new log
I20260709 12:16:29.758877 10192 ts_tablet_manager.cc:1434] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.007s
I20260709 12:16:29.759387 10188 ts_tablet_manager.cc:1403] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.003s
I20260709 12:16:29.760530 10037 leader_election.cc:304] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bfdac66fe3f45c8aadeb6136ea18991, ad111e2f1bd8464197863677c9091a57; no voters: 5ec5d5f9a9c641ba97b82b28d016ba5b
I20260709 12:16:29.761778 10197 raft_consensus.cc:2804] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.761509 10189 raft_consensus.cc:359] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.762267 10197 raft_consensus.cc:493] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.762390 10189 raft_consensus.cc:385] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.762693 10197 raft_consensus.cc:3060] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.762782 10189 raft_consensus.cc:740] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec5d5f9a9c641ba97b82b28d016ba5b, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.763636 10188 raft_consensus.cc:359] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.764441 10188 raft_consensus.cc:385] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.764160 10189 consensus_queue.cc:260] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.764827 10188 raft_consensus.cc:740] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bfdac66fe3f45c8aadeb6136ea18991, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.765746 10188 consensus_queue.cc:260] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.768079 10188 ts_tablet_manager.cc:1434] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:16:29.770298 10189 ts_tablet_manager.cc:1434] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.007s
I20260709 12:16:29.771531 10189 tablet_bootstrap.cc:492] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Bootstrap starting.
I20260709 12:16:29.775024 10197 raft_consensus.cc:515] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.777945 10197 leader_election.cc:290] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [CANDIDATE]: Term 1 election: Requested vote from peers 9bfdac66fe3f45c8aadeb6136ea18991 (127.1.248.65:36449), 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67:39249)
I20260709 12:16:29.777879  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c193c72c4f24dc8ad8b142f2cda1db6" candidate_uuid: "ad111e2f1bd8464197863677c9091a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bfdac66fe3f45c8aadeb6136ea18991"
I20260709 12:16:29.778548  9999 raft_consensus.cc:3060] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.778654 10189 tablet_bootstrap.cc:654] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.780220 10148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c193c72c4f24dc8ad8b142f2cda1db6" candidate_uuid: "ad111e2f1bd8464197863677c9091a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b"
I20260709 12:16:29.780833 10148 raft_consensus.cc:3060] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.787168  9999 raft_consensus.cc:2468] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad111e2f1bd8464197863677c9091a57 in term 1.
I20260709 12:16:29.788350 10037 leader_election.cc:304] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bfdac66fe3f45c8aadeb6136ea18991, ad111e2f1bd8464197863677c9091a57; no voters: 
I20260709 12:16:29.788353 10148 raft_consensus.cc:2468] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad111e2f1bd8464197863677c9091a57 in term 1.
I20260709 12:16:29.789160 10189 tablet_bootstrap.cc:492] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b: No bootstrap required, opened a new log
I20260709 12:16:29.789403 10197 raft_consensus.cc:2804] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.789719 10189 ts_tablet_manager.cc:1403] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 12:16:29.791599 10197 raft_consensus.cc:697] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 1 LEADER]: Becoming Leader. State: Replica: ad111e2f1bd8464197863677c9091a57, State: Running, Role: LEADER
I20260709 12:16:29.792441 10189 raft_consensus.cc:359] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.793069 10189 raft_consensus.cc:385] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.792559 10197 consensus_queue.cc:237] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.793351 10189 raft_consensus.cc:740] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec5d5f9a9c641ba97b82b28d016ba5b, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.794121 10189 consensus_queue.cc:260] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.796243 10189 ts_tablet_manager.cc:1434] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:29.802115  9895 catalog_manager.cc:5697] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad111e2f1bd8464197863677c9091a57 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "ad111e2f1bd8464197863677c9091a57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.865207 10194 raft_consensus.cc:493] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.865747 10194 raft_consensus.cc:515] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.867833 10194 leader_election.cc:290] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad111e2f1bd8464197863677c9091a57 (127.1.248.66:33237), 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67:39249)
I20260709 12:16:29.868872 10148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c33abfbc3c4330be1fdd9639ba6041" candidate_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" is_pre_election: true
I20260709 12:16:29.868755 10073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c33abfbc3c4330be1fdd9639ba6041" candidate_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad111e2f1bd8464197863677c9091a57" is_pre_election: true
I20260709 12:16:29.869601 10148 raft_consensus.cc:2468] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bfdac66fe3f45c8aadeb6136ea18991 in term 0.
I20260709 12:16:29.869634 10073 raft_consensus.cc:2468] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bfdac66fe3f45c8aadeb6136ea18991 in term 0.
I20260709 12:16:29.870824  9964 leader_election.cc:304] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec5d5f9a9c641ba97b82b28d016ba5b, 9bfdac66fe3f45c8aadeb6136ea18991; no voters: 
I20260709 12:16:29.871670 10194 raft_consensus.cc:2804] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.871979 10194 raft_consensus.cc:493] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.872332 10194 raft_consensus.cc:3060] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:29.874677  9945 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:29.878324 10194 raft_consensus.cc:515] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.880014 10194 leader_election.cc:290] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [CANDIDATE]: Term 1 election: Requested vote from peers ad111e2f1bd8464197863677c9091a57 (127.1.248.66:33237), 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67:39249)
I20260709 12:16:29.880930 10073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c33abfbc3c4330be1fdd9639ba6041" candidate_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad111e2f1bd8464197863677c9091a57"
I20260709 12:16:29.881099 10148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c33abfbc3c4330be1fdd9639ba6041" candidate_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b"
I20260709 12:16:29.881461 10073 raft_consensus.cc:3060] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.881701 10148 raft_consensus.cc:3060] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.887720 10073 raft_consensus.cc:2468] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bfdac66fe3f45c8aadeb6136ea18991 in term 1.
I20260709 12:16:29.887876 10148 raft_consensus.cc:2468] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bfdac66fe3f45c8aadeb6136ea18991 in term 1.
I20260709 12:16:29.888767  9962 leader_election.cc:304] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bfdac66fe3f45c8aadeb6136ea18991, ad111e2f1bd8464197863677c9091a57; no voters: 
I20260709 12:16:29.889577 10194 raft_consensus.cc:2804] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.889981 10194 raft_consensus.cc:697] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 LEADER]: Becoming Leader. State: Replica: 9bfdac66fe3f45c8aadeb6136ea18991, State: Running, Role: LEADER
I20260709 12:16:29.890733 10194 consensus_queue.cc:237] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.897373  9895 catalog_manager.cc:5697] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bfdac66fe3f45c8aadeb6136ea18991 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.948886 10148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4837c81987bb4c35b194e86a5602c451"
dest_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b"
mode: GRACEFUL
new_leader_uuid: "9bfdac66fe3f45c8aadeb6136ea18991"
 from {username='slave'} at 127.0.0.1:35796
I20260709 12:16:29.949580 10148 raft_consensus.cc:606] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 LEADER]: Received request to transfer leadership to TS 9bfdac66fe3f45c8aadeb6136ea18991
I20260709 12:16:29.950611 10194 consensus_queue.cc:1048] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:29.963259 10194 consensus_queue.cc:1048] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:29.966984  9999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17089f560a2548058166ec7bfc97fd14"
dest_uuid: "9bfdac66fe3f45c8aadeb6136ea18991"
mode: GRACEFUL
new_leader_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b"
 from {username='slave'} at 127.0.0.1:60268
I20260709 12:16:29.967607  9999 raft_consensus.cc:606] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 LEADER]: Received request to transfer leadership to TS 5ec5d5f9a9c641ba97b82b28d016ba5b
I20260709 12:16:29.974936 10201 raft_consensus.cc:993] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991: : Instructing follower 5ec5d5f9a9c641ba97b82b28d016ba5b to start an election
I20260709 12:16:29.975399 10201 raft_consensus.cc:1081] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 LEADER]: Signalling peer 5ec5d5f9a9c641ba97b82b28d016ba5b to start an election
I20260709 12:16:29.977227 10148 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17089f560a2548058166ec7bfc97fd14"
dest_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b"
 from {username='slave'} at 127.0.0.1:35786
I20260709 12:16:29.977792 10148 raft_consensus.cc:493] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:29.978188 10148 raft_consensus.cc:3060] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:29.985847 10148 raft_consensus.cc:515] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.986878 10073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c193c72c4f24dc8ad8b142f2cda1db6"
dest_uuid: "ad111e2f1bd8464197863677c9091a57"
mode: GRACEFUL
new_leader_uuid: "9bfdac66fe3f45c8aadeb6136ea18991"
 from {username='slave'} at 127.0.0.1:40316
I20260709 12:16:29.987504 10073 raft_consensus.cc:606] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 1 LEADER]: Received request to transfer leadership to TS 9bfdac66fe3f45c8aadeb6136ea18991
I20260709 12:16:29.988078 10148 leader_election.cc:290] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [CANDIDATE]: Term 2 election: Requested vote from peers 9bfdac66fe3f45c8aadeb6136ea18991 (127.1.248.65:36449), ad111e2f1bd8464197863677c9091a57 (127.1.248.66:33237)
I20260709 12:16:29.989097  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17089f560a2548058166ec7bfc97fd14" candidate_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bfdac66fe3f45c8aadeb6136ea18991"
I20260709 12:16:29.989741  9999 raft_consensus.cc:3055] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:29.989719 10073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17089f560a2548058166ec7bfc97fd14" candidate_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad111e2f1bd8464197863677c9091a57"
I20260709 12:16:29.990326  9999 raft_consensus.cc:740] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bfdac66fe3f45c8aadeb6136ea18991, State: Running, Role: LEADER
I20260709 12:16:29.990502 10073 raft_consensus.cc:3060] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:29.991290  9999 consensus_queue.cc:260] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:29.992646  9999 raft_consensus.cc:3060] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:29.998421 10073 raft_consensus.cc:2468] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec5d5f9a9c641ba97b82b28d016ba5b in term 2.
I20260709 12:16:29.999857 10111 leader_election.cc:304] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec5d5f9a9c641ba97b82b28d016ba5b, ad111e2f1bd8464197863677c9091a57; no voters: 
I20260709 12:16:30.000372  9999 raft_consensus.cc:2468] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec5d5f9a9c641ba97b82b28d016ba5b in term 2.
I20260709 12:16:30.000797 10195 raft_consensus.cc:2804] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:30.001359 10195 raft_consensus.cc:697] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 LEADER]: Becoming Leader. State: Replica: 5ec5d5f9a9c641ba97b82b28d016ba5b, State: Running, Role: LEADER
I20260709 12:16:30.002264 10195 consensus_queue.cc:237] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:30.009158  9896 catalog_manager.cc:5697] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b reported cstate change: term changed from 1 to 2, leader changed from 9bfdac66fe3f45c8aadeb6136ea18991 (127.1.248.65) to 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67). New cstate: current_term: 2 leader_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:30.024365 10195 consensus_queue.cc:1048] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.036778 10195 consensus_queue.cc:1048] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.049415 10196 raft_consensus.cc:993] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b: : Instructing follower 9bfdac66fe3f45c8aadeb6136ea18991 to start an election
I20260709 12:16:30.050024 10230 raft_consensus.cc:1081] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 LEADER]: Signalling peer 9bfdac66fe3f45c8aadeb6136ea18991 to start an election
I20260709 12:16:30.052623  9999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4837c81987bb4c35b194e86a5602c451"
dest_uuid: "9bfdac66fe3f45c8aadeb6136ea18991"
 from {username='slave'} at 127.0.0.1:60250
I20260709 12:16:30.053253  9999 raft_consensus.cc:493] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:30.053644  9999 raft_consensus.cc:3060] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.060047  9999 raft_consensus.cc:515] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:30.062134  9999 leader_election.cc:290] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [CANDIDATE]: Term 2 election: Requested vote from peers ad111e2f1bd8464197863677c9091a57 (127.1.248.66:33237), 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67:39249)
I20260709 12:16:30.063292 10073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4837c81987bb4c35b194e86a5602c451" candidate_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad111e2f1bd8464197863677c9091a57"
I20260709 12:16:30.063781 10148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4837c81987bb4c35b194e86a5602c451" candidate_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b"
I20260709 12:16:30.063982 10073 raft_consensus.cc:3060] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.064435 10148 raft_consensus.cc:3055] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:30.064791 10148 raft_consensus.cc:740] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec5d5f9a9c641ba97b82b28d016ba5b, State: Running, Role: LEADER
I20260709 12:16:30.065801 10148 consensus_queue.cc:260] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:30.067159 10148 raft_consensus.cc:3060] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.071244 10073 raft_consensus.cc:2468] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bfdac66fe3f45c8aadeb6136ea18991 in term 2.
I20260709 12:16:30.072415  9962 leader_election.cc:304] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bfdac66fe3f45c8aadeb6136ea18991, ad111e2f1bd8464197863677c9091a57; no voters: 
I20260709 12:16:30.073302 10201 raft_consensus.cc:2804] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:30.073746 10201 raft_consensus.cc:697] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 LEADER]: Becoming Leader. State: Replica: 9bfdac66fe3f45c8aadeb6136ea18991, State: Running, Role: LEADER
I20260709 12:16:30.074472 10201 consensus_queue.cc:237] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:30.075330 10148 raft_consensus.cc:2468] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bfdac66fe3f45c8aadeb6136ea18991 in term 2.
I20260709 12:16:30.082394  9897 catalog_manager.cc:5697] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 reported cstate change: term changed from 1 to 2, leader changed from 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67) to 9bfdac66fe3f45c8aadeb6136ea18991 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:30.286886 10197 consensus_queue.cc:1048] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:30.295907 10233 raft_consensus.cc:993] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57: : Instructing follower 9bfdac66fe3f45c8aadeb6136ea18991 to start an election
I20260709 12:16:30.296754 10197 raft_consensus.cc:1081] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 1 LEADER]: Signalling peer 9bfdac66fe3f45c8aadeb6136ea18991 to start an election
I20260709 12:16:30.299829  9998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c193c72c4f24dc8ad8b142f2cda1db6"
dest_uuid: "9bfdac66fe3f45c8aadeb6136ea18991"
 from {username='slave'} at 127.0.0.1:60262
I20260709 12:16:30.303642  9998 raft_consensus.cc:493] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:30.304077  9998 raft_consensus.cc:3060] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.306028 10233 consensus_queue.cc:1048] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.313045  9998 raft_consensus.cc:515] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:30.319149  9998 leader_election.cc:290] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [CANDIDATE]: Term 2 election: Requested vote from peers ad111e2f1bd8464197863677c9091a57 (127.1.248.66:33237), 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67:39249)
I20260709 12:16:30.319931 10148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c193c72c4f24dc8ad8b142f2cda1db6" candidate_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b"
I20260709 12:16:30.320748 10148 raft_consensus.cc:3060] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.321249 10073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c193c72c4f24dc8ad8b142f2cda1db6" candidate_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad111e2f1bd8464197863677c9091a57"
I20260709 12:16:30.321954 10073 raft_consensus.cc:3055] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:30.322324 10073 raft_consensus.cc:740] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad111e2f1bd8464197863677c9091a57, State: Running, Role: LEADER
I20260709 12:16:30.323159 10073 consensus_queue.cc:260] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:30.324505 10073 raft_consensus.cc:3060] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:30.325708 10233 consensus_queue.cc:1175] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:16:30.328717 10148 raft_consensus.cc:2468] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bfdac66fe3f45c8aadeb6136ea18991 in term 2.
I20260709 12:16:30.329993  9964 leader_election.cc:304] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec5d5f9a9c641ba97b82b28d016ba5b, 9bfdac66fe3f45c8aadeb6136ea18991; no voters: 
I20260709 12:16:30.330875 10201 raft_consensus.cc:2804] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:30.331374 10201 raft_consensus.cc:697] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 LEADER]: Becoming Leader. State: Replica: 9bfdac66fe3f45c8aadeb6136ea18991, State: Running, Role: LEADER
I20260709 12:16:30.332160 10201 consensus_queue.cc:237] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:30.333140 10073 raft_consensus.cc:2468] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bfdac66fe3f45c8aadeb6136ea18991 in term 2.
I20260709 12:16:30.340163  9895 catalog_manager.cc:5697] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 reported cstate change: term changed from 1 to 2, leader changed from ad111e2f1bd8464197863677c9091a57 (127.1.248.66) to 9bfdac66fe3f45c8aadeb6136ea18991 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:30.439496 10201 consensus_queue.cc:1048] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.452158 10237 consensus_queue.cc:1048] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:30.469980 10148 raft_consensus.cc:1275] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Refusing update from remote peer 9bfdac66fe3f45c8aadeb6136ea18991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:30.470378  2017 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:16:30.471287 10237 consensus_queue.cc:1048] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:30.472756  2017 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:16:30.473409  2017 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:16:30.481626 10073 raft_consensus.cc:1275] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Refusing update from remote peer 9bfdac66fe3f45c8aadeb6136ea18991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:30.483249 10237 consensus_queue.cc:1048] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:30.501473  9998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14c33abfbc3c4330be1fdd9639ba6041"
dest_uuid: "9bfdac66fe3f45c8aadeb6136ea18991"
mode: GRACEFUL
new_leader_uuid: "ad111e2f1bd8464197863677c9091a57"
 from {username='slave'} at 127.0.0.1:60274
I20260709 12:16:30.501972  9998 raft_consensus.cc:606] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 LEADER]: Received request to transfer leadership to TS ad111e2f1bd8464197863677c9091a57
I20260709 12:16:30.503079  2017 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:16:30.554380  9998 raft_consensus.cc:1275] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 FOLLOWER]: Refusing update from remote peer 5ec5d5f9a9c641ba97b82b28d016ba5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:30.555661 10230 consensus_queue.cc:1048] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:30.566042 10073 raft_consensus.cc:1275] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Refusing update from remote peer 5ec5d5f9a9c641ba97b82b28d016ba5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:30.567538 10230 consensus_queue.cc:1048] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:30.731982 10073 raft_consensus.cc:1275] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Refusing update from remote peer 9bfdac66fe3f45c8aadeb6136ea18991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:30.733331 10237 consensus_queue.cc:1048] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:30.741036 10148 raft_consensus.cc:1275] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Refusing update from remote peer 9bfdac66fe3f45c8aadeb6136ea18991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:30.742869 10201 consensus_queue.cc:1048] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:31.017277 10201 raft_consensus.cc:993] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991: : Instructing follower ad111e2f1bd8464197863677c9091a57 to start an election
I20260709 12:16:31.017820 10194 raft_consensus.cc:1081] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 LEADER]: Signalling peer ad111e2f1bd8464197863677c9091a57 to start an election
I20260709 12:16:31.019479 10073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14c33abfbc3c4330be1fdd9639ba6041"
dest_uuid: "ad111e2f1bd8464197863677c9091a57"
 from {username='slave'} at 127.0.0.1:40304
I20260709 12:16:31.020051 10073 raft_consensus.cc:493] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:31.020447 10073 raft_consensus.cc:3060] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:31.025610 10073 raft_consensus.cc:515] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:31.027153 10073 leader_election.cc:290] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [CANDIDATE]: Term 2 election: Requested vote from peers 9bfdac66fe3f45c8aadeb6136ea18991 (127.1.248.65:36449), 5ec5d5f9a9c641ba97b82b28d016ba5b (127.1.248.67:39249)
I20260709 12:16:31.028220  9998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c33abfbc3c4330be1fdd9639ba6041" candidate_uuid: "ad111e2f1bd8464197863677c9091a57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bfdac66fe3f45c8aadeb6136ea18991"
I20260709 12:16:31.028309 10148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c33abfbc3c4330be1fdd9639ba6041" candidate_uuid: "ad111e2f1bd8464197863677c9091a57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b"
I20260709 12:16:31.028860  9998 raft_consensus.cc:3055] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:31.028999 10148 raft_consensus.cc:3060] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:31.029168  9998 raft_consensus.cc:740] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bfdac66fe3f45c8aadeb6136ea18991, State: Running, Role: LEADER
I20260709 12:16:31.029963  9998 consensus_queue.cc:260] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:31.030917  9998 raft_consensus.cc:3060] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:31.034969 10148 raft_consensus.cc:2468] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad111e2f1bd8464197863677c9091a57 in term 2.
I20260709 12:16:31.035892  9998 raft_consensus.cc:2468] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad111e2f1bd8464197863677c9091a57 in term 2.
I20260709 12:16:31.036597 10039 leader_election.cc:304] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec5d5f9a9c641ba97b82b28d016ba5b, ad111e2f1bd8464197863677c9091a57; no voters: 
I20260709 12:16:31.037621 10234 raft_consensus.cc:2804] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:31.038707 10234 raft_consensus.cc:697] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 2 LEADER]: Becoming Leader. State: Replica: ad111e2f1bd8464197863677c9091a57, State: Running, Role: LEADER
I20260709 12:16:31.039543 10234 consensus_queue.cc:237] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } }
I20260709 12:16:31.045837  9895 catalog_manager.cc:5697] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 reported cstate change: term changed from 1 to 2, leader changed from 9bfdac66fe3f45c8aadeb6136ea18991 (127.1.248.65) to ad111e2f1bd8464197863677c9091a57 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "ad111e2f1bd8464197863677c9091a57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bfdac66fe3f45c8aadeb6136ea18991" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad111e2f1bd8464197863677c9091a57" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 33237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec5d5f9a9c641ba97b82b28d016ba5b" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.122218  2017 tablet_server.cc:179] TabletServer@127.1.248.65:0 shutting down...
I20260709 12:16:31.145848  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:31.146534  2017 tablet_replica.cc:333] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991: stopping tablet replica
I20260709 12:16:31.147130  2017 raft_consensus.cc:2243] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:31.148036  2017 raft_consensus.cc:2272] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.150525  2017 tablet_replica.cc:333] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991: stopping tablet replica
I20260709 12:16:31.151060  2017 raft_consensus.cc:2243] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.151502  2017 raft_consensus.cc:2272] T 14c33abfbc3c4330be1fdd9639ba6041 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.153633  2017 tablet_replica.cc:333] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991: stopping tablet replica
I20260709 12:16:31.154126  2017 raft_consensus.cc:2243] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:31.154870  2017 raft_consensus.cc:2272] T 4837c81987bb4c35b194e86a5602c451 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.157196  2017 tablet_replica.cc:333] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991: stopping tablet replica
I20260709 12:16:31.157655  2017 raft_consensus.cc:2243] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.158030  2017 raft_consensus.cc:2272] T 17089f560a2548058166ec7bfc97fd14 P 9bfdac66fe3f45c8aadeb6136ea18991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.172325  2017 tablet_server.cc:196] TabletServer@127.1.248.65:0 shutdown complete.
I20260709 12:16:31.185870  2017 tablet_server.cc:179] TabletServer@127.1.248.66:0 shutting down...
I20260709 12:16:31.205830  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:31.206588  2017 tablet_replica.cc:333] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57: stopping tablet replica
I20260709 12:16:31.207233  2017 raft_consensus.cc:2243] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.207862  2017 raft_consensus.cc:2272] T 7c193c72c4f24dc8ad8b142f2cda1db6 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.210304  2017 tablet_replica.cc:333] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57: stopping tablet replica
I20260709 12:16:31.210937  2017 raft_consensus.cc:2243] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:31.211696  2017 pending_rounds.cc:70] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57: Trying to abort 1 pending ops.
I20260709 12:16:31.211896  2017 pending_rounds.cc:77] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305623105706598400 op_type: NO_OP noop_request { }
I20260709 12:16:31.212232  2017 raft_consensus.cc:2889] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:16:31.212554  2017 raft_consensus.cc:2272] T 14c33abfbc3c4330be1fdd9639ba6041 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.214934  2017 tablet_replica.cc:333] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57: stopping tablet replica
I20260709 12:16:31.215615  2017 raft_consensus.cc:2243] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.216106  2017 raft_consensus.cc:2272] T 4837c81987bb4c35b194e86a5602c451 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.218433  2017 tablet_replica.cc:333] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57: stopping tablet replica
I20260709 12:16:31.218952  2017 raft_consensus.cc:2243] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.219389  2017 raft_consensus.cc:2272] T 17089f560a2548058166ec7bfc97fd14 P ad111e2f1bd8464197863677c9091a57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.242908  2017 tablet_server.cc:196] TabletServer@127.1.248.66:0 shutdown complete.
I20260709 12:16:31.256737  2017 tablet_server.cc:179] TabletServer@127.1.248.67:0 shutting down...
I20260709 12:16:31.277242  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:31.277916  2017 tablet_replica.cc:333] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b: stopping tablet replica
I20260709 12:16:31.278466  2017 raft_consensus.cc:2243] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.278884  2017 raft_consensus.cc:2272] T 7c193c72c4f24dc8ad8b142f2cda1db6 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.281260  2017 tablet_replica.cc:333] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b: stopping tablet replica
I20260709 12:16:31.281736  2017 raft_consensus.cc:2243] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:31.282491  2017 raft_consensus.cc:2272] T 17089f560a2548058166ec7bfc97fd14 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.284667  2017 tablet_replica.cc:333] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b: stopping tablet replica
I20260709 12:16:31.285140  2017 raft_consensus.cc:2243] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.285497  2017 raft_consensus.cc:2272] T 14c33abfbc3c4330be1fdd9639ba6041 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.287813  2017 tablet_replica.cc:333] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b: stopping tablet replica
I20260709 12:16:31.288237  2017 raft_consensus.cc:2243] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.288599  2017 raft_consensus.cc:2272] T 4837c81987bb4c35b194e86a5602c451 P 5ec5d5f9a9c641ba97b82b28d016ba5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.311801  2017 tablet_server.cc:196] TabletServer@127.1.248.67:0 shutdown complete.
I20260709 12:16:31.326463  2017 master.cc:562] Master@127.1.248.126:35733 shutting down...
I20260709 12:16:31.341872  2017 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:31.342468  2017 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.342806  2017 tablet_replica.cc:333] T 00000000000000000000000000000000 P 946e759a258a4f02a85cf21fafffe063: stopping tablet replica
I20260709 12:16:31.360934  2017 master.cc:584] Master@127.1.248.126:35733 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2673 ms)
[----------] 6 tests from LeaderRebalancerTest (282545 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:16:31.388301  2017 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.248.126:38283
I20260709 12:16:31.389405  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:31.394268 10247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:31.394578 10248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:31.396026 10250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:31.397225  2017 server_base.cc:1061] running on GCE node
I20260709 12:16:31.398036  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:31.398247  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:31.398456  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599391398438 us; error 0 us; skew 500 ppm
I20260709 12:16:31.398985  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:31.401285  2017 webserver.cc:533] Webserver started at http://127.1.248.126:38585/ using document root <none> and password file <none>
I20260709 12:16:31.401767  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:31.401980  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:31.402262  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:31.403326  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/master-0-root/instance:
uuid: "40139625d4174d37a16225fc485aa107"
format_stamp: "Formatted at 2026-07-09 12:16:31 on dist-test-slave-z9f9"
I20260709 12:16:31.408012  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:16:31.411510 10255 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:31.412261  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:16:31.412554  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/master-0-root
uuid: "40139625d4174d37a16225fc485aa107"
format_stamp: "Formatted at 2026-07-09 12:16:31 on dist-test-slave-z9f9"
I20260709 12:16:31.412835  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:31.429816  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:31.430857  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:31.468923  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.126:38283
I20260709 12:16:31.469020 10306 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.126:38283 every 8 connection(s)
I20260709 12:16:31.473237 10307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:31.484333 10307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107: Bootstrap starting.
I20260709 12:16:31.488945 10307 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.493952 10307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107: No bootstrap required, opened a new log
I20260709 12:16:31.496663 10307 raft_consensus.cc:359] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40139625d4174d37a16225fc485aa107" member_type: VOTER }
I20260709 12:16:31.497102 10307 raft_consensus.cc:385] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.497340 10307 raft_consensus.cc:740] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40139625d4174d37a16225fc485aa107, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.498042 10307 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40139625d4174d37a16225fc485aa107" member_type: VOTER }
I20260709 12:16:31.498548 10307 raft_consensus.cc:399] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:31.498798 10307 raft_consensus.cc:493] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:31.499107 10307 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.504433 10307 raft_consensus.cc:515] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40139625d4174d37a16225fc485aa107" member_type: VOTER }
I20260709 12:16:31.505012 10307 leader_election.cc:304] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40139625d4174d37a16225fc485aa107; no voters: 
I20260709 12:16:31.506321 10307 leader_election.cc:290] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:31.506743 10310 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:31.508507 10310 raft_consensus.cc:697] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [term 1 LEADER]: Becoming Leader. State: Replica: 40139625d4174d37a16225fc485aa107, State: Running, Role: LEADER
I20260709 12:16:31.509208 10310 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40139625d4174d37a16225fc485aa107" member_type: VOTER }
I20260709 12:16:31.509832 10307 sys_catalog.cc:565] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:31.513056 10312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40139625d4174d37a16225fc485aa107. Latest consensus state: current_term: 1 leader_uuid: "40139625d4174d37a16225fc485aa107" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40139625d4174d37a16225fc485aa107" member_type: VOTER } }
I20260709 12:16:31.513749 10312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:31.512899 10311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40139625d4174d37a16225fc485aa107" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40139625d4174d37a16225fc485aa107" member_type: VOTER } }
I20260709 12:16:31.515003 10311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:31.521644 10316 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:31.527714 10316 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:31.528842  2017 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:31.536818 10316 catalog_manager.cc:1383] Generated new cluster ID: 95daf092c3564617b77f7dcccccdb566
I20260709 12:16:31.537357 10316 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:31.570961 10316 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:31.572422 10316 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:31.592196 10316 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107: Generated new TSK 0
I20260709 12:16:31.592901 10316 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:31.660529  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:31.666623 10328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:31.667959 10329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:31.670882  2017 server_base.cc:1061] running on GCE node
W20260709 12:16:31.670925 10331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:31.672133  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:31.672431  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:31.672621  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599391672599 us; error 0 us; skew 500 ppm
I20260709 12:16:31.673218  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:31.675945  2017 webserver.cc:533] Webserver started at http://127.1.248.65:41887/ using document root <none> and password file <none>
I20260709 12:16:31.676482  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:31.676702  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:31.677000  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:31.678194  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-0-root/instance:
uuid: "021c49ecd5974a54a3b690aa43e71f69"
format_stamp: "Formatted at 2026-07-09 12:16:31 on dist-test-slave-z9f9"
I20260709 12:16:31.683075  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 12:16:31.686875 10336 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:31.687879  2017 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:16:31.688218  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-0-root
uuid: "021c49ecd5974a54a3b690aa43e71f69"
format_stamp: "Formatted at 2026-07-09 12:16:31 on dist-test-slave-z9f9"
I20260709 12:16:31.688530  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:31.709929  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:31.711177  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:31.712777  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:31.715566  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:31.715803  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:31.716058  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:31.716243  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:31.755110  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.65:42929
I20260709 12:16:31.755227 10398 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.65:42929 every 8 connection(s)
I20260709 12:16:31.760453  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:31.767176 10403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:31.768795 10404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:31.771518 10406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:31.772214  2017 server_base.cc:1061] running on GCE node
I20260709 12:16:31.773317 10399 heartbeater.cc:344] Connected to a master server at 127.1.248.126:38283
I20260709 12:16:31.773800 10399 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:31.774194  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:31.774497  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:31.774693 10399 heartbeater.cc:507] Master 127.1.248.126:38283 requested a full tablet report, sending...
I20260709 12:16:31.774704  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599391774684 us; error 0 us; skew 500 ppm
I20260709 12:16:31.775858  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:31.777493 10272 ts_manager.cc:194] Registered new tserver with Master: 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929)
I20260709 12:16:31.778692  2017 webserver.cc:533] Webserver started at http://127.1.248.66:40111/ using document root <none> and password file <none>
I20260709 12:16:31.779414  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:31.779683  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:31.779989  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:31.780131 10272 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34370
I20260709 12:16:31.781420  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-1-root/instance:
uuid: "5f70ed38144548d197978cda555dc43b"
format_stamp: "Formatted at 2026-07-09 12:16:31 on dist-test-slave-z9f9"
I20260709 12:16:31.786255  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:16:31.789652 10411 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:31.790465  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:31.790805  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-1-root
uuid: "5f70ed38144548d197978cda555dc43b"
format_stamp: "Formatted at 2026-07-09 12:16:31 on dist-test-slave-z9f9"
I20260709 12:16:31.791102  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:31.810802  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:31.812016  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:31.813449  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:31.815814  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:31.816045  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:31.816287  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:31.816460  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:31.853578  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.66:41657
I20260709 12:16:31.853688 10473 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.66:41657 every 8 connection(s)
I20260709 12:16:31.858474  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:31.866529 10477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:31.867632 10478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:31.869457 10480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:31.871245 10474 heartbeater.cc:344] Connected to a master server at 127.1.248.126:38283
I20260709 12:16:31.871392  2017 server_base.cc:1061] running on GCE node
I20260709 12:16:31.871855 10474 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:31.872452  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:31.872769  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:31.872664 10474 heartbeater.cc:507] Master 127.1.248.126:38283 requested a full tablet report, sending...
I20260709 12:16:31.873131  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599391873098 us; error 0 us; skew 500 ppm
I20260709 12:16:31.873755  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:31.875242 10272 ts_manager.cc:194] Registered new tserver with Master: 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:31.876425  2017 webserver.cc:533] Webserver started at http://127.1.248.67:44011/ using document root <none> and password file <none>
I20260709 12:16:31.876971  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:31.876904 10272 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34372
I20260709 12:16:31.877331  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:31.877650  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:31.878840  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-2-root/instance:
uuid: "173593b73f1d4418957c253a8bfcb969"
format_stamp: "Formatted at 2026-07-09 12:16:31 on dist-test-slave-z9f9"
I20260709 12:16:31.883185  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:16:31.886448 10485 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:31.887228  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:31.887589  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-2-root
uuid: "173593b73f1d4418957c253a8bfcb969"
format_stamp: "Formatted at 2026-07-09 12:16:31 on dist-test-slave-z9f9"
I20260709 12:16:31.887928  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599108657414-2017-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:31.907009  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:31.908154  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:31.909561  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:31.911932  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:31.912160  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:31.912417  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:31.912592  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:31.951560  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.67:38627
I20260709 12:16:31.951709 10547 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.67:38627 every 8 connection(s)
I20260709 12:16:31.965458 10548 heartbeater.cc:344] Connected to a master server at 127.1.248.126:38283
I20260709 12:16:31.965945 10548 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:31.966717 10548 heartbeater.cc:507] Master 127.1.248.126:38283 requested a full tablet report, sending...
I20260709 12:16:31.968636 10272 ts_manager.cc:194] Registered new tserver with Master: 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:31.969533  2017 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014744063s
I20260709 12:16:31.970042 10272 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34380
I20260709 12:16:31.993904 10272 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34390:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:31.996496 10272 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:32.062386 10364 tablet_service.cc:1511] Processing CreateTablet for tablet 50da356720e64811bf28f97fccb37476 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:32.064895 10363 tablet_service.cc:1511] Processing CreateTablet for tablet 11baa72ed6a64d1f9ab1ee8f5f29e574 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:32.067627 10362 tablet_service.cc:1511] Processing CreateTablet for tablet a95dabc712c5492f8bf78e2b9815abcb (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:32.070348 10361 tablet_service.cc:1511] Processing CreateTablet for tablet 835e250034f84f2bbc21be0bc3719256 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:32.072962 10360 tablet_service.cc:1511] Processing CreateTablet for tablet 87b3ea2ebbe24f64814fbbba1bf09cfd (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:32.075251 10364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50da356720e64811bf28f97fccb37476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.078078 10359 tablet_service.cc:1511] Processing CreateTablet for tablet 036301d981ab4f54baaec35aaa421934 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:32.083076 10361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835e250034f84f2bbc21be0bc3719256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.083225 10358 tablet_service.cc:1511] Processing CreateTablet for tablet ddfcc3ae5546483b9d7bbc62da36e533 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:32.104352 10358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddfcc3ae5546483b9d7bbc62da36e533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.104208 10435 tablet_service.cc:1511] Processing CreateTablet for tablet 87b3ea2ebbe24f64814fbbba1bf09cfd (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:32.105086 10360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87b3ea2ebbe24f64814fbbba1bf09cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.105571 10435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87b3ea2ebbe24f64814fbbba1bf09cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.104385 10505 tablet_service.cc:1511] Processing CreateTablet for tablet 2eed7f33591243b481c4e67e9fb1f099 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:32.106797 10505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eed7f33591243b481c4e67e9fb1f099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.088162 10508 tablet_service.cc:1511] Processing CreateTablet for tablet 036301d981ab4f54baaec35aaa421934 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:32.107836 10363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11baa72ed6a64d1f9ab1ee8f5f29e574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.108261 10508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036301d981ab4f54baaec35aaa421934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.111387 10359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036301d981ab4f54baaec35aaa421934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.088451 10512 tablet_service.cc:1511] Processing CreateTablet for tablet 11baa72ed6a64d1f9ab1ee8f5f29e574 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:32.116326 10512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11baa72ed6a64d1f9ab1ee8f5f29e574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.090504 10511 tablet_service.cc:1511] Processing CreateTablet for tablet a95dabc712c5492f8bf78e2b9815abcb (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:32.091656 10357 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0a12c537a741a99c8330569ae05c49 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:32.092247 10510 tablet_service.cc:1511] Processing CreateTablet for tablet 835e250034f84f2bbc21be0bc3719256 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:32.120344 10511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95dabc712c5492f8bf78e2b9815abcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.093842 10509 tablet_service.cc:1511] Processing CreateTablet for tablet 87b3ea2ebbe24f64814fbbba1bf09cfd (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:32.121546 10509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87b3ea2ebbe24f64814fbbba1bf09cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.095371 10513 tablet_service.cc:1511] Processing CreateTablet for tablet 50da356720e64811bf28f97fccb37476 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:32.124343 10513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50da356720e64811bf28f97fccb37476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.097119 10356 tablet_service.cc:1511] Processing CreateTablet for tablet 2eed7f33591243b481c4e67e9fb1f099 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:32.095938 10439 tablet_service.cc:1511] Processing CreateTablet for tablet 50da356720e64811bf28f97fccb37476 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:32.098428 10438 tablet_service.cc:1511] Processing CreateTablet for tablet 11baa72ed6a64d1f9ab1ee8f5f29e574 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:32.099951 10437 tablet_service.cc:1511] Processing CreateTablet for tablet a95dabc712c5492f8bf78e2b9815abcb (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:32.100021 10507 tablet_service.cc:1511] Processing CreateTablet for tablet ddfcc3ae5546483b9d7bbc62da36e533 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:32.126587 10510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835e250034f84f2bbc21be0bc3719256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.101841 10506 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0a12c537a741a99c8330569ae05c49 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:32.127399 10507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddfcc3ae5546483b9d7bbc62da36e533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.128239 10506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0a12c537a741a99c8330569ae05c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.129882 10439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50da356720e64811bf28f97fccb37476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.131685 10437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95dabc712c5492f8bf78e2b9815abcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.102337 10436 tablet_service.cc:1511] Processing CreateTablet for tablet 835e250034f84f2bbc21be0bc3719256 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:32.133684 10436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835e250034f84f2bbc21be0bc3719256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.135450 10438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11baa72ed6a64d1f9ab1ee8f5f29e574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.119833 10362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95dabc712c5492f8bf78e2b9815abcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.146615 10357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0a12c537a741a99c8330569ae05c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.148097 10356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eed7f33591243b481c4e67e9fb1f099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.151298 10434 tablet_service.cc:1511] Processing CreateTablet for tablet 036301d981ab4f54baaec35aaa421934 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:32.153152 10434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036301d981ab4f54baaec35aaa421934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.182753 10433 tablet_service.cc:1511] Processing CreateTablet for tablet ddfcc3ae5546483b9d7bbc62da36e533 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:32.184275 10433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddfcc3ae5546483b9d7bbc62da36e533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.197331 10432 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0a12c537a741a99c8330569ae05c49 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:32.198760 10432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0a12c537a741a99c8330569ae05c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.205540 10431 tablet_service.cc:1511] Processing CreateTablet for tablet 2eed7f33591243b481c4e67e9fb1f099 (DEFAULT_TABLE table=test-workload [id=f6de862f6e764e839bd6002058b95b02]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:32.207018 10431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eed7f33591243b481c4e67e9fb1f099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.254208 10563 tablet_bootstrap.cc:492] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:32.294395 10563 tablet_bootstrap.cc:654] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.334345 10564 tablet_bootstrap.cc:492] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:32.340517 10565 tablet_bootstrap.cc:492] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:32.345600 10563 tablet_bootstrap.cc:492] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:32.346130 10564 tablet_bootstrap.cc:654] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.346195 10563 ts_tablet_manager.cc:1403] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.092s	user 0.020s	sys 0.014s
I20260709 12:16:32.347525 10565 tablet_bootstrap.cc:654] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.349500 10563 raft_consensus.cc:359] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } }
I20260709 12:16:32.350438 10563 raft_consensus.cc:385] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.350826 10564 tablet_bootstrap.cc:492] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:32.350874 10563 raft_consensus.cc:740] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.351545 10564 ts_tablet_manager.cc:1403] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 12:16:32.351987 10563 consensus_queue.cc:260] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } }
I20260709 12:16:32.352993 10565 tablet_bootstrap.cc:492] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:32.353591 10565 ts_tablet_manager.cc:1403] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:16:32.353896 10564 raft_consensus.cc:359] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.354571 10399 heartbeater.cc:499] Master 127.1.248.126:38283 was elected leader, sending a full tablet report...
I20260709 12:16:32.354676 10564 raft_consensus.cc:385] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.355002 10563 ts_tablet_manager.cc:1434] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:32.355088 10564 raft_consensus.cc:740] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.356206 10563 tablet_bootstrap.cc:492] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:32.356072 10564 consensus_queue.cc:260] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.359745 10474 heartbeater.cc:499] Master 127.1.248.126:38283 was elected leader, sending a full tablet report...
I20260709 12:16:32.360296 10564 ts_tablet_manager.cc:1434] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:32.361307 10564 tablet_bootstrap.cc:492] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:32.362411 10563 tablet_bootstrap.cc:654] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.367908 10563 tablet_bootstrap.cc:492] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:32.368414 10563 ts_tablet_manager.cc:1403] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:16:32.370280 10564 tablet_bootstrap.cc:654] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.370110 10565 raft_consensus.cc:359] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.371075 10565 raft_consensus.cc:385] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.371505 10565 raft_consensus.cc:740] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.371411 10563 raft_consensus.cc:359] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.372403 10563 raft_consensus.cc:385] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.372751 10563 raft_consensus.cc:740] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.372641 10565 consensus_queue.cc:260] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.373911 10563 consensus_queue.cc:260] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.376570 10563 ts_tablet_manager.cc:1434] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:32.377595 10563 tablet_bootstrap.cc:492] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:32.383893 10563 tablet_bootstrap.cc:654] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.390573 10548 heartbeater.cc:499] Master 127.1.248.126:38283 was elected leader, sending a full tablet report...
I20260709 12:16:32.391551 10565 ts_tablet_manager.cc:1434] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.013s
I20260709 12:16:32.392702 10565 tablet_bootstrap.cc:492] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:32.395372 10564 tablet_bootstrap.cc:492] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:32.396021 10564 ts_tablet_manager.cc:1403] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.008s
I20260709 12:16:32.398940 10565 tablet_bootstrap.cc:654] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.399685 10564 raft_consensus.cc:359] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.400548 10564 raft_consensus.cc:385] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.400895 10564 raft_consensus.cc:740] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.404186 10565 tablet_bootstrap.cc:492] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:32.404686 10563 tablet_bootstrap.cc:492] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:32.404752 10565 ts_tablet_manager.cc:1403] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.005s
I20260709 12:16:32.405356 10563 ts_tablet_manager.cc:1403] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 12:16:32.407856 10564 consensus_queue.cc:260] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.408032 10565 raft_consensus.cc:359] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.408262 10563 raft_consensus.cc:359] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.409006 10563 raft_consensus.cc:385] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.409318 10563 raft_consensus.cc:740] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.410517 10564 ts_tablet_manager.cc:1434] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:16:32.410182 10563 consensus_queue.cc:260] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.408896 10565 raft_consensus.cc:385] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.411631 10565 raft_consensus.cc:740] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.411767 10564 tablet_bootstrap.cc:492] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:32.412622 10565 consensus_queue.cc:260] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.414784 10565 ts_tablet_manager.cc:1434] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:16:32.415848 10565 tablet_bootstrap.cc:492] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:32.419575 10564 tablet_bootstrap.cc:654] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.421937 10565 tablet_bootstrap.cc:654] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.430131 10563 ts_tablet_manager.cc:1434] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 12:16:32.432165 10563 tablet_bootstrap.cc:492] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:32.434522 10565 tablet_bootstrap.cc:492] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:32.436511 10565 ts_tablet_manager.cc:1403] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.010s
I20260709 12:16:32.438374 10564 tablet_bootstrap.cc:492] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:32.438823 10563 tablet_bootstrap.cc:654] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.438902 10564 ts_tablet_manager.cc:1403] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.009s
I20260709 12:16:32.439479 10565 raft_consensus.cc:359] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.440234 10565 raft_consensus.cc:385] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.440537 10565 raft_consensus.cc:740] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.441326 10565 consensus_queue.cc:260] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.442000 10564 raft_consensus.cc:359] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.442755 10564 raft_consensus.cc:385] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.443049 10564 raft_consensus.cc:740] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.443738 10565 ts_tablet_manager.cc:1434] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:16:32.443961 10564 consensus_queue.cc:260] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.444823 10565 tablet_bootstrap.cc:492] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:32.445323 10563 tablet_bootstrap.cc:492] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:32.445927 10563 ts_tablet_manager.cc:1403] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 12:16:32.446213 10564 ts_tablet_manager.cc:1434] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:16:32.447214 10564 tablet_bootstrap.cc:492] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:32.449436 10563 raft_consensus.cc:359] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.450277 10563 raft_consensus.cc:385] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.450632 10563 raft_consensus.cc:740] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.451668 10565 tablet_bootstrap.cc:654] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.451526 10563 consensus_queue.cc:260] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.451699 10573 raft_consensus.cc:493] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.453701 10564 tablet_bootstrap.cc:654] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.453451 10573 raft_consensus.cc:515] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.463372 10563 ts_tablet_manager.cc:1434] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:16:32.464850 10563 tablet_bootstrap.cc:492] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:32.471944 10563 tablet_bootstrap.cc:654] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.484269 10374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11baa72ed6a64d1f9ab1ee8f5f29e574" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:32.485335 10374 raft_consensus.cc:2468] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 0.
I20260709 12:16:32.488095 10569 raft_consensus.cc:493] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.488852 10569 raft_consensus.cc:515] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } }
I20260709 12:16:32.492240 10486 leader_election.cc:304] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:32.504084 10573 leader_election.cc:290] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:32.504954 10573 raft_consensus.cc:2804] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.505439 10573 raft_consensus.cc:493] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.505950 10573 raft_consensus.cc:3060] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.521057 10569 leader_election.cc:290] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
W20260709 12:16:32.522370 10320 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:32.546942 10570 raft_consensus.cc:493] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.547943 10570 raft_consensus.cc:515] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.553678 10570 leader_election.cc:290] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:32.572570 10582 raft_consensus.cc:493] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.573462 10582 raft_consensus.cc:515] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
W20260709 12:16:32.591053 10486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.248.65:42929, user_credentials={real_user=slave}} blocked reactor thread for 99099.9us
I20260709 12:16:32.619500 10523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50da356720e64811bf28f97fccb37476" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
W20260709 12:16:32.621812 10338 leader_election.cc:343] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.622790 10569 raft_consensus.cc:493] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.623306 10569 raft_consensus.cc:515] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.626590 10569 leader_election.cc:290] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:32.638185 10570 raft_consensus.cc:493] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.638953 10570 raft_consensus.cc:515] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.641729 10570 leader_election.cc:290] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:32.646345 10523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835e250034f84f2bbc21be0bc3719256" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
W20260709 12:16:32.648329 10338 leader_election.cc:343] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.649752 10590 raft_consensus.cc:493] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.650379 10582 leader_election.cc:290] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:32.650482 10590 raft_consensus.cc:515] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.650835 10570 raft_consensus.cc:493] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.651664 10570 raft_consensus.cc:515] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.653733 10570 leader_election.cc:290] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:32.655700 10590 leader_election.cc:290] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:32.663370 10374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dabc712c5492f8bf78e2b9815abcb" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:32.666482 10374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eed7f33591243b481c4e67e9fb1f099" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
W20260709 12:16:32.668411 10486 leader_election.cc:343] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:32.669349 10486 leader_election.cc:343] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.675699 10573 raft_consensus.cc:515] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.679723 10374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11baa72ed6a64d1f9ab1ee8f5f29e574" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:32.680547 10374 raft_consensus.cc:3060] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.696287 10449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11baa72ed6a64d1f9ab1ee8f5f29e574" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:32.698129 10565 tablet_bootstrap.cc:492] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:32.698031 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dabc712c5492f8bf78e2b9815abcb" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:32.698766 10565 ts_tablet_manager.cc:1403] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.254s	user 0.092s	sys 0.154s
I20260709 12:16:32.699697 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eed7f33591243b481c4e67e9fb1f099" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:32.700205 10564 tablet_bootstrap.cc:492] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:32.700426 10447 raft_consensus.cc:2468] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 0.
I20260709 12:16:32.700760 10564 ts_tablet_manager.cc:1403] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.254s	user 0.106s	sys 0.140s
W20260709 12:16:32.698091 10489 leader_election.cc:343] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.701898 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50da356720e64811bf28f97fccb37476" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:32.701997 10565 raft_consensus.cc:359] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
W20260709 12:16:32.702474 10489 leader_election.cc:343] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.702836 10565 raft_consensus.cc:385] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.702919 10489 leader_election.cc:304] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969; no voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b
I20260709 12:16:32.703275 10565 raft_consensus.cc:740] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
W20260709 12:16:32.703562 10340 leader_election.cc:343] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.704083 10590 raft_consensus.cc:2749] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.704463 10564 raft_consensus.cc:359] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.704886 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835e250034f84f2bbc21be0bc3719256" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:32.705300 10564 raft_consensus.cc:385] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.705395 10489 leader_election.cc:304] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 021c49ecd5974a54a3b690aa43e71f69
I20260709 12:16:32.705641 10564 raft_consensus.cc:740] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.704051 10340 leader_election.cc:304] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69; no voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b
I20260709 12:16:32.706147 10563 tablet_bootstrap.cc:492] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:32.706447 10590 raft_consensus.cc:2804] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.706831 10563 ts_tablet_manager.cc:1403] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.242s	user 0.085s	sys 0.099s
I20260709 12:16:32.706723 10564 consensus_queue.cc:260] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.707453 10569 raft_consensus.cc:2749] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.706890 10590 raft_consensus.cc:493] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.708084 10590 raft_consensus.cc:3060] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:32.707101 10340 leader_election.cc:343] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.708582 10340 leader_election.cc:304] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69; no voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b
I20260709 12:16:32.709349 10569 raft_consensus.cc:2749] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.712878 10563 raft_consensus.cc:359] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.713630 10563 raft_consensus.cc:385] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.713963 10563 raft_consensus.cc:740] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.704098 10565 consensus_queue.cc:260] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.714696 10563 consensus_queue.cc:260] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.716226 10590 raft_consensus.cc:515] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.716777 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eed7f33591243b481c4e67e9fb1f099" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:32.718254 10372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87b3ea2ebbe24f64814fbbba1bf09cfd" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:32.718817 10590 leader_election.cc:290] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:32.718941 10372 raft_consensus.cc:2468] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 0.
I20260709 12:16:32.720162 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:32.720523 10565 ts_tablet_manager.cc:1434] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:16:32.721655 10565 tablet_bootstrap.cc:492] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:32.722420 10573 leader_election.cc:290] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:32.722744 10523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eed7f33591243b481c4e67e9fb1f099" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:32.723639 10523 raft_consensus.cc:2393] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f70ed38144548d197978cda555dc43b in current term 1: Already voted for candidate 173593b73f1d4418957c253a8bfcb969 in this term.
I20260709 12:16:32.724123 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:32.723641 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87b3ea2ebbe24f64814fbbba1bf09cfd" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:32.724939 10563 ts_tablet_manager.cc:1434] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:16:32.721565 10374 raft_consensus.cc:2468] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
W20260709 12:16:32.726577 10412 leader_election.cc:343] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.727092 10563 tablet_bootstrap.cc:492] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:32.727280 10486 leader_election.cc:304] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:32.727706 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eed7f33591243b481c4e67e9fb1f099" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:32.728226 10573 raft_consensus.cc:2804] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.728104 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11baa72ed6a64d1f9ab1ee8f5f29e574" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:32.728760 10573 raft_consensus.cc:697] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Leader. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:32.727324 10412 leader_election.cc:304] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:32.729643 10573 consensus_queue.cc:237] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
W20260709 12:16:32.730225 10412 leader_election.cc:343] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.730626 10413 leader_election.cc:304] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f70ed38144548d197978cda555dc43b; no voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969
I20260709 12:16:32.730914 10570 raft_consensus.cc:2804] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.731415 10570 raft_consensus.cc:493] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:32.731786 10489 leader_election.cc:343] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.732172 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eed7f33591243b481c4e67e9fb1f099" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:32.731791 10570 raft_consensus.cc:3060] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.732774 10447 raft_consensus.cc:3060] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.734421 10563 tablet_bootstrap.cc:654] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:32.736157 10486 leader_election.cc:343] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.740269 10565 tablet_bootstrap.cc:654] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.741891 10447 raft_consensus.cc:2468] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
I20260709 12:16:32.742861 10592 raft_consensus.cc:2749] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:32.742959 10413 leader_election.cc:343] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.743638 10413 leader_election.cc:304] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f70ed38144548d197978cda555dc43b; no voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969
I20260709 12:16:32.745481 10564 ts_tablet_manager.cc:1434] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:16:32.743629 10570 raft_consensus.cc:515] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.752655 10570 leader_election.cc:290] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:32.753397 10570 raft_consensus.cc:2749] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.759667 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87b3ea2ebbe24f64814fbbba1bf09cfd" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:32.761269 10373 raft_consensus.cc:3060] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.762171 10564 tablet_bootstrap.cc:492] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:32.759667 10565 tablet_bootstrap.cc:492] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:32.768842 10565 ts_tablet_manager.cc:1403] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.007s
I20260709 12:16:32.773972 10564 tablet_bootstrap.cc:654] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.774752 10565 raft_consensus.cc:359] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.775564 10565 raft_consensus.cc:385] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.775872 10565 raft_consensus.cc:740] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
W20260709 12:16:32.777433 10413 leader_election.cc:343] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.776660 10565 consensus_queue.cc:260] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.778896 10489 leader_election.cc:304] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 021c49ecd5974a54a3b690aa43e71f69
I20260709 12:16:32.779660 10565 ts_tablet_manager.cc:1434] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:16:32.779973 10563 tablet_bootstrap.cc:492] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:32.780453 10573 raft_consensus.cc:2804] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.780575 10563 ts_tablet_manager.cc:1403] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.014s
I20260709 12:16:32.781029 10573 raft_consensus.cc:697] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Leader. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:32.781175 10565 tablet_bootstrap.cc:492] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:32.781945 10573 consensus_queue.cc:237] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.784220 10563 raft_consensus.cc:359] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.785117 10563 raft_consensus.cc:385] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.785673 10563 raft_consensus.cc:740] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.784883 10269 catalog_manager.cc:5697] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173593b73f1d4418957c253a8bfcb969 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "173593b73f1d4418957c253a8bfcb969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:32.786645 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87b3ea2ebbe24f64814fbbba1bf09cfd" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:32.786659 10563 consensus_queue.cc:260] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.787196 10373 raft_consensus.cc:2468] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 1.
W20260709 12:16:32.788973 10413 leader_election.cc:343] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.793151 10412 leader_election.cc:304] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 173593b73f1d4418957c253a8bfcb969
I20260709 12:16:32.794314 10594 raft_consensus.cc:2804] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.794937 10594 raft_consensus.cc:697] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Becoming Leader. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:32.796208 10594 consensus_queue.cc:237] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.799697 10590 raft_consensus.cc:493] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.796175 10565 tablet_bootstrap.cc:654] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.800428 10590 raft_consensus.cc:515] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.803857 10563 ts_tablet_manager.cc:1434] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:16:32.805464 10563 tablet_bootstrap.cc:492] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:32.811690 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036301d981ab4f54baaec35aaa421934" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:32.812651 10373 raft_consensus.cc:2468] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 0.
I20260709 12:16:32.813871 10590 leader_election.cc:290] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:32.814179 10486 leader_election.cc:304] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:32.815155 10590 raft_consensus.cc:2804] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.815564 10590 raft_consensus.cc:493] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.815919 10590 raft_consensus.cc:3060] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.815848 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036301d981ab4f54baaec35aaa421934" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:32.817528 10563 tablet_bootstrap.cc:654] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.818475 10564 tablet_bootstrap.cc:492] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:32.819020 10564 ts_tablet_manager.cc:1403] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.002s
W20260709 12:16:32.822098 10489 leader_election.cc:343] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:32.810917 10271 catalog_manager.cc:5697] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f70ed38144548d197978cda555dc43b (127.1.248.66). New cstate: current_term: 1 leader_uuid: "5f70ed38144548d197978cda555dc43b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:32.825632 10590 raft_consensus.cc:515] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.829833 10564 raft_consensus.cc:359] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.830662 10564 raft_consensus.cc:385] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.830993 10564 raft_consensus.cc:740] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.831830 10564 consensus_queue.cc:260] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.833019 10590 leader_election.cc:290] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:32.833911 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036301d981ab4f54baaec35aaa421934" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:32.834129 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036301d981ab4f54baaec35aaa421934" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:32.834414 10564 ts_tablet_manager.cc:1434] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:16:32.834741 10373 raft_consensus.cc:3060] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.835462 10564 tablet_bootstrap.cc:492] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:32.838984 10563 tablet_bootstrap.cc:492] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:32.834775 10447 raft_consensus.cc:3060] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.839576 10563 ts_tablet_manager.cc:1403] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.004s
I20260709 12:16:32.841673 10564 tablet_bootstrap.cc:654] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.842792 10563 raft_consensus.cc:359] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.843626 10563 raft_consensus.cc:385] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.843796 10373 raft_consensus.cc:2468] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
I20260709 12:16:32.844170 10563 raft_consensus.cc:740] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.845278 10563 consensus_queue.cc:260] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.845538 10486 leader_election.cc:304] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:32.846802 10590 raft_consensus.cc:2804] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:32.847292 10590 raft_consensus.cc:697] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Leader. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:32.847968 10563 ts_tablet_manager.cc:1434] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:16:32.848160 10590 consensus_queue.cc:237] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.849071 10563 tablet_bootstrap.cc:492] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:32.850597 10565 tablet_bootstrap.cc:492] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:32.851333 10565 ts_tablet_manager.cc:1403] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.001s
I20260709 12:16:32.862495 10447 raft_consensus.cc:2468] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
I20260709 12:16:32.864197 10563 tablet_bootstrap.cc:654] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.867755 10565 raft_consensus.cc:359] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.868605 10565 raft_consensus.cc:385] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.868924 10565 raft_consensus.cc:740] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.869712 10565 consensus_queue.cc:260] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.872159 10565 ts_tablet_manager.cc:1434] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:16:32.873221 10565 tablet_bootstrap.cc:492] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:32.874365 10270 catalog_manager.cc:5697] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173593b73f1d4418957c253a8bfcb969 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "173593b73f1d4418957c253a8bfcb969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:32.876044 10270 catalog_manager.cc:5697] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173593b73f1d4418957c253a8bfcb969 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "173593b73f1d4418957c253a8bfcb969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:32.876801 10563 tablet_bootstrap.cc:492] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:32.877491 10563 ts_tablet_manager.cc:1403] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.012s
I20260709 12:16:32.879928 10565 tablet_bootstrap.cc:654] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.880776 10564 tablet_bootstrap.cc:492] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:32.880550 10563 raft_consensus.cc:359] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.881369 10564 ts_tablet_manager.cc:1403] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.016s
I20260709 12:16:32.881381 10563 raft_consensus.cc:385] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.881968 10563 raft_consensus.cc:740] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.882748 10563 consensus_queue.cc:260] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.885120 10563 ts_tablet_manager.cc:1434] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:32.886071 10563 tablet_bootstrap.cc:492] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:32.885466 10564 raft_consensus.cc:359] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.886570 10564 raft_consensus.cc:385] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.886981 10564 raft_consensus.cc:740] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.890971 10564 consensus_queue.cc:260] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.893345 10564 ts_tablet_manager.cc:1434] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:16:32.894062 10563 tablet_bootstrap.cc:654] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.894517 10564 tablet_bootstrap.cc:492] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:32.903621 10565 tablet_bootstrap.cc:492] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:32.904273 10565 ts_tablet_manager.cc:1403] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.006s
I20260709 12:16:32.905603 10569 raft_consensus.cc:493] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.906284 10569 raft_consensus.cc:515] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.907320 10565 raft_consensus.cc:359] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } }
I20260709 12:16:32.908174 10565 raft_consensus.cc:385] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.908463 10565 raft_consensus.cc:740] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.909360 10565 consensus_queue.cc:260] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } }
I20260709 12:16:32.910384 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eed7f33591243b481c4e67e9fb1f099" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:32.911257 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eed7f33591243b481c4e67e9fb1f099" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:32.912094 10565 ts_tablet_manager.cc:1434] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:16:32.912163 10447 raft_consensus.cc:2393] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 021c49ecd5974a54a3b690aa43e71f69 in current term 1: Already voted for candidate 173593b73f1d4418957c253a8bfcb969 in this term.
I20260709 12:16:32.912587 10569 leader_election.cc:290] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:32.903610 10564 tablet_bootstrap.cc:654] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.913653 10340 leader_election.cc:304] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69; no voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b
I20260709 12:16:32.914346 10563 tablet_bootstrap.cc:492] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:32.914844 10569 raft_consensus.cc:3060] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:32.915681 10565 tablet_bootstrap.cc:492] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:32.914851 10563 ts_tablet_manager.cc:1403] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.010s
I20260709 12:16:32.922891 10565 tablet_bootstrap.cc:654] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.926530 10569 raft_consensus.cc:2749] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:32.930668 10563 raft_consensus.cc:359] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.931248 10563 raft_consensus.cc:385] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.931550 10563 raft_consensus.cc:740] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.931885 10565 tablet_bootstrap.cc:492] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:32.932384 10565 ts_tablet_manager.cc:1403] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:16:32.932716 10564 tablet_bootstrap.cc:492] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:32.932341 10563 consensus_queue.cc:260] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.933243 10564 ts_tablet_manager.cc:1403] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.010s
I20260709 12:16:32.934612 10563 ts_tablet_manager.cc:1434] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:32.935493 10565 raft_consensus.cc:359] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.936254 10565 raft_consensus.cc:385] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.936139 10564 raft_consensus.cc:359] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.936707 10565 raft_consensus.cc:740] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.936986 10564 raft_consensus.cc:385] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.937343 10564 raft_consensus.cc:740] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.937455 10565 consensus_queue.cc:260] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.938125 10564 consensus_queue.cc:260] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.940335 10565 ts_tablet_manager.cc:1434] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:32.941284 10565 tablet_bootstrap.cc:492] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:32.944495 10564 ts_tablet_manager.cc:1434] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:16:32.946149 10564 tablet_bootstrap.cc:492] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:32.953871 10565 tablet_bootstrap.cc:654] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.954525 10564 tablet_bootstrap.cc:654] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.958877 10565 tablet_bootstrap.cc:492] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:32.959252 10564 tablet_bootstrap.cc:492] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:32.959329 10565 ts_tablet_manager.cc:1403] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:16:32.959954 10564 ts_tablet_manager.cc:1403] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.014s	user 0.002s	sys 0.009s
I20260709 12:16:32.962410 10565 raft_consensus.cc:359] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.962612 10564 raft_consensus.cc:359] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } }
I20260709 12:16:32.963085 10565 raft_consensus.cc:385] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.963236 10564 raft_consensus.cc:385] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.963402 10565 raft_consensus.cc:740] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.963624 10564 raft_consensus.cc:740] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.964172 10565 consensus_queue.cc:260] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.964319 10564 consensus_queue.cc:260] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } }
I20260709 12:16:32.966193 10565 ts_tablet_manager.cc:1434] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:16:32.966420 10564 ts_tablet_manager.cc:1434] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:32.967196 10564 tablet_bootstrap.cc:492] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:32.972195 10564 tablet_bootstrap.cc:654] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.976963 10564 tablet_bootstrap.cc:492] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:32.977442 10564 ts_tablet_manager.cc:1403] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:16:32.979725 10564 raft_consensus.cc:359] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.980165 10564 raft_consensus.cc:385] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.980336 10564 raft_consensus.cc:740] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.980846 10564 consensus_queue.cc:260] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.982195 10564 ts_tablet_manager.cc:1434] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:32.992348 10590 raft_consensus.cc:493] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.992857 10590 raft_consensus.cc:515] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:32.994794 10590 leader_election.cc:290] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:32.995368 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835e250034f84f2bbc21be0bc3719256" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:32.995764 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835e250034f84f2bbc21be0bc3719256" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:32.996016 10373 raft_consensus.cc:2468] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 0.
I20260709 12:16:32.996369 10447 raft_consensus.cc:2468] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 0.
I20260709 12:16:32.997114 10486 leader_election.cc:304] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:32.997953 10590 raft_consensus.cc:2804] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:32.998216 10590 raft_consensus.cc:493] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.998468 10590 raft_consensus.cc:3060] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.003396 10590 raft_consensus.cc:515] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.004881 10590 leader_election.cc:290] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:33.005630 10594 raft_consensus.cc:493] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.005733 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835e250034f84f2bbc21be0bc3719256" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:33.005955 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835e250034f84f2bbc21be0bc3719256" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:33.006418 10373 raft_consensus.cc:3060] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.006584 10447 raft_consensus.cc:3060] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.006312 10594 raft_consensus.cc:515] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.008628 10594 leader_election.cc:290] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:33.009349 10374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfcc3ae5546483b9d7bbc62da36e533" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:33.010025 10374 raft_consensus.cc:2468] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 0.
I20260709 12:16:33.010239 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfcc3ae5546483b9d7bbc62da36e533" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:33.010876 10522 raft_consensus.cc:2468] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 0.
I20260709 12:16:33.011348 10412 leader_election.cc:304] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:33.012343 10594 raft_consensus.cc:2804] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.012749 10594 raft_consensus.cc:493] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.013037 10594 raft_consensus.cc:3060] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.014111 10373 raft_consensus.cc:2468] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
I20260709 12:16:33.014709 10447 raft_consensus.cc:2468] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
I20260709 12:16:33.015367 10486 leader_election.cc:304] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:33.016301 10590 raft_consensus.cc:2804] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.017009 10590 raft_consensus.cc:697] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Leader. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:33.017863 10590 consensus_queue.cc:237] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.020188 10594 raft_consensus.cc:515] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.022531 10594 leader_election.cc:290] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:33.023742 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfcc3ae5546483b9d7bbc62da36e533" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:33.024071 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfcc3ae5546483b9d7bbc62da36e533" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:33.024401 10373 raft_consensus.cc:3060] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.024663 10522 raft_consensus.cc:3060] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.026496 10271 catalog_manager.cc:5697] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173593b73f1d4418957c253a8bfcb969 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "173593b73f1d4418957c253a8bfcb969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:33.032114 10373 raft_consensus.cc:2468] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 1.
I20260709 12:16:33.032114 10522 raft_consensus.cc:2468] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 1.
I20260709 12:16:33.033649 10413 leader_election.cc:304] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:33.034610 10594 raft_consensus.cc:2804] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.035122 10594 raft_consensus.cc:697] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Becoming Leader. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:33.036027 10594 consensus_queue.cc:237] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.043350 10271 catalog_manager.cc:5697] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f70ed38144548d197978cda555dc43b (127.1.248.66). New cstate: current_term: 1 leader_uuid: "5f70ed38144548d197978cda555dc43b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.091486 10590 raft_consensus.cc:493] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.092092 10590 raft_consensus.cc:515] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } }
I20260709 12:16:33.094058 10590 leader_election.cc:290] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:33.094928 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50da356720e64811bf28f97fccb37476" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:33.095069 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50da356720e64811bf28f97fccb37476" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:33.095629 10373 raft_consensus.cc:2468] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 0.
I20260709 12:16:33.095726 10447 raft_consensus.cc:2468] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 0.
I20260709 12:16:33.096710 10486 leader_election.cc:304] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:33.097469 10590 raft_consensus.cc:2804] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.097733 10590 raft_consensus.cc:493] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.097956 10590 raft_consensus.cc:3060] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.103509 10590 raft_consensus.cc:515] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } }
I20260709 12:16:33.105213 10590 leader_election.cc:290] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:33.106204 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50da356720e64811bf28f97fccb37476" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:33.106204 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50da356720e64811bf28f97fccb37476" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:33.107156 10447 raft_consensus.cc:3060] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.107177 10373 raft_consensus.cc:3060] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.114317 10594 raft_consensus.cc:493] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.115136 10373 raft_consensus.cc:2468] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
I20260709 12:16:33.115207 10594 raft_consensus.cc:515] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.115141 10447 raft_consensus.cc:2468] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
I20260709 12:16:33.116871 10486 leader_election.cc:304] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:33.117905 10590 raft_consensus.cc:2804] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.118520 10590 raft_consensus.cc:697] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Leader. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:33.119378 10590 consensus_queue.cc:237] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } }
I20260709 12:16:33.119679 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dabc712c5492f8bf78e2b9815abcb" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:33.119889 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dabc712c5492f8bf78e2b9815abcb" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:33.119947 10594 leader_election.cc:290] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:33.120500 10373 raft_consensus.cc:2468] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 0.
I20260709 12:16:33.120652 10522 raft_consensus.cc:2468] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 0.
I20260709 12:16:33.121838 10412 leader_election.cc:304] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:33.122807 10594 raft_consensus.cc:2804] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.123283 10594 raft_consensus.cc:493] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.123679 10594 raft_consensus.cc:3060] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.128216 10590 raft_consensus.cc:493] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.128796 10590 raft_consensus.cc:515] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.129034 10271 catalog_manager.cc:5697] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173593b73f1d4418957c253a8bfcb969 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "173593b73f1d4418957c253a8bfcb969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.131157 10590 leader_election.cc:290] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:33.131349 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87b3ea2ebbe24f64814fbbba1bf09cfd" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:33.132254 10373 raft_consensus.cc:2393] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 173593b73f1d4418957c253a8bfcb969 in current term 1: Already voted for candidate 5f70ed38144548d197978cda555dc43b in this term.
I20260709 12:16:33.132182 10594 raft_consensus.cc:515] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.132292 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87b3ea2ebbe24f64814fbbba1bf09cfd" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:33.133917 10489 leader_election.cc:304] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969; no voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b
I20260709 12:16:33.134729 10590 raft_consensus.cc:3060] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.135564 10594 leader_election.cc:290] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:33.135809 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dabc712c5492f8bf78e2b9815abcb" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:33.136504 10373 raft_consensus.cc:3060] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.137321 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dabc712c5492f8bf78e2b9815abcb" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:33.137936 10522 raft_consensus.cc:3060] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.141820 10590 raft_consensus.cc:2749] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.144160 10373 raft_consensus.cc:2468] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 1.
I20260709 12:16:33.145218 10522 raft_consensus.cc:2468] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 1.
I20260709 12:16:33.145397 10412 leader_election.cc:304] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:33.146272 10594 raft_consensus.cc:2804] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.146678 10594 raft_consensus.cc:697] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Becoming Leader. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:33.147496 10594 consensus_queue.cc:237] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.154291 10271 catalog_manager.cc:5697] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f70ed38144548d197978cda555dc43b (127.1.248.66). New cstate: current_term: 1 leader_uuid: "5f70ed38144548d197978cda555dc43b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.163596 10590 consensus_queue.cc:1048] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.175596 10582 consensus_queue.cc:1048] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.185273 10582 consensus_queue.cc:1048] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.195617 10447 raft_consensus.cc:3060] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.203943 10573 consensus_queue.cc:1048] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.212029 10569 raft_consensus.cc:493] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.212556 10569 raft_consensus.cc:515] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.214874 10569 leader_election.cc:290] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:33.215564 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:33.216218 10447 raft_consensus.cc:2468] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 0.
I20260709 12:16:33.216400 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:33.217088 10522 raft_consensus.cc:2468] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 0.
I20260709 12:16:33.217471 10340 leader_election.cc:304] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:33.218376 10569 raft_consensus.cc:2804] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.218698 10569 raft_consensus.cc:493] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.218976 10569 raft_consensus.cc:3060] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.224701 10569 raft_consensus.cc:515] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.226539 10569 leader_election.cc:290] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 election: Requested vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:33.227085 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:33.227653 10447 raft_consensus.cc:3060] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.227649 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:33.228327 10522 raft_consensus.cc:3060] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.233024 10447 raft_consensus.cc:2468] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 1.
I20260709 12:16:33.233235 10522 raft_consensus.cc:2468] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 1.
I20260709 12:16:33.234193 10340 leader_election.cc:304] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:33.234908 10569 raft_consensus.cc:2804] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.235884 10569 raft_consensus.cc:697] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Becoming Leader. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:33.236562 10569 consensus_queue.cc:237] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.244055 10271 catalog_manager.cc:5697] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "021c49ecd5974a54a3b690aa43e71f69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.263792 10573 consensus_queue.cc:1048] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.274215 10590 consensus_queue.cc:1048] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.339772 10594 consensus_queue.cc:1048] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.346539 10592 consensus_queue.cc:1048] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.426729 10590 consensus_queue.cc:1048] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.438580 10582 consensus_queue.cc:1048] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.455901 10522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50da356720e64811bf28f97fccb37476"
dest_uuid: "173593b73f1d4418957c253a8bfcb969"
mode: GRACEFUL
new_leader_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:41336
I20260709 12:16:33.456449 10522 raft_consensus.cc:606] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Received request to transfer leadership to TS 021c49ecd5974a54a3b690aa43e71f69
I20260709 12:16:33.461912 10522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11baa72ed6a64d1f9ab1ee8f5f29e574"
dest_uuid: "173593b73f1d4418957c253a8bfcb969"
mode: GRACEFUL
new_leader_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:41336
I20260709 12:16:33.462462 10522 raft_consensus.cc:606] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Received request to transfer leadership to TS 021c49ecd5974a54a3b690aa43e71f69
I20260709 12:16:33.476394 10447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a95dabc712c5492f8bf78e2b9815abcb"
dest_uuid: "5f70ed38144548d197978cda555dc43b"
mode: GRACEFUL
new_leader_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:43360
I20260709 12:16:33.476974 10447 raft_consensus.cc:606] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Received request to transfer leadership to TS 021c49ecd5974a54a3b690aa43e71f69
I20260709 12:16:33.482246 10522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "835e250034f84f2bbc21be0bc3719256"
dest_uuid: "173593b73f1d4418957c253a8bfcb969"
mode: GRACEFUL
new_leader_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:41336
I20260709 12:16:33.482787 10522 raft_consensus.cc:606] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Received request to transfer leadership to TS 021c49ecd5974a54a3b690aa43e71f69
I20260709 12:16:33.490442 10522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "036301d981ab4f54baaec35aaa421934"
dest_uuid: "173593b73f1d4418957c253a8bfcb969"
mode: GRACEFUL
new_leader_uuid: "5f70ed38144548d197978cda555dc43b"
 from {username='slave'} at 127.0.0.1:41336
I20260709 12:16:33.490962 10522 raft_consensus.cc:606] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Received request to transfer leadership to TS 5f70ed38144548d197978cda555dc43b
I20260709 12:16:33.506445 10374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49"
dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
mode: GRACEFUL
new_leader_uuid: "5f70ed38144548d197978cda555dc43b"
 from {username='slave'} at 127.0.0.1:41964
I20260709 12:16:33.507009 10374 raft_consensus.cc:606] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Received request to transfer leadership to TS 5f70ed38144548d197978cda555dc43b
I20260709 12:16:33.527563 10632 consensus_queue.cc:1048] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.541131 10631 consensus_queue.cc:1048] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.581801 10582 consensus_queue.cc:1048] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.593544 10573 consensus_queue.cc:1048] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.600389 10631 consensus_queue.cc:1048] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.601971 10643 raft_consensus.cc:993] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969: : Instructing follower 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:33.602494 10573 raft_consensus.cc:1081] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Signalling peer 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:33.603953 10374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50da356720e64811bf28f97fccb37476"
dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:53158
I20260709 12:16:33.604514 10374 raft_consensus.cc:493] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:33.604914 10374 raft_consensus.cc:3060] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.609760 10631 consensus_queue.cc:1048] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.613349 10374 raft_consensus.cc:515] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } }
I20260709 12:16:33.619109 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50da356720e64811bf28f97fccb37476" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:33.619730 10521 raft_consensus.cc:3055] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:33.620033 10521 raft_consensus.cc:740] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:33.620481 10374 leader_election.cc:290] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Requested vote from peers 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:33.620860 10521 consensus_queue.cc:260] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } }
I20260709 12:16:33.622282 10521 raft_consensus.cc:3060] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.624292 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50da356720e64811bf28f97fccb37476" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:33.624959 10447 raft_consensus.cc:3060] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.631063 10521 raft_consensus.cc:2468] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 2.
I20260709 12:16:33.632962 10338 leader_election.cc:304] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:33.633834 10569 raft_consensus.cc:2804] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:33.634399 10569 raft_consensus.cc:697] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Becoming Leader. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:33.634840 10447 raft_consensus.cc:2468] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 2.
I20260709 12:16:33.635293 10594 raft_consensus.cc:993] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b: : Instructing follower 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:33.635972 10594 raft_consensus.cc:1081] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Signalling peer 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:33.635243 10569 consensus_queue.cc:237] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } }
I20260709 12:16:33.637952 10374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a95dabc712c5492f8bf78e2b9815abcb"
dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:41954
I20260709 12:16:33.638582 10374 raft_consensus.cc:493] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:33.638970 10374 raft_consensus.cc:3060] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.645437 10271 catalog_manager.cc:5697] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 reported cstate change: term changed from 1 to 2, leader changed from 173593b73f1d4418957c253a8bfcb969 (127.1.248.67) to 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "021c49ecd5974a54a3b690aa43e71f69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.646061 10374 raft_consensus.cc:515] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.647333 10373 raft_consensus.cc:1240] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Rejecting Update request from peer 5f70ed38144548d197978cda555dc43b for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:33.649106 10374 leader_election.cc:290] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Requested vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:33.649417 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dabc712c5492f8bf78e2b9815abcb" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:33.650061 10447 raft_consensus.cc:3055] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:33.650388 10447 raft_consensus.cc:740] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:33.651225 10447 consensus_queue.cc:260] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.651252 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dabc712c5492f8bf78e2b9815abcb" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:33.652534 10447 raft_consensus.cc:3060] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.652966 10521 raft_consensus.cc:3060] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.658492 10521 raft_consensus.cc:2468] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 2.
I20260709 12:16:33.659034 10447 raft_consensus.cc:2468] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 2.
I20260709 12:16:33.659689 10338 leader_election.cc:304] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:33.660615 10569 raft_consensus.cc:2804] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:33.661048 10569 raft_consensus.cc:697] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Becoming Leader. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:33.661813 10569 consensus_queue.cc:237] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.668362 10271 catalog_manager.cc:5697] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 reported cstate change: term changed from 1 to 2, leader changed from 5f70ed38144548d197978cda555dc43b (127.1.248.66) to 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "021c49ecd5974a54a3b690aa43e71f69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.729681 10569 consensus_queue.cc:1048] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.737326 10626 raft_consensus.cc:993] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69: : Instructing follower 5f70ed38144548d197978cda555dc43b to start an election
I20260709 12:16:33.738054 10569 raft_consensus.cc:1081] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Signalling peer 5f70ed38144548d197978cda555dc43b to start an election
I20260709 12:16:33.739912 10448 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49"
dest_uuid: "5f70ed38144548d197978cda555dc43b"
 from {username='slave'} at 127.0.0.1:54552
I20260709 12:16:33.741068 10448 raft_consensus.cc:493] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:33.741483 10448 raft_consensus.cc:3060] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.745105 10569 consensus_queue.cc:1048] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:33.748870 10448 raft_consensus.cc:515] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.756925 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:33.757217 10573 raft_consensus.cc:993] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969: : Instructing follower 5f70ed38144548d197978cda555dc43b to start an election
I20260709 12:16:33.757586 10373 raft_consensus.cc:3055] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:33.757788 10573 raft_consensus.cc:1081] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Signalling peer 5f70ed38144548d197978cda555dc43b to start an election
I20260709 12:16:33.757943 10373 raft_consensus.cc:740] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:33.758986 10448 leader_election.cc:290] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 2 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:33.758903 10373 consensus_queue.cc:260] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.759467 10447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "036301d981ab4f54baaec35aaa421934"
dest_uuid: "5f70ed38144548d197978cda555dc43b"
 from {username='slave'} at 127.0.0.1:54556
I20260709 12:16:33.760128 10447 raft_consensus.cc:493] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:33.760528 10447 raft_consensus.cc:3060] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.760452 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:33.760135 10373 raft_consensus.cc:3060] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.761155 10521 raft_consensus.cc:3060] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.766381 10447 raft_consensus.cc:515] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.768385 10447 leader_election.cc:290] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 2 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:33.769212 10521 raft_consensus.cc:2468] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 2.
I20260709 12:16:33.769521 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036301d981ab4f54baaec35aaa421934" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:33.769888 10373 raft_consensus.cc:2468] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 2.
I20260709 12:16:33.770236 10522 raft_consensus.cc:3055] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:33.770645 10522 raft_consensus.cc:740] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:33.769214 10374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036301d981ab4f54baaec35aaa421934" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:33.771023 10412 leader_election.cc:304] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:33.771520 10374 raft_consensus.cc:3060] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.771526 10522 consensus_queue.cc:260] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.772420 10594 raft_consensus.cc:2804] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:33.772903 10594 raft_consensus.cc:697] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Becoming Leader. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:33.773167 10522 raft_consensus.cc:3060] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.773729 10594 consensus_queue.cc:237] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.778597 10374 raft_consensus.cc:2468] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 2.
I20260709 12:16:33.779860 10412 leader_election.cc:304] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:33.780542 10522 raft_consensus.cc:2468] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 2.
I20260709 12:16:33.781198 10631 raft_consensus.cc:2804] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:33.781702 10631 raft_consensus.cc:697] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Becoming Leader. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:33.782531 10631 consensus_queue.cc:237] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.789047 10270 catalog_manager.cc:5697] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b reported cstate change: term changed from 1 to 2, leader changed from 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65) to 5f70ed38144548d197978cda555dc43b (127.1.248.66). New cstate: current_term: 2 leader_uuid: "5f70ed38144548d197978cda555dc43b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.793515 10582 raft_consensus.cc:993] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969: : Instructing follower 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:33.794037 10643 raft_consensus.cc:1081] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Signalling peer 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:33.795416 10374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11baa72ed6a64d1f9ab1ee8f5f29e574"
dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:53158
I20260709 12:16:33.795987 10374 raft_consensus.cc:493] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:33.796324 10374 raft_consensus.cc:3060] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.802713 10270 catalog_manager.cc:5697] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b reported cstate change: term changed from 1 to 2, leader changed from 173593b73f1d4418957c253a8bfcb969 (127.1.248.67) to 5f70ed38144548d197978cda555dc43b (127.1.248.66). New cstate: current_term: 2 leader_uuid: "5f70ed38144548d197978cda555dc43b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.803377 10374 raft_consensus.cc:515] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.805226 10374 leader_election.cc:290] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Requested vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:33.806067 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11baa72ed6a64d1f9ab1ee8f5f29e574" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:33.806396 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11baa72ed6a64d1f9ab1ee8f5f29e574" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:33.806721 10447 raft_consensus.cc:3060] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.807091 10522 raft_consensus.cc:3055] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:33.807417 10522 raft_consensus.cc:740] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:33.808218 10522 consensus_queue.cc:260] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.809401 10522 raft_consensus.cc:3060] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.813241 10447 raft_consensus.cc:2468] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 2.
I20260709 12:16:33.814525 10340 leader_election.cc:304] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:33.815286 10569 raft_consensus.cc:2804] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:33.815779 10569 raft_consensus.cc:697] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Becoming Leader. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:33.816800 10522 raft_consensus.cc:2468] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 2.
I20260709 12:16:33.816572 10569 consensus_queue.cc:237] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.823623 10270 catalog_manager.cc:5697] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 reported cstate change: term changed from 1 to 2, leader changed from 173593b73f1d4418957c253a8bfcb969 (127.1.248.67) to 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "021c49ecd5974a54a3b690aa43e71f69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.968633 10582 raft_consensus.cc:993] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969: : Instructing follower 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:33.969137 10643 raft_consensus.cc:1081] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Signalling peer 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:33.970430 10374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "835e250034f84f2bbc21be0bc3719256"
dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:53158
I20260709 12:16:33.970952 10374 raft_consensus.cc:493] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:33.971256 10374 raft_consensus.cc:3060] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.976858 10374 raft_consensus.cc:515] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.978562 10374 leader_election.cc:290] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Requested vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:33.979540 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835e250034f84f2bbc21be0bc3719256" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:33.979862 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835e250034f84f2bbc21be0bc3719256" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:33.980226 10447 raft_consensus.cc:3060] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.980528 10522 raft_consensus.cc:3055] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:33.980921 10522 raft_consensus.cc:740] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:33.981802 10522 consensus_queue.cc:260] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.982832 10522 raft_consensus.cc:3060] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.985687 10447 raft_consensus.cc:2468] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 2.
I20260709 12:16:33.986801 10340 leader_election.cc:304] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:33.987910 10648 raft_consensus.cc:2804] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:33.988323 10648 raft_consensus.cc:697] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Becoming Leader. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:33.988328 10522 raft_consensus.cc:2468] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 2.
I20260709 12:16:33.989197 10648 consensus_queue.cc:237] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:33.995576 10270 catalog_manager.cc:5697] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 reported cstate change: term changed from 1 to 2, leader changed from 173593b73f1d4418957c253a8bfcb969 (127.1.248.67) to 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "021c49ecd5974a54a3b690aa43e71f69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:34.103870 10447 raft_consensus.cc:1275] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:34.105140 10648 consensus_queue.cc:1048] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.112869 10522 raft_consensus.cc:1275] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:34.115512 10569 consensus_queue.cc:1048] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.222584 10522 raft_consensus.cc:1275] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:34.223778 10569 consensus_queue.cc:1048] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.233001 10447 raft_consensus.cc:1275] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:34.235621 10648 consensus_queue.cc:1048] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.251942 10522 raft_consensus.cc:1275] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:34.253290 10648 consensus_queue.cc:1048] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.262472 10447 raft_consensus.cc:1275] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:34.264891 10648 consensus_queue.cc:1048] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.330837 10374 raft_consensus.cc:1275] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Refusing update from remote peer 5f70ed38144548d197978cda555dc43b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:34.331336 10373 raft_consensus.cc:1275] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Refusing update from remote peer 5f70ed38144548d197978cda555dc43b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:34.333596 10594 consensus_queue.cc:1048] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.334271 10592 consensus_queue.cc:1048] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.337172 10522 raft_consensus.cc:1275] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Refusing update from remote peer 5f70ed38144548d197978cda555dc43b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:34.338975 10592 consensus_queue.cc:1048] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.348790 10521 raft_consensus.cc:1275] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Refusing update from remote peer 5f70ed38144548d197978cda555dc43b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:34.353150 10594 consensus_queue.cc:1048] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.385443 10522 raft_consensus.cc:1275] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:34.386759 10648 consensus_queue.cc:1048] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.394613 10447 raft_consensus.cc:1275] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:34.396703 10648 consensus_queue.cc:1048] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:36.695338 10271 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53286:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:36.698164 10271 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:36.750250 10357 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4daa002b4542c5a99a8a5eaa64adf6 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:36.751497 10438 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4daa002b4542c5a99a8a5eaa64adf6 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:36.752385 10357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4daa002b4542c5a99a8a5eaa64adf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.753279 10438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4daa002b4542c5a99a8a5eaa64adf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.753172 10509 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4daa002b4542c5a99a8a5eaa64adf6 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:36.754745 10509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4daa002b4542c5a99a8a5eaa64adf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.757404 10362 tablet_service.cc:1511] Processing CreateTablet for tablet 1b976eb9a341499782230fa96a66b761 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:36.759049 10362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b976eb9a341499782230fa96a66b761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.760672 10439 tablet_service.cc:1511] Processing CreateTablet for tablet 1b976eb9a341499782230fa96a66b761 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:36.762153 10439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b976eb9a341499782230fa96a66b761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.763137 10436 tablet_service.cc:1511] Processing CreateTablet for tablet 939740892dbd49998223a0e99abde7be (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:36.764575 10436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939740892dbd49998223a0e99abde7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.764693 10506 tablet_service.cc:1511] Processing CreateTablet for tablet 1b976eb9a341499782230fa96a66b761 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:36.766149 10506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b976eb9a341499782230fa96a66b761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.768769 10358 tablet_service.cc:1511] Processing CreateTablet for tablet 60a88f4f23074e17ab636800f20c5f96 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:36.770057 10432 tablet_service.cc:1511] Processing CreateTablet for tablet 60a88f4f23074e17ab636800f20c5f96 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:36.771298 10356 tablet_service.cc:1511] Processing CreateTablet for tablet 939740892dbd49998223a0e99abde7be (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:36.778070 10361 tablet_service.cc:1511] Processing CreateTablet for tablet 82fbe8b6741d46329ab34fd5e8b39eec (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:36.778735 10432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a88f4f23074e17ab636800f20c5f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.774005 10513 tablet_service.cc:1511] Processing CreateTablet for tablet 60a88f4f23074e17ab636800f20c5f96 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:36.774581 10359 tablet_service.cc:1511] Processing CreateTablet for tablet 43f2eb5d0e914ac8902db6526e43200d (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:36.776180 10510 tablet_service.cc:1511] Processing CreateTablet for tablet 43f2eb5d0e914ac8902db6526e43200d (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:36.777146 10437 tablet_service.cc:1511] Processing CreateTablet for tablet 43f2eb5d0e914ac8902db6526e43200d (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:36.784109 10437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f2eb5d0e914ac8902db6526e43200d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.786952 10508 tablet_service.cc:1511] Processing CreateTablet for tablet 82fbe8b6741d46329ab34fd5e8b39eec (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:36.788604 10434 tablet_service.cc:1511] Processing CreateTablet for tablet 82fbe8b6741d46329ab34fd5e8b39eec (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:36.789974 10434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fbe8b6741d46329ab34fd5e8b39eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.792531 10364 tablet_service.cc:1511] Processing CreateTablet for tablet f2c6a6ac6ab847f79486a416a8978e53 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:36.797089 10507 tablet_service.cc:1511] Processing CreateTablet for tablet f2c6a6ac6ab847f79486a416a8978e53 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:36.800247 10360 tablet_service.cc:1511] Processing CreateTablet for tablet ed1b191848c049f9aa1a4bf2546f949a (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:36.794742 10435 tablet_service.cc:1511] Processing CreateTablet for tablet f2c6a6ac6ab847f79486a416a8978e53 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:36.804179 10435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c6a6ac6ab847f79486a416a8978e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.807850 10433 tablet_service.cc:1511] Processing CreateTablet for tablet ed1b191848c049f9aa1a4bf2546f949a (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:36.809202 10433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed1b191848c049f9aa1a4bf2546f949a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.810123 10505 tablet_service.cc:1511] Processing CreateTablet for tablet ed1b191848c049f9aa1a4bf2546f949a (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:36.812645 10361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fbe8b6741d46329ab34fd5e8b39eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.813411 10356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939740892dbd49998223a0e99abde7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.814021 10364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c6a6ac6ab847f79486a416a8978e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.814694 10363 tablet_service.cc:1511] Processing CreateTablet for tablet 8549089965d1470ea422dc0922dd65c8 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:36.815703 10360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed1b191848c049f9aa1a4bf2546f949a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.816335 10363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8549089965d1470ea422dc0922dd65c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.816411 10508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fbe8b6741d46329ab34fd5e8b39eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.818106 10507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c6a6ac6ab847f79486a416a8978e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.819800 10505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed1b191848c049f9aa1a4bf2546f949a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.829710 10513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a88f4f23074e17ab636800f20c5f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.832470 10431 tablet_service.cc:1511] Processing CreateTablet for tablet 8549089965d1470ea422dc0922dd65c8 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:36.833194 10510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f2eb5d0e914ac8902db6526e43200d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.833918 10431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8549089965d1470ea422dc0922dd65c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.836674 10512 tablet_service.cc:1511] Processing CreateTablet for tablet 8549089965d1470ea422dc0922dd65c8 (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:36.838070 10512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8549089965d1470ea422dc0922dd65c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.772923 10511 tablet_service.cc:1511] Processing CreateTablet for tablet 939740892dbd49998223a0e99abde7be (DEFAULT_TABLE table=soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:36.841045 10359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f2eb5d0e914ac8902db6526e43200d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.841703 10511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939740892dbd49998223a0e99abde7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.847290 10358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a88f4f23074e17ab636800f20c5f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.953814 10674 tablet_bootstrap.cc:492] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:36.961387 10674 tablet_bootstrap.cc:654] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:36.989419 10675 tablet_bootstrap.cc:492] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:37.039641 10675 tablet_bootstrap.cc:654] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.044142 10676 tablet_bootstrap.cc:492] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:37.052184 10674 tablet_bootstrap.cc:492] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:37.055662 10674 ts_tablet_manager.cc:1403] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.102s	user 0.031s	sys 0.052s
I20260709 12:16:37.058018 10675 tablet_bootstrap.cc:492] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:37.058509 10675 ts_tablet_manager.cc:1403] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.019s
I20260709 12:16:37.059203 10676 tablet_bootstrap.cc:654] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.058709 10674 raft_consensus.cc:359] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.059757 10674 raft_consensus.cc:385] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.060114 10674 raft_consensus.cc:740] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.061290 10675 raft_consensus.cc:359] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.061004 10674 consensus_queue.cc:260] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.061914 10675 raft_consensus.cc:385] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.062255 10675 raft_consensus.cc:740] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.063237 10675 consensus_queue.cc:260] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.064010 10674 ts_tablet_manager.cc:1434] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:16:37.065147 10674 tablet_bootstrap.cc:492] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:37.065784 10675 ts_tablet_manager.cc:1434] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:16:37.066867 10675 tablet_bootstrap.cc:492] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:37.072510 10674 tablet_bootstrap.cc:654] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.074146 10675 tablet_bootstrap.cc:654] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.087447 10674 tablet_bootstrap.cc:492] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:37.088127 10674 ts_tablet_manager.cc:1403] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.006s
I20260709 12:16:37.091171 10675 tablet_bootstrap.cc:492] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:37.091795 10675 ts_tablet_manager.cc:1403] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.003s
I20260709 12:16:37.091562 10674 raft_consensus.cc:359] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.092342 10676 tablet_bootstrap.cc:492] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:37.092330 10674 raft_consensus.cc:385] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.092898 10674 raft_consensus.cc:740] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.093086 10676 ts_tablet_manager.cc:1403] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.024s
I20260709 12:16:37.094293 10674 consensus_queue.cc:260] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.095319 10675 raft_consensus.cc:359] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.096067 10675 raft_consensus.cc:385] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.096354 10675 raft_consensus.cc:740] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.096837 10674 ts_tablet_manager.cc:1434] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:37.097136 10675 consensus_queue.cc:260] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.097868 10674 tablet_bootstrap.cc:492] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:37.099440 10675 ts_tablet_manager.cc:1434] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:16:37.100595 10675 tablet_bootstrap.cc:492] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:37.099468 10676 raft_consensus.cc:359] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.102837 10676 raft_consensus.cc:385] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.103168 10676 raft_consensus.cc:740] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.104033 10676 consensus_queue.cc:260] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.105480 10674 tablet_bootstrap.cc:654] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.107241 10675 tablet_bootstrap.cc:654] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.114593 10676 ts_tablet_manager.cc:1434] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:16:37.116351 10676 tablet_bootstrap.cc:492] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:37.125864 10676 tablet_bootstrap.cc:654] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.144507 10674 tablet_bootstrap.cc:492] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:37.144987 10676 tablet_bootstrap.cc:492] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:37.145030 10674 ts_tablet_manager.cc:1403] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.047s	user 0.025s	sys 0.012s
I20260709 12:16:37.145335 10675 tablet_bootstrap.cc:492] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:37.145709 10676 ts_tablet_manager.cc:1403] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.010s
I20260709 12:16:37.145859 10675 ts_tablet_manager.cc:1403] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.024s
I20260709 12:16:37.148029 10674 raft_consensus.cc:359] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.148712 10674 raft_consensus.cc:385] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.148980 10674 raft_consensus.cc:740] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.148952 10676 raft_consensus.cc:359] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.149210 10675 raft_consensus.cc:359] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.149889 10676 raft_consensus.cc:385] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.149996 10675 raft_consensus.cc:385] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.150322 10676 raft_consensus.cc:740] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.150502 10675 raft_consensus.cc:740] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.150066 10674 consensus_queue.cc:260] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.151230 10675 consensus_queue.cc:260] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.151180 10676 consensus_queue.cc:260] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.152968 10674 ts_tablet_manager.cc:1434] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:37.153729 10675 ts_tablet_manager.cc:1434] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:37.154054 10674 tablet_bootstrap.cc:492] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:37.154247 10676 ts_tablet_manager.cc:1434] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 12:16:37.154835 10675 tablet_bootstrap.cc:492] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:37.155512 10676 tablet_bootstrap.cc:492] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:37.162595 10674 tablet_bootstrap.cc:654] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.162672 10675 tablet_bootstrap.cc:654] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.162672 10676 tablet_bootstrap.cc:654] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.177295 10675 tablet_bootstrap.cc:492] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:37.177977 10675 ts_tablet_manager.cc:1403] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:16:37.180554 10676 tablet_bootstrap.cc:492] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:37.181187 10676 ts_tablet_manager.cc:1403] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.009s
I20260709 12:16:37.182018 10675 raft_consensus.cc:359] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.183120 10675 raft_consensus.cc:385] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.184639 10675 raft_consensus.cc:740] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.184448 10676 raft_consensus.cc:359] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.185545 10676 raft_consensus.cc:385] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.185937 10676 raft_consensus.cc:740] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.185705 10675 consensus_queue.cc:260] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.186180 10674 tablet_bootstrap.cc:492] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:37.187136 10674 ts_tablet_manager.cc:1403] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.015s
I20260709 12:16:37.186940 10676 consensus_queue.cc:260] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.189870 10676 ts_tablet_manager.cc:1434] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:16:37.190203 10674 raft_consensus.cc:359] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.190969 10674 raft_consensus.cc:385] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.191013 10676 tablet_bootstrap.cc:492] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:37.191361 10674 raft_consensus.cc:740] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.191780 10675 ts_tablet_manager.cc:1434] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.007s
I20260709 12:16:37.192315 10674 consensus_queue.cc:260] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.192845 10675 tablet_bootstrap.cc:492] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:37.194784 10674 ts_tablet_manager.cc:1434] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:37.195839 10674 tablet_bootstrap.cc:492] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:37.198675 10676 tablet_bootstrap.cc:654] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.200223 10675 tablet_bootstrap.cc:654] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.202584 10674 tablet_bootstrap.cc:654] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.210305 10676 tablet_bootstrap.cc:492] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:37.210891 10676 ts_tablet_manager.cc:1403] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 12:16:37.213894 10676 raft_consensus.cc:359] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.214746 10676 raft_consensus.cc:385] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.215106 10676 raft_consensus.cc:740] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.216040 10676 consensus_queue.cc:260] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.216892 10648 raft_consensus.cc:493] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.217677 10648 raft_consensus.cc:515] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.218797 10676 ts_tablet_manager.cc:1434] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:16:37.221526 10676 tablet_bootstrap.cc:492] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:37.221467 10648 leader_election.cc:290] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.222013 10643 raft_consensus.cc:493] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.222601 10643 raft_consensus.cc:515] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.221592 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
W20260709 12:16:37.227596 10340 leader_election.cc:343] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.229540 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:37.230234 10676 tablet_bootstrap.cc:654] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.230234 10521 raft_consensus.cc:2468] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 0.
I20260709 12:16:37.232954 10643 leader_election.cc:290] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:37.239912 10338 leader_election.cc:304] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 5f70ed38144548d197978cda555dc43b
I20260709 12:16:37.241201 10648 raft_consensus.cc:2804] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:37.241628 10648 raft_consensus.cc:493] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.241951 10648 raft_consensus.cc:3060] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.242928 10676 tablet_bootstrap.cc:492] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:37.244028 10676 ts_tablet_manager.cc:1403] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 12:16:37.244177 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f2eb5d0e914ac8902db6526e43200d" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
W20260709 12:16:37.245985 10489 leader_election.cc:343] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.247026 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f2eb5d0e914ac8902db6526e43200d" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:37.247722 10676 raft_consensus.cc:359] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.248615 10676 raft_consensus.cc:385] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.248991 10676 raft_consensus.cc:740] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
W20260709 12:16:37.249545 10486 leader_election.cc:343] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.250041 10486 leader_election.cc:304] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969; no voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b
I20260709 12:16:37.249794 10676 consensus_queue.cc:260] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.256369 10643 raft_consensus.cc:2749] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:37.276705 10659 raft_consensus.cc:493] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.276959 10676 ts_tablet_manager.cc:1434] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.025s
I20260709 12:16:37.277367 10659 raft_consensus.cc:515] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.278299 10676 tablet_bootstrap.cc:492] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:37.280576 10659 leader_election.cc:290] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.281467 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8549089965d1470ea422dc0922dd65c8" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
W20260709 12:16:37.282968 10340 leader_election.cc:343] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.284854 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8549089965d1470ea422dc0922dd65c8" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:37.285594 10521 raft_consensus.cc:2468] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 0.
I20260709 12:16:37.286247 10676 tablet_bootstrap.cc:654] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.287249 10693 raft_consensus.cc:493] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.287330 10338 leader_election.cc:304] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 5f70ed38144548d197978cda555dc43b
I20260709 12:16:37.288174 10693 raft_consensus.cc:515] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.288842 10659 raft_consensus.cc:2804] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:37.289294 10659 raft_consensus.cc:493] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.289757 10659 raft_consensus.cc:3060] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.291957 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b976eb9a341499782230fa96a66b761" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:37.292676 10693 leader_election.cc:290] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:37.295421 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b976eb9a341499782230fa96a66b761" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:37.296250 10448 raft_consensus.cc:2468] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 0.
I20260709 12:16:37.297490 10489 leader_election.cc:304] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:37.298352 10693 raft_consensus.cc:2804] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:16:37.298641 10486 leader_election.cc:343] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.298806 10676 tablet_bootstrap.cc:492] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:37.299556 10676 ts_tablet_manager.cc:1403] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 12:16:37.298866 10693 raft_consensus.cc:493] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.300130 10693 raft_consensus.cc:3060] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.302985 10676 raft_consensus.cc:359] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.303969 10676 raft_consensus.cc:385] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.304337 10676 raft_consensus.cc:740] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.305197 10676 consensus_queue.cc:260] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.307526 10676 ts_tablet_manager.cc:1434] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:16:37.308588 10676 tablet_bootstrap.cc:492] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:37.316987 10676 tablet_bootstrap.cc:654] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.309613 10695 raft_consensus.cc:493] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.317519 10695 raft_consensus.cc:515] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.317637 10648 raft_consensus.cc:515] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.321659 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b"
W20260709 12:16:37.323189 10340 leader_election.cc:343] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.324548 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939740892dbd49998223a0e99abde7be" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:37.325307 10448 raft_consensus.cc:2468] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 0.
I20260709 12:16:37.332136 10340 leader_election.cc:304] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:37.335831 10696 raft_consensus.cc:2804] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:37.335894 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939740892dbd49998223a0e99abde7be" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:37.336305 10696 raft_consensus.cc:493] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.336146 10695 leader_election.cc:290] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.336915 10696 raft_consensus.cc:3060] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:37.337798 10338 leader_election.cc:343] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:37.345345 10544 debug-util.cc:398] Leaking SignalData structure 0x7b08001be2c0 after lost signal to thread 2020
I20260709 12:16:37.346014 10648 leader_election.cc:290] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 election: Requested vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.347895 10659 raft_consensus.cc:515] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
W20260709 12:16:37.348680 10544 debug-util.cc:398] Leaking SignalData structure 0x7b08000403e0 after lost signal to thread 10398
W20260709 12:16:37.350529 10544 debug-util.cc:398] Leaking SignalData structure 0x7b08001add20 after lost signal to thread 10473
I20260709 12:16:37.345280 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:37.351775 10521 raft_consensus.cc:3060] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:37.351912 10544 debug-util.cc:398] Leaking SignalData structure 0x7b0800204500 after lost signal to thread 10547
I20260709 12:16:37.354326 10674 tablet_bootstrap.cc:492] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:37.355068 10674 ts_tablet_manager.cc:1403] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.159s	user 0.056s	sys 0.088s
I20260709 12:16:37.359448 10674 raft_consensus.cc:359] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.362203 10662 raft_consensus.cc:493] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.360435 10674 raft_consensus.cc:385] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.362805 10662 raft_consensus.cc:515] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.363297 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8549089965d1470ea422dc0922dd65c8" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:37.363610 10674 raft_consensus.cc:740] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.363677 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8549089965d1470ea422dc0922dd65c8" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:37.364596 10522 raft_consensus.cc:3060] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:37.365007 10340 leader_election.cc:343] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.364879 10674 consensus_queue.cc:260] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.363317 10659 leader_election.cc:290] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 election: Requested vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.367833 10523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c6a6ac6ab847f79486a416a8978e53" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:37.368575 10523 raft_consensus.cc:2468] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 0.
I20260709 12:16:37.368726 10675 tablet_bootstrap.cc:492] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:37.369658 10675 ts_tablet_manager.cc:1403] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.177s	user 0.029s	sys 0.029s
I20260709 12:16:37.371608 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c6a6ac6ab847f79486a416a8978e53" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:37.372749 10662 leader_election.cc:290] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.372972 10693 raft_consensus.cc:515] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.373010 10522 raft_consensus.cc:2468] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 1.
W20260709 12:16:37.374070 10412 leader_election.cc:343] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.375129 10338 leader_election.cc:304] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 5f70ed38144548d197978cda555dc43b
I20260709 12:16:37.375330 10413 leader_election.cc:304] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 021c49ecd5974a54a3b690aa43e71f69
I20260709 12:16:37.376426 10659 raft_consensus.cc:2804] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:37.376906 10659 raft_consensus.cc:697] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Becoming Leader. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:37.377550 10662 raft_consensus.cc:2804] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:37.377985 10662 raft_consensus.cc:493] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.377825 10659 consensus_queue.cc:237] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.378407 10662 raft_consensus.cc:3060] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.367870 10674 ts_tablet_manager.cc:1434] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.012s	user 0.012s	sys 0.001s
I20260709 12:16:37.394217 10674 tablet_bootstrap.cc:492] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:37.387418 10662 raft_consensus.cc:515] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.392817 10521 raft_consensus.cc:2468] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 1.
I20260709 12:16:37.402642 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c6a6ac6ab847f79486a416a8978e53" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:37.403538 10338 leader_election.cc:304] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 5f70ed38144548d197978cda555dc43b
I20260709 12:16:37.405018 10662 leader_election.cc:290] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.405380 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c6a6ac6ab847f79486a416a8978e53" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:37.405774 10697 raft_consensus.cc:2804] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:37.405997 10662 raft_consensus.cc:493] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.406337 10521 raft_consensus.cc:3060] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.406540 10697 raft_consensus.cc:697] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Becoming Leader. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:37.406597 10662 raft_consensus.cc:515] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.408032 10697 consensus_queue.cc:237] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.410553 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4daa002b4542c5a99a8a5eaa64adf6" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
W20260709 12:16:37.411931 10413 leader_election.cc:343] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:37.412324 10412 leader_election.cc:343] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.412478 10674 tablet_bootstrap.cc:654] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.413446 10662 leader_election.cc:290] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.415200 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4daa002b4542c5a99a8a5eaa64adf6" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
W20260709 12:16:37.418042 10412 leader_election.cc:343] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.418773 10521 raft_consensus.cc:2468] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 1.
I20260709 12:16:37.418648 10412 leader_election.cc:304] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f70ed38144548d197978cda555dc43b; no voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969
I20260709 12:16:37.420320 10413 leader_election.cc:304] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 021c49ecd5974a54a3b690aa43e71f69
I20260709 12:16:37.421876 10660 raft_consensus.cc:2749] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:37.422596 10660 raft_consensus.cc:2804] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:37.423062 10660 raft_consensus.cc:697] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Becoming Leader. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:37.424003 10660 consensus_queue.cc:237] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.428210 10695 raft_consensus.cc:493] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.428746 10695 raft_consensus.cc:515] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.430966 10695 leader_election.cc:290] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.432749 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a88f4f23074e17ab636800f20c5f96" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:37.433718 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a88f4f23074e17ab636800f20c5f96" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
W20260709 12:16:37.434497 10340 leader_election.cc:343] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:37.435482 10338 leader_election.cc:343] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.435909 10338 leader_election.cc:304] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69; no voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b
I20260709 12:16:37.437008 10674 tablet_bootstrap.cc:492] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:37.437044 10695 raft_consensus.cc:2749] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:37.439227 10674 ts_tablet_manager.cc:1403] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.008s
I20260709 12:16:37.443353 10674 raft_consensus.cc:359] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.444317 10674 raft_consensus.cc:385] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.444494 10676 tablet_bootstrap.cc:492] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:37.444638 10674 raft_consensus.cc:740] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.445371 10676 ts_tablet_manager.cc:1403] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.137s	user 0.028s	sys 0.053s
I20260709 12:16:37.445904 10674 consensus_queue.cc:260] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.446733 10271 catalog_manager.cc:5697] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f70ed38144548d197978cda555dc43b (127.1.248.66). New cstate: current_term: 1 leader_uuid: "5f70ed38144548d197978cda555dc43b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:37.448617 10676 raft_consensus.cc:359] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.449049 10674 ts_tablet_manager.cc:1434] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:16:37.449482 10676 raft_consensus.cc:385] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.450187 10676 raft_consensus.cc:740] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.450330 10674 tablet_bootstrap.cc:492] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:37.451113 10676 consensus_queue.cc:260] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.444674 10675 raft_consensus.cc:359] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.454057 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b976eb9a341499782230fa96a66b761" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:37.454361 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b976eb9a341499782230fa96a66b761" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:37.455166 10448 raft_consensus.cc:3060] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.456501 10676 ts_tablet_manager.cc:1434] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:16:37.458063 10676 tablet_bootstrap.cc:492] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:37.454507 10675 raft_consensus.cc:385] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.463637 10675 raft_consensus.cc:740] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.464370 10693 leader_election.cc:290] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:37.464803 10676 tablet_bootstrap.cc:654] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.467265 10675 consensus_queue.cc:260] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.471326 10448 raft_consensus.cc:2468] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
I20260709 12:16:37.471721 10371 raft_consensus.cc:3060] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.473150 10489 leader_election.cc:304] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:37.474081 10693 raft_consensus.cc:2804] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:37.474850 10693 raft_consensus.cc:697] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Leader. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:37.475598 10674 tablet_bootstrap.cc:654] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.475759 10693 consensus_queue.cc:237] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.476058 10270 catalog_manager.cc:5697] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "021c49ecd5974a54a3b690aa43e71f69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:37.478799 10675 ts_tablet_manager.cc:1434] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.000s
I20260709 12:16:37.479929 10675 tablet_bootstrap.cc:492] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:37.469780 10696 raft_consensus.cc:515] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.480769 10371 raft_consensus.cc:2468] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
I20260709 12:16:37.487648 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939740892dbd49998223a0e99abde7be" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:37.487852 10696 leader_election.cc:290] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 election: Requested vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.488319 10448 raft_consensus.cc:3060] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.489728 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939740892dbd49998223a0e99abde7be" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969"
W20260709 12:16:37.491480 10338 leader_election.cc:343] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.495034 10675 tablet_bootstrap.cc:654] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.496622 10448 raft_consensus.cc:2468] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 1.
I20260709 12:16:37.498553 10340 leader_election.cc:304] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 173593b73f1d4418957c253a8bfcb969
I20260709 12:16:37.502722 10696 raft_consensus.cc:2804] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:37.503221 10696 raft_consensus.cc:697] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Becoming Leader. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:37.504115 10696 consensus_queue.cc:237] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.506597 10674 tablet_bootstrap.cc:492] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:37.507208 10674 ts_tablet_manager.cc:1403] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.009s
I20260709 12:16:37.509183 10676 tablet_bootstrap.cc:492] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:37.509861 10676 ts_tablet_manager.cc:1403] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.001s
I20260709 12:16:37.512692 10676 raft_consensus.cc:359] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.510581 10674 raft_consensus.cc:359] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.516028 10674 raft_consensus.cc:385] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.516390 10674 raft_consensus.cc:740] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.517331 10674 consensus_queue.cc:260] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.516049 10676 raft_consensus.cc:385] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.519850 10676 raft_consensus.cc:740] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.520563 10676 consensus_queue.cc:260] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.525346 10272 catalog_manager.cc:5697] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173593b73f1d4418957c253a8bfcb969 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "173593b73f1d4418957c253a8bfcb969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:37.530983 10674 ts_tablet_manager.cc:1434] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 12:16:37.532171 10674 tablet_bootstrap.cc:492] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:37.534210 10676 ts_tablet_manager.cc:1434] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:16:37.534323 10693 raft_consensus.cc:493] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.534919 10693 raft_consensus.cc:515] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.535343 10676 tablet_bootstrap.cc:492] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969: Bootstrap starting.
I20260709 12:16:37.537113 10693 leader_election.cc:290] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:37.538228 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1b191848c049f9aa1a4bf2546f949a" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:37.538638 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1b191848c049f9aa1a4bf2546f949a" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:37.538945 10447 raft_consensus.cc:2468] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 0.
W20260709 12:16:37.540182 10486 leader_election.cc:343] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.540735 10489 leader_election.cc:304] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 021c49ecd5974a54a3b690aa43e71f69
I20260709 12:16:37.543334 10675 tablet_bootstrap.cc:492] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:37.543952 10675 ts_tablet_manager.cc:1403] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.011s
I20260709 12:16:37.546974 10675 raft_consensus.cc:359] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.547775 10675 raft_consensus.cc:385] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.548123 10675 raft_consensus.cc:740] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.548985 10675 consensus_queue.cc:260] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.549815 10693 raft_consensus.cc:2804] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:37.550251 10693 raft_consensus.cc:493] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.550800 10693 raft_consensus.cc:3060] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.551860 10675 ts_tablet_manager.cc:1434] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:37.553068 10675 tablet_bootstrap.cc:492] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:37.553194 10676 tablet_bootstrap.cc:654] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.557816 10674 tablet_bootstrap.cc:654] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.559684 10693 raft_consensus.cc:515] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.560333 10675 tablet_bootstrap.cc:654] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.562758 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1b191848c049f9aa1a4bf2546f949a" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:37.563397 10371 raft_consensus.cc:3060] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.565547 10676 tablet_bootstrap.cc:492] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969: No bootstrap required, opened a new log
I20260709 12:16:37.566099 10676 ts_tablet_manager.cc:1403] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 12:16:37.569376 10270 catalog_manager.cc:5697] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "021c49ecd5974a54a3b690aa43e71f69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:37.571316 10270 catalog_manager.cc:5697] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65). New cstate: current_term: 1 leader_uuid: "021c49ecd5974a54a3b690aa43e71f69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:37.573066 10371 raft_consensus.cc:2468] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
I20260709 12:16:37.573443 10674 tablet_bootstrap.cc:492] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:37.574034 10674 ts_tablet_manager.cc:1403] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.003s
I20260709 12:16:37.574563 10662 raft_consensus.cc:493] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:37.579581 10320 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:37.579843 10662 raft_consensus.cc:515] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.574631 10486 leader_election.cc:304] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:37.582332 10662 leader_election.cc:290] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.583328 10691 raft_consensus.cc:2804] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:37.583940 10691 raft_consensus.cc:697] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Leader. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:37.584174 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f2eb5d0e914ac8902db6526e43200d" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:37.584950 10521 raft_consensus.cc:2468] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 0.
I20260709 12:16:37.584867 10691 consensus_queue.cc:237] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.585634 10693 leader_election.cc:290] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:37.586710 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f2eb5d0e914ac8902db6526e43200d" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:37.587451 10413 leader_election.cc:304] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 
W20260709 12:16:37.588461 10412 leader_election.cc:343] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:37.577867 10675 tablet_bootstrap.cc:492] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:37.592648 10660 raft_consensus.cc:2804] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:37.592872 10675 ts_tablet_manager.cc:1403] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.005s
I20260709 12:16:37.593453 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1b191848c049f9aa1a4bf2546f949a" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:37.594468 10447 raft_consensus.cc:3060] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.597652 10675 raft_consensus.cc:359] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.599558 10660 raft_consensus.cc:493] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.603566 10675 raft_consensus.cc:385] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.603645 10660 raft_consensus.cc:3060] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.603966 10675 raft_consensus.cc:740] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.604883 10675 consensus_queue.cc:260] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.605891 10270 catalog_manager.cc:5697] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173593b73f1d4418957c253a8bfcb969 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "173593b73f1d4418957c253a8bfcb969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:37.607664 10675 ts_tablet_manager.cc:1434] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:16:37.607942 10662 raft_consensus.cc:493] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.608508 10662 raft_consensus.cc:515] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.608935 10675 tablet_bootstrap.cc:492] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:37.615991 10675 tablet_bootstrap.cc:654] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.616031 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a88f4f23074e17ab636800f20c5f96" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:37.616808 10371 raft_consensus.cc:2468] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 0.
I20260709 12:16:37.618305 10412 leader_election.cc:304] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:37.628464 10718 raft_consensus.cc:2804] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:37.628842 10718 raft_consensus.cc:493] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.629129 10718 raft_consensus.cc:3060] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.633502 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a88f4f23074e17ab636800f20c5f96" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:37.634390 10675 tablet_bootstrap.cc:492] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:37.634992 10675 ts_tablet_manager.cc:1403] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.009s
I20260709 12:16:37.635300 10662 leader_election.cc:290] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.636806 10718 raft_consensus.cc:515] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.638513 10675 raft_consensus.cc:359] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.639334 10675 raft_consensus.cc:385] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.639750 10675 raft_consensus.cc:740] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.640215 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a88f4f23074e17ab636800f20c5f96" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:37.640846 10371 raft_consensus.cc:3060] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.640517 10675 consensus_queue.cc:260] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.643038 10675 ts_tablet_manager.cc:1434] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:16:37.644747 10718 leader_election.cc:290] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.645749 10675 tablet_bootstrap.cc:492] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69: Bootstrap starting.
I20260709 12:16:37.646024 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a88f4f23074e17ab636800f20c5f96" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:37.650321 10691 raft_consensus.cc:493] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.650528 10674 raft_consensus.cc:359] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.650924 10691 raft_consensus.cc:515] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.570344 10676 raft_consensus.cc:359] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.653072 10691 leader_election.cc:290] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:37.653337 10676 raft_consensus.cc:385] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.653707 10676 raft_consensus.cc:740] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.631078 10447 raft_consensus.cc:2468] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
I20260709 12:16:37.655198 10374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4daa002b4542c5a99a8a5eaa64adf6" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:37.655938 10374 raft_consensus.cc:2468] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 0.
I20260709 12:16:37.658594 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4daa002b4542c5a99a8a5eaa64adf6" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:37.659019 10486 leader_election.cc:304] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:37.659348 10447 raft_consensus.cc:2468] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 0.
I20260709 12:16:37.660408 10675 tablet_bootstrap.cc:654] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.661321 10676 consensus_queue.cc:260] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.662326 10691 raft_consensus.cc:2804] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:37.662386 10521 raft_consensus.cc:2468] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 0.
I20260709 12:16:37.662969 10691 raft_consensus.cc:493] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.651363 10674 raft_consensus.cc:385] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.676901 10674 raft_consensus.cc:740] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.677781 10674 consensus_queue.cc:260] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.680101 10674 ts_tablet_manager.cc:1434] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:16:37.681106 10674 tablet_bootstrap.cc:492] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b: Bootstrap starting.
I20260709 12:16:37.665707 10660 raft_consensus.cc:515] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.687016 10660 leader_election.cc:290] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.668255 10676 ts_tablet_manager.cc:1434] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.002s
I20260709 12:16:37.688045 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f2eb5d0e914ac8902db6526e43200d" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:37.688838 10521 raft_consensus.cc:3060] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.691999 10374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f2eb5d0e914ac8902db6526e43200d" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:37.692903 10374 raft_consensus.cc:3060] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.700783 10674 tablet_bootstrap.cc:654] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:37.717664 10674 tablet_bootstrap.cc:492] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b: No bootstrap required, opened a new log
I20260709 12:16:37.718196 10674 ts_tablet_manager.cc:1403] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.007s
I20260709 12:16:37.721155 10674 raft_consensus.cc:359] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.721920 10674 raft_consensus.cc:385] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.722205 10674 raft_consensus.cc:740] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.722452 10691 raft_consensus.cc:3060] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.723068 10674 consensus_queue.cc:260] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.725845 10674 ts_tablet_manager.cc:1434] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:37.743909 10521 raft_consensus.cc:2468] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 1.
I20260709 12:16:37.746254 10413 leader_election.cc:304] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:37.746851 10374 raft_consensus.cc:2468] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 1.
I20260709 12:16:37.747560 10660 raft_consensus.cc:2804] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:37.748297 10660 raft_consensus.cc:697] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Becoming Leader. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:37.749428 10660 consensus_queue.cc:237] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.752849 10371 raft_consensus.cc:2468] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 1.
I20260709 12:16:37.753768 10643 raft_consensus.cc:493] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.754283 10643 raft_consensus.cc:515] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.754482 10412 leader_election.cc:304] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 173593b73f1d4418957c253a8bfcb969
I20260709 12:16:37.756407 10643 leader_election.cc:290] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:37.756713 10715 raft_consensus.cc:2804] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:37.757407 10691 raft_consensus.cc:515] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.757445 10715 raft_consensus.cc:697] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Becoming Leader. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:37.761231 10691 leader_election.cc:290] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:37.761572 10715 consensus_queue.cc:237] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.764842 10447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939740892dbd49998223a0e99abde7be" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b" is_pre_election: true
I20260709 12:16:37.765231 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4daa002b4542c5a99a8a5eaa64adf6" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:37.765657 10447 raft_consensus.cc:2393] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 173593b73f1d4418957c253a8bfcb969 in current term 1: Already voted for candidate 021c49ecd5974a54a3b690aa43e71f69 in this term.
I20260709 12:16:37.765843 10448 raft_consensus.cc:3060] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.772207 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939740892dbd49998223a0e99abde7be" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:37.773790 10486 leader_election.cc:304] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969; no voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b
I20260709 12:16:37.775286 10691 raft_consensus.cc:3060] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.775396 10448 raft_consensus.cc:2468] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
I20260709 12:16:37.778136 10675 tablet_bootstrap.cc:492] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69: No bootstrap required, opened a new log
I20260709 12:16:37.778667 10675 ts_tablet_manager.cc:1403] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69: Time spent bootstrapping tablet: real 0.133s	user 0.054s	sys 0.055s
I20260709 12:16:37.779054 10489 leader_election.cc:304] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:37.779965 10643 raft_consensus.cc:2804] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:37.780421 10643 raft_consensus.cc:697] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Leader. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:37.781235 10643 consensus_queue.cc:237] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.781494 10271 catalog_manager.cc:5697] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f70ed38144548d197978cda555dc43b (127.1.248.66). New cstate: current_term: 1 leader_uuid: "5f70ed38144548d197978cda555dc43b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:37.781787 10675 raft_consensus.cc:359] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.782791 10675 raft_consensus.cc:385] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:37.783082 10675 raft_consensus.cc:740] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Initialized, Role: FOLLOWER
I20260709 12:16:37.783877 10675 consensus_queue.cc:260] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.786495 10675 ts_tablet_manager.cc:1434] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:16:37.784245 10718 raft_consensus.cc:493] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.787035 10718 raft_consensus.cc:515] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:37.789551 10718 leader_election.cc:290] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:37.790364 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69" is_pre_election: true
I20260709 12:16:37.793615 10691 raft_consensus.cc:2749] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:37.796988 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173593b73f1d4418957c253a8bfcb969" is_pre_election: true
I20260709 12:16:37.773859 10374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4daa002b4542c5a99a8a5eaa64adf6" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:37.798748 10374 raft_consensus.cc:3060] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.800112 10521 raft_consensus.cc:2393] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f70ed38144548d197978cda555dc43b in current term 1: Already voted for candidate 021c49ecd5974a54a3b690aa43e71f69 in this term.
I20260709 12:16:37.801614 10413 leader_election.cc:304] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f70ed38144548d197978cda555dc43b; no voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969
I20260709 12:16:37.802999 10660 raft_consensus.cc:3060] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.808954 10271 catalog_manager.cc:5697] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173593b73f1d4418957c253a8bfcb969 (127.1.248.67). New cstate: current_term: 1 leader_uuid: "173593b73f1d4418957c253a8bfcb969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:37.811262 10660 raft_consensus.cc:2749] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:37.811046 10374 raft_consensus.cc:2468] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 1.
I20260709 12:16:37.815994 10272 catalog_manager.cc:5697] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f70ed38144548d197978cda555dc43b (127.1.248.66). New cstate: current_term: 1 leader_uuid: "5f70ed38144548d197978cda555dc43b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:37.862116 10696 consensus_queue.cc:1048] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:37.864456 10696 consensus_queue.cc:1048] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:37.885393 10659 consensus_queue.cc:1048] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:37.902927 10696 consensus_queue.cc:1048] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:37.932601 10521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b4daa002b4542c5a99a8a5eaa64adf6"
dest_uuid: "173593b73f1d4418957c253a8bfcb969"
mode: GRACEFUL
new_leader_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:41336
I20260709 12:16:37.933358 10521 raft_consensus.cc:606] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Received request to transfer leadership to TS 021c49ecd5974a54a3b690aa43e71f69
I20260709 12:16:37.941558 10691 consensus_queue.cc:1048] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:37.942418 10447 raft_consensus.cc:3060] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:37.946233 10521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b976eb9a341499782230fa96a66b761"
dest_uuid: "173593b73f1d4418957c253a8bfcb969"
mode: GRACEFUL
new_leader_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:41336
I20260709 12:16:37.946967 10521 raft_consensus.cc:606] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Received request to transfer leadership to TS 021c49ecd5974a54a3b690aa43e71f69
I20260709 12:16:37.954661 10659 consensus_queue.cc:1048] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:37.957399 10448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60a88f4f23074e17ab636800f20c5f96"
dest_uuid: "5f70ed38144548d197978cda555dc43b"
mode: GRACEFUL
new_leader_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:43360
I20260709 12:16:37.958214 10448 raft_consensus.cc:606] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Received request to transfer leadership to TS 021c49ecd5974a54a3b690aa43e71f69
I20260709 12:16:37.969249 10371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec"
dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
mode: GRACEFUL
new_leader_uuid: "5f70ed38144548d197978cda555dc43b"
 from {username='slave'} at 127.0.0.1:41964
I20260709 12:16:37.970007 10371 raft_consensus.cc:606] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Received request to transfer leadership to TS 5f70ed38144548d197978cda555dc43b
I20260709 12:16:37.967276 10691 raft_consensus.cc:993] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969: : Instructing follower 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:37.973039 10691 raft_consensus.cc:1081] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Signalling peer 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:37.976245 10371 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b976eb9a341499782230fa96a66b761"
dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:53158
I20260709 12:16:37.976857 10371 raft_consensus.cc:493] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:37.977206 10371 raft_consensus.cc:3060] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:37.988126 10697 consensus_queue.cc:1048] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:37.994947 10693 consensus_queue.cc:1048] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:37.996116 10691 consensus_queue.cc:1048] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:37.997452 10521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed1b191848c049f9aa1a4bf2546f949a"
dest_uuid: "173593b73f1d4418957c253a8bfcb969"
mode: GRACEFUL
new_leader_uuid: "5f70ed38144548d197978cda555dc43b"
 from {username='slave'} at 127.0.0.1:41336
I20260709 12:16:37.998138 10521 raft_consensus.cc:606] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Received request to transfer leadership to TS 5f70ed38144548d197978cda555dc43b
I20260709 12:16:37.999075 10371 raft_consensus.cc:515] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.002382 10449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b976eb9a341499782230fa96a66b761" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:38.002437 10521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b976eb9a341499782230fa96a66b761" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:38.003044 10449 raft_consensus.cc:3060] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.003147 10521 raft_consensus.cc:3055] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:38.003631 10521 raft_consensus.cc:740] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:38.004453 10521 consensus_queue.cc:260] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.005439 10521 raft_consensus.cc:3060] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.007580 10374 raft_consensus.cc:1240] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Rejecting Update request from peer 173593b73f1d4418957c253a8bfcb969 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:38.017632 10374 raft_consensus.cc:3060] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:38.023537 10371 leader_election.cc:290] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Requested vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:38.026144 10371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8549089965d1470ea422dc0922dd65c8"
dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
mode: GRACEFUL
new_leader_uuid: "173593b73f1d4418957c253a8bfcb969"
 from {username='slave'} at 127.0.0.1:41964
I20260709 12:16:38.026684 10371 raft_consensus.cc:606] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Received request to transfer leadership to TS 173593b73f1d4418957c253a8bfcb969
I20260709 12:16:38.026305 10660 consensus_queue.cc:1048] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:38.032188 10449 raft_consensus.cc:2468] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 2.
I20260709 12:16:38.033087 10448 raft_consensus.cc:1240] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Rejecting Update request from peer 173593b73f1d4418957c253a8bfcb969 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:16:38.034447 10340 leader_election.cc:304] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:38.035586 10696 raft_consensus.cc:2804] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:38.036128 10696 raft_consensus.cc:697] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Becoming Leader. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:38.037019 10696 consensus_queue.cc:237] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.044960 10660 consensus_queue.cc:1048] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:38.023124 10521 raft_consensus.cc:2468] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 2.
I20260709 12:16:38.056200 10696 raft_consensus.cc:993] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69: : Instructing follower 173593b73f1d4418957c253a8bfcb969 to start an election
I20260709 12:16:38.056679 10697 raft_consensus.cc:1081] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Signalling peer 173593b73f1d4418957c253a8bfcb969 to start an election
I20260709 12:16:38.057577 10693 raft_consensus.cc:993] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969: : Instructing follower 5f70ed38144548d197978cda555dc43b to start an election
I20260709 12:16:38.058101 10693 raft_consensus.cc:1081] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Signalling peer 5f70ed38144548d197978cda555dc43b to start an election
I20260709 12:16:38.062320 10269 catalog_manager.cc:5697] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 reported cstate change: term changed from 1 to 2, leader changed from 173593b73f1d4418957c253a8bfcb969 (127.1.248.67) to 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "021c49ecd5974a54a3b690aa43e71f69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.069541 10448 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed1b191848c049f9aa1a4bf2546f949a"
dest_uuid: "5f70ed38144548d197978cda555dc43b"
 from {username='slave'} at 127.0.0.1:54556
I20260709 12:16:38.070171 10448 raft_consensus.cc:493] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.070538 10448 raft_consensus.cc:3060] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.072108 10693 consensus_queue.cc:1048] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:38.081951 10521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8549089965d1470ea422dc0922dd65c8"
dest_uuid: "173593b73f1d4418957c253a8bfcb969"
 from {username='slave'} at 127.0.0.1:59270
I20260709 12:16:38.082645 10521 raft_consensus.cc:493] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.083380 10521 raft_consensus.cc:3060] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.084431 10448 raft_consensus.cc:515] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.086661 10448 leader_election.cc:290] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 2 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:38.087401 10373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1b191848c049f9aa1a4bf2546f949a" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:38.091419 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1b191848c049f9aa1a4bf2546f949a" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:38.092051 10522 raft_consensus.cc:3055] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:38.092392 10522 raft_consensus.cc:740] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:38.093590 10522 consensus_queue.cc:260] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.094707 10522 raft_consensus.cc:3060] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.101747 10521 raft_consensus.cc:515] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.104064 10521 leader_election.cc:290] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 2 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:38.104710 10374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8549089965d1470ea422dc0922dd65c8" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:38.105161 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8549089965d1470ea422dc0922dd65c8" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:38.105399 10374 raft_consensus.cc:3055] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:38.105777 10448 raft_consensus.cc:3060] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.105830 10374 raft_consensus.cc:740] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:38.106834 10374 consensus_queue.cc:260] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.108162 10374 raft_consensus.cc:3060] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.113278 10448 raft_consensus.cc:2468] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 2.
I20260709 12:16:38.113626 10522 raft_consensus.cc:2468] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 2.
I20260709 12:16:38.114701 10413 leader_election.cc:304] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 021c49ecd5974a54a3b690aa43e71f69
I20260709 12:16:38.115607 10489 leader_election.cc:304] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:38.115875 10715 raft_consensus.cc:2804] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:38.116427 10715 raft_consensus.cc:697] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Becoming Leader. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:38.116478 10693 raft_consensus.cc:2804] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:38.116870 10374 raft_consensus.cc:2468] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 2.
I20260709 12:16:38.117128 10693 raft_consensus.cc:697] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [term 2 LEADER]: Becoming Leader. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:38.117357 10715 consensus_queue.cc:237] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.118230 10693 consensus_queue.cc:237] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.127262 10269 catalog_manager.cc:5697] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b reported cstate change: term changed from 1 to 2, leader changed from 173593b73f1d4418957c253a8bfcb969 (127.1.248.67) to 5f70ed38144548d197978cda555dc43b (127.1.248.66). New cstate: current_term: 2 leader_uuid: "5f70ed38144548d197978cda555dc43b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.128187 10271 catalog_manager.cc:5697] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 reported cstate change: term changed from 1 to 2, leader changed from 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65) to 173593b73f1d4418957c253a8bfcb969 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "173593b73f1d4418957c253a8bfcb969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:38.133404 10715 consensus_queue.cc:1048] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:38.153604 10718 consensus_queue.cc:1048] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:38.173497 10718 consensus_queue.cc:1048] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:38.181617 10660 raft_consensus.cc:993] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b: : Instructing follower 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:38.182093 10660 raft_consensus.cc:1081] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Signalling peer 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:38.184276 10371 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60a88f4f23074e17ab636800f20c5f96"
dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:41954
I20260709 12:16:38.185840 10371 raft_consensus.cc:493] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.186267 10371 raft_consensus.cc:3060] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.189779 10522 raft_consensus.cc:3060] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:38.193948 10371 raft_consensus.cc:515] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.199968 10718 consensus_queue.cc:1048] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:38.201737 10371 leader_election.cc:290] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Requested vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:38.202869 10523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a88f4f23074e17ab636800f20c5f96" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:38.204679 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a88f4f23074e17ab636800f20c5f96" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:38.205555 10448 raft_consensus.cc:3055] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:38.205910 10448 raft_consensus.cc:740] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:38.206700 10448 consensus_queue.cc:260] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.208001 10448 raft_consensus.cc:3060] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.215247 10448 raft_consensus.cc:2468] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 2.
I20260709 12:16:38.216504 10340 leader_election.cc:304] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 173593b73f1d4418957c253a8bfcb969
I20260709 12:16:38.217641 10659 raft_consensus.cc:2804] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:38.218133 10659 raft_consensus.cc:697] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Becoming Leader. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:38.218977 10659 consensus_queue.cc:237] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.227696 10269 catalog_manager.cc:5697] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 reported cstate change: term changed from 1 to 2, leader changed from 5f70ed38144548d197978cda555dc43b (127.1.248.66) to 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "021c49ecd5974a54a3b690aa43e71f69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.316120 10693 consensus_queue.cc:1048] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:38.323302 10691 raft_consensus.cc:993] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969: : Instructing follower 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:38.323846 10691 raft_consensus.cc:1081] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Signalling peer 021c49ecd5974a54a3b690aa43e71f69 to start an election
I20260709 12:16:38.326542 10374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b4daa002b4542c5a99a8a5eaa64adf6"
dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
 from {username='slave'} at 127.0.0.1:53158
I20260709 12:16:38.327172 10374 raft_consensus.cc:493] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.327610 10374 raft_consensus.cc:3060] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.332365 10691 consensus_queue.cc:1048] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:38.342320 10374 raft_consensus.cc:515] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.343560 10371 raft_consensus.cc:1240] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Rejecting Update request from peer 173593b73f1d4418957c253a8bfcb969 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:38.345422 10448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4daa002b4542c5a99a8a5eaa64adf6" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:38.346141 10448 raft_consensus.cc:3060] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.346544 10691 consensus_queue.cc:1059] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:38.347402 10691 raft_consensus.cc:3055] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:38.347858 10691 raft_consensus.cc:740] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:38.348662 10691 consensus_queue.cc:260] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.349565 10374 leader_election.cc:290] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Requested vote from peers 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:38.349730 10691 raft_consensus.cc:3060] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.350696 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4daa002b4542c5a99a8a5eaa64adf6" candidate_uuid: "021c49ecd5974a54a3b690aa43e71f69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:38.356951 10448 raft_consensus.cc:2468] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 2.
I20260709 12:16:38.358340 10340 leader_election.cc:304] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:38.359258 10659 raft_consensus.cc:2804] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:38.359783 10659 raft_consensus.cc:697] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Becoming Leader. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:38.364157 10522 raft_consensus.cc:2468] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 021c49ecd5974a54a3b690aa43e71f69 in term 2.
I20260709 12:16:38.365329 10659 consensus_queue.cc:237] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.373524 10271 catalog_manager.cc:5697] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 reported cstate change: term changed from 1 to 2, leader changed from 173593b73f1d4418957c253a8bfcb969 (127.1.248.67) to 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65). New cstate: current_term: 2 leader_uuid: "021c49ecd5974a54a3b690aa43e71f69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.387645 10697 raft_consensus.cc:993] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69: : Instructing follower 5f70ed38144548d197978cda555dc43b to start an election
I20260709 12:16:38.388159 10659 raft_consensus.cc:1081] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Signalling peer 5f70ed38144548d197978cda555dc43b to start an election
I20260709 12:16:38.389654 10448 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec"
dest_uuid: "5f70ed38144548d197978cda555dc43b"
 from {username='slave'} at 127.0.0.1:54552
I20260709 12:16:38.390311 10448 raft_consensus.cc:493] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.390727 10448 raft_consensus.cc:3060] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.398985 10448 raft_consensus.cc:515] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.401629 10448 leader_election.cc:290] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 2 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 173593b73f1d4418957c253a8bfcb969 (127.1.248.67:38627)
I20260709 12:16:38.402108 10374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:38.402341 10522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec" candidate_uuid: "5f70ed38144548d197978cda555dc43b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173593b73f1d4418957c253a8bfcb969"
I20260709 12:16:38.402858 10374 raft_consensus.cc:3055] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:38.403056 10522 raft_consensus.cc:3060] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.403223 10374 raft_consensus.cc:740] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:38.404250 10374 consensus_queue.cc:260] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.405517 10374 raft_consensus.cc:3060] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.410455 10522 raft_consensus.cc:2468] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 2.
I20260709 12:16:38.411975 10413 leader_election.cc:304] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:38.412850 10374 raft_consensus.cc:2468] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f70ed38144548d197978cda555dc43b in term 2.
I20260709 12:16:38.412945 10662 raft_consensus.cc:2804] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:38.413664 10662 raft_consensus.cc:697] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Becoming Leader. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:38.414582 10662 consensus_queue.cc:237] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:38.423627 10271 catalog_manager.cc:5697] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b reported cstate change: term changed from 1 to 2, leader changed from 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65) to 5f70ed38144548d197978cda555dc43b (127.1.248.66). New cstate: current_term: 2 leader_uuid: "5f70ed38144548d197978cda555dc43b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.559544 10522 raft_consensus.cc:1275] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:38.560775 10659 consensus_queue.cc:1048] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.575377 10448 raft_consensus.cc:1275] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:38.576890 10659 consensus_queue.cc:1048] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:38.580578 10522 raft_consensus.cc:1275] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Refusing update from remote peer 5f70ed38144548d197978cda555dc43b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:38.582089 10718 consensus_queue.cc:1048] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.601440 10371 raft_consensus.cc:3060] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.614163 10371 raft_consensus.cc:1275] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Refusing update from remote peer 5f70ed38144548d197978cda555dc43b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:38.615888 10662 consensus_queue.cc:1048] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.617835 10374 raft_consensus.cc:1275] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Refusing update from remote peer 173593b73f1d4418957c253a8bfcb969: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:38.621620 10693 consensus_queue.cc:1048] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.625169 10448 raft_consensus.cc:1275] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Refusing update from remote peer 173593b73f1d4418957c253a8bfcb969: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:38.626760 10693 consensus_queue.cc:1048] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.662084 10448 raft_consensus.cc:1275] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:38.663580 10659 consensus_queue.cc:1048] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.672063 10522 raft_consensus.cc:3060] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.687876 10522 raft_consensus.cc:1275] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:38.689152 10659 consensus_queue.cc:1048] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.892984 10448 raft_consensus.cc:1275] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:38.894446 10648 consensus_queue.cc:1048] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.895147 10522 raft_consensus.cc:1275] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Refusing update from remote peer 021c49ecd5974a54a3b690aa43e71f69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:38.896807 10648 consensus_queue.cc:1048] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.913686 10521 raft_consensus.cc:1275] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Refusing update from remote peer 5f70ed38144548d197978cda555dc43b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:38.915400 10718 consensus_queue.cc:1048] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:38.944171 10373 raft_consensus.cc:1275] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Refusing update from remote peer 5f70ed38144548d197978cda555dc43b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:38.946038 10660 consensus_queue.cc:1048] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.030591 10271 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53286:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:16:41.049224 10271 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53286:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:16:41.110054  2017 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:16:41.213948 10765 log.cc:927] Time spent T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 12:16:41.277153 10340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:41657, user_credentials={real_user=slave}} blocked reactor thread for 47279.7us
I20260709 12:16:41.313599 10801 tablet.cc:1724] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.382476 10807 tablet.cc:1724] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.404012 10813 tablet.cc:1724] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.404675 10816 tablet.cc:1724] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.407127 10814 tablet.cc:1724] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.426227 10820 tablet.cc:1724] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.394611 10810 tablet.cc:1724] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:16:41.447368 10400 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:1b976eb9a341499782230fa96a66b761)
W20260709 12:16:41.448717 10400 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:1b976eb9a341499782230fa96a66b761)
W20260709 12:16:41.464711 10338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:38627, user_credentials={real_user=slave}} blocked reactor thread for 59917.6us
I20260709 12:16:41.480886 10817 tablet.cc:1724] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:16:41.483181 10789 log.cc:927] Time spent T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:16:41.511230 10549 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:9b4daa002b4542c5a99a8a5eaa64adf6)
I20260709 12:16:41.545146 10823 tablet.cc:1724] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:16:41.577178 10412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:42929, user_credentials={real_user=slave}} blocked reactor thread for 88543us
I20260709 12:16:41.580642 10821 tablet.cc:1724] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.583365 10820 tablet.cc:1724] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.553440 10801 tablet.cc:1724] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.601886 10821 tablet.cc:1724] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.603271 10816 tablet.cc:1724] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.610589 10448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec"
dest_uuid: "5f70ed38144548d197978cda555dc43b"
mode: GRACEFUL
new_leader_uuid: "173593b73f1d4418957c253a8bfcb969"
 from {username='slave'} at 127.0.0.1:43376
I20260709 12:16:41.575215 10817 tablet.cc:1724] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.611333 10448 raft_consensus.cc:606] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Received request to transfer leadership to TS 173593b73f1d4418957c253a8bfcb969
I20260709 12:16:41.580649 10822 tablet.cc:1724] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.621956 10824 tablet.cc:1724] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.636955 10810 tablet.cc:1724] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.640230 10823 tablet.cc:1724] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.644389 10813 tablet.cc:1724] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:16:41.652230 10412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:42929, user_credentials={real_user=slave}} blocked reactor thread for 52507.1us
I20260709 12:16:41.646279 10814 tablet.cc:1724] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.674084 10824 tablet.cc:1724] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.702579 10820 tablet.cc:1724] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.704005 10821 tablet.cc:1724] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.696949 10822 tablet.cc:1724] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.702874 10814 tablet.cc:1724] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.732447 10810 tablet.cc:1724] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:41.750228 10371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "939740892dbd49998223a0e99abde7be"
dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
mode: GRACEFUL
new_leader_uuid: "173593b73f1d4418957c253a8bfcb969"
 from {username='slave'} at 127.0.0.1:41978
I20260709 12:16:41.750982 10371 raft_consensus.cc:606] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Received request to transfer leadership to TS 173593b73f1d4418957c253a8bfcb969
I20260709 12:16:41.752403  2017 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:16:41.753075  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:41.761085 10371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11baa72ed6a64d1f9ab1ee8f5f29e574"
dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
mode: GRACEFUL
new_leader_uuid: "173593b73f1d4418957c253a8bfcb969"
 from {username='slave'} at 127.0.0.1:41978
I20260709 12:16:41.761767 10371 raft_consensus.cc:606] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Received request to transfer leadership to TS 173593b73f1d4418957c253a8bfcb969
I20260709 12:16:41.761868 10271 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107: soft_deleted_table [id=6cc8b5705dc44c93ae5cb30d71f43c80] alter complete (version 1)
I20260709 12:16:41.764707 10446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49"
dest_uuid: "5f70ed38144548d197978cda555dc43b"
mode: GRACEFUL
new_leader_uuid: "173593b73f1d4418957c253a8bfcb969"
 from {username='slave'} at 127.0.0.1:43376
I20260709 12:16:41.765261 10446 raft_consensus.cc:606] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Received request to transfer leadership to TS 173593b73f1d4418957c253a8bfcb969
I20260709 12:16:41.766563  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:41.779336  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:41.856998 10828 raft_consensus.cc:993] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b: : Instructing follower 173593b73f1d4418957c253a8bfcb969 to start an election
I20260709 12:16:41.857616 10780 raft_consensus.cc:1081] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Signalling peer 173593b73f1d4418957c253a8bfcb969 to start an election
I20260709 12:16:41.859046 10522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec"
dest_uuid: "173593b73f1d4418957c253a8bfcb969"
 from {username='slave'} at 127.0.0.1:41334
I20260709 12:16:41.859714 10522 raft_consensus.cc:493] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:41.859956 10522 raft_consensus.cc:3060] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.864681 10522 raft_consensus.cc:515] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:41.866181 10522 leader_election.cc:290] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 3 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:41.867054 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:41.867209 10446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fbe8b6741d46329ab34fd5e8b39eec" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:41.867784 10371 raft_consensus.cc:3060] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.867946 10446 raft_consensus.cc:3055] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:41.868415 10446 raft_consensus.cc:740] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:41.869233 10446 consensus_queue.cc:260] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:41.870328 10446 raft_consensus.cc:3060] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.873612 10371 raft_consensus.cc:2468] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 3.
I20260709 12:16:41.874842 10486 leader_election.cc:304] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:41.875648 10799 raft_consensus.cc:2804] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:41.876070 10799 raft_consensus.cc:697] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 3 LEADER]: Becoming Leader. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:41.876937 10446 raft_consensus.cc:2468] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 3.
I20260709 12:16:41.876804 10799 consensus_queue.cc:237] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:41.883827 10269 catalog_manager.cc:5697] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 reported cstate change: term changed from 2 to 3, leader changed from 5f70ed38144548d197978cda555dc43b (127.1.248.66) to 173593b73f1d4418957c253a8bfcb969 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "173593b73f1d4418957c253a8bfcb969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:42.070668 10828 raft_consensus.cc:993] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b: : Instructing follower 173593b73f1d4418957c253a8bfcb969 to start an election
I20260709 12:16:42.071151 10780 raft_consensus.cc:1081] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Signalling peer 173593b73f1d4418957c253a8bfcb969 to start an election
I20260709 12:16:42.072566 10522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49"
dest_uuid: "173593b73f1d4418957c253a8bfcb969"
 from {username='slave'} at 127.0.0.1:41334
I20260709 12:16:42.073113 10522 raft_consensus.cc:493] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:42.073405 10522 raft_consensus.cc:3060] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:42.078480 10522 raft_consensus.cc:515] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:42.080381 10522 leader_election.cc:290] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 3 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:42.081266 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:42.082419 10371 raft_consensus.cc:3060] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:42.082368 10446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0a12c537a741a99c8330569ae05c49" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:42.083130 10446 raft_consensus.cc:3055] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:42.083487 10446 raft_consensus.cc:740] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f70ed38144548d197978cda555dc43b, State: Running, Role: LEADER
I20260709 12:16:42.084360 10446 consensus_queue.cc:260] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:42.085512 10446 raft_consensus.cc:3060] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:42.088735 10371 raft_consensus.cc:2468] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 3.
I20260709 12:16:42.089799 10486 leader_election.cc:304] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:42.090590 10799 raft_consensus.cc:2804] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:42.091229 10799 raft_consensus.cc:697] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 3 LEADER]: Becoming Leader. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:42.091341 10446 raft_consensus.cc:2468] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 3.
I20260709 12:16:42.092170 10799 consensus_queue.cc:237] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:42.093827 10803 raft_consensus.cc:993] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69: : Instructing follower 173593b73f1d4418957c253a8bfcb969 to start an election
I20260709 12:16:42.094462 10800 raft_consensus.cc:1081] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Signalling peer 173593b73f1d4418957c253a8bfcb969 to start an election
I20260709 12:16:42.095999 10522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "939740892dbd49998223a0e99abde7be"
dest_uuid: "173593b73f1d4418957c253a8bfcb969"
 from {username='slave'} at 127.0.0.1:59270
I20260709 12:16:42.096498 10522 raft_consensus.cc:493] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:42.096827 10522 raft_consensus.cc:3060] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.101390 10269 catalog_manager.cc:5697] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 reported cstate change: term changed from 2 to 3, leader changed from 5f70ed38144548d197978cda555dc43b (127.1.248.66) to 173593b73f1d4418957c253a8bfcb969 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "173593b73f1d4418957c253a8bfcb969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:42.102684 10522 raft_consensus.cc:515] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:42.104619 10522 leader_election.cc:290] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 2 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:42.105780 10446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939740892dbd49998223a0e99abde7be" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:42.106448 10446 raft_consensus.cc:3060] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.106467 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939740892dbd49998223a0e99abde7be" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:42.107138 10371 raft_consensus.cc:3055] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:42.107592 10371 raft_consensus.cc:740] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:42.108358 10371 consensus_queue.cc:260] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:42.109594 10371 raft_consensus.cc:3060] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.114835 10446 raft_consensus.cc:2468] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 2.
I20260709 12:16:42.116058 10489 leader_election.cc:304] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173593b73f1d4418957c253a8bfcb969, 5f70ed38144548d197978cda555dc43b; no voters: 
I20260709 12:16:42.116847 10371 raft_consensus.cc:2468] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 2.
I20260709 12:16:42.117352 10799 raft_consensus.cc:2804] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:42.117761 10803 raft_consensus.cc:993] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69: : Instructing follower 173593b73f1d4418957c253a8bfcb969 to start an election
I20260709 12:16:42.118228 10800 raft_consensus.cc:1081] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Signalling peer 173593b73f1d4418957c253a8bfcb969 to start an election
I20260709 12:16:42.118904 10799 raft_consensus.cc:697] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 2 LEADER]: Becoming Leader. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:42.119714 10522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11baa72ed6a64d1f9ab1ee8f5f29e574"
dest_uuid: "173593b73f1d4418957c253a8bfcb969"
 from {username='slave'} at 127.0.0.1:59270
I20260709 12:16:42.120211 10522 raft_consensus.cc:493] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:42.119793 10799 consensus_queue.cc:237] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:42.120515 10522 raft_consensus.cc:3060] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:42.126039 10522 raft_consensus.cc:515] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:42.127604 10522 leader_election.cc:290] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 3 election: Requested vote from peers 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929), 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657)
I20260709 12:16:42.128274 10371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11baa72ed6a64d1f9ab1ee8f5f29e574" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "021c49ecd5974a54a3b690aa43e71f69"
I20260709 12:16:42.128576 10446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11baa72ed6a64d1f9ab1ee8f5f29e574" candidate_uuid: "173593b73f1d4418957c253a8bfcb969" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f70ed38144548d197978cda555dc43b"
I20260709 12:16:42.128927 10371 raft_consensus.cc:3055] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:42.129240 10446 raft_consensus.cc:3060] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:42.129326 10371 raft_consensus.cc:740] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 021c49ecd5974a54a3b690aa43e71f69, State: Running, Role: LEADER
I20260709 12:16:42.130313 10371 consensus_queue.cc:260] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:42.131367 10371 raft_consensus.cc:3060] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:42.134838 10269 catalog_manager.cc:5697] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 reported cstate change: term changed from 1 to 2, leader changed from 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65) to 173593b73f1d4418957c253a8bfcb969 (127.1.248.67). New cstate: current_term: 2 leader_uuid: "173593b73f1d4418957c253a8bfcb969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:42.135984 10371 raft_consensus.cc:2468] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 3.
I20260709 12:16:42.136757 10446 raft_consensus.cc:2468] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173593b73f1d4418957c253a8bfcb969 in term 3.
I20260709 12:16:42.137004 10486 leader_election.cc:304] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 021c49ecd5974a54a3b690aa43e71f69, 173593b73f1d4418957c253a8bfcb969; no voters: 
I20260709 12:16:42.137893 10799 raft_consensus.cc:2804] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:42.138357 10799 raft_consensus.cc:697] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 3 LEADER]: Becoming Leader. State: Replica: 173593b73f1d4418957c253a8bfcb969, State: Running, Role: LEADER
I20260709 12:16:42.139261 10799 consensus_queue.cc:237] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } }
I20260709 12:16:42.149327 10269 catalog_manager.cc:5697] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 reported cstate change: term changed from 2 to 3, leader changed from 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65) to 173593b73f1d4418957c253a8bfcb969 (127.1.248.67). New cstate: current_term: 3 leader_uuid: "173593b73f1d4418957c253a8bfcb969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173593b73f1d4418957c253a8bfcb969" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 38627 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:42.364104 10448 raft_consensus.cc:1275] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 3 FOLLOWER]: Refusing update from remote peer 173593b73f1d4418957c253a8bfcb969: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:16:42.365588 10693 consensus_queue.cc:1048] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:42.374054 10371 raft_consensus.cc:1275] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 3 FOLLOWER]: Refusing update from remote peer 173593b73f1d4418957c253a8bfcb969: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:16:42.376138 10693 consensus_queue.cc:1048] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:42.498644 10371 raft_consensus.cc:1275] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 3 FOLLOWER]: Refusing update from remote peer 173593b73f1d4418957c253a8bfcb969: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.499840 10693 consensus_queue.cc:1048] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.509337 10446 raft_consensus.cc:1275] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 3 FOLLOWER]: Refusing update from remote peer 173593b73f1d4418957c253a8bfcb969: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.510886 10843 consensus_queue.cc:1048] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.524345 10371 raft_consensus.cc:1275] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Refusing update from remote peer 173593b73f1d4418957c253a8bfcb969: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:16:42.525573 10843 consensus_queue.cc:1048] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.534461 10446 raft_consensus.cc:1275] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Refusing update from remote peer 173593b73f1d4418957c253a8bfcb969: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:16:42.535787 10843 consensus_queue.cc:1048] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.565812 10371 raft_consensus.cc:1275] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 3 FOLLOWER]: Refusing update from remote peer 173593b73f1d4418957c253a8bfcb969: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.567061 10843 consensus_queue.cc:1048] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021c49ecd5974a54a3b690aa43e71f69" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.577915 10446 raft_consensus.cc:1275] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b [term 3 FOLLOWER]: Refusing update from remote peer 173593b73f1d4418957c253a8bfcb969: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.579610 10843 consensus_queue.cc:1048] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f70ed38144548d197978cda555dc43b" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.820176  2017 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:42.826454  2017 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:42.826910  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:42.831668  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:42.832055  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:16:43.246320 10303 debug-util.cc:398] Leaking SignalData structure 0x7b08000354a0 after lost signal to thread 2020
W20260709 12:16:43.247723 10303 debug-util.cc:398] Leaking SignalData structure 0x7b0800250fc0 after lost signal to thread 10306
W20260709 12:16:43.248869 10303 debug-util.cc:398] Leaking SignalData structure 0x7b0800354280 after lost signal to thread 10398
W20260709 12:16:43.249835 10303 debug-util.cc:398] Leaking SignalData structure 0x7b080038f720 after lost signal to thread 10473
W20260709 12:16:43.250793 10303 debug-util.cc:398] Leaking SignalData structure 0x7b080027d520 after lost signal to thread 10547
I20260709 12:16:43.833046  2017 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:43.839411  2017 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:43.839938  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:43.844836  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:43.845316  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:44.846369  2017 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:44.851922  2017 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:44.852388  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:44.857416  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:44.857872  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:45.859388  2017 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:45.869009  2017 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:45.869621  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:45.877449  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:45.878018  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:46.879372  2017 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:46.885561  2017 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:46.886123  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:46.892383  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:46.892827  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:47.893837  2017 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:47.900269  2017 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:47.900746  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:47.905857  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:47.906405  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:48.907413  2017 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:48.912631  2017 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:48.913100  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:48.918445  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:48.918855  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:49.919807  2017 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:49.925737  2017 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:49.926164  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:49.930783  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:49.931149  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:50.932062  2017 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:50.937098  2017 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:50.937500  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:50.942106  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:50.942466  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:52.000200  2017 tablet_server.cc:179] TabletServer@127.1.248.65:0 shutting down...
I20260709 12:16:52.044644  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:52.045496  2017 tablet_replica.cc:333] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.046497  2017 raft_consensus.cc:2243] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.047580  2017 raft_consensus.cc:2272] T f2c6a6ac6ab847f79486a416a8978e53 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.051664  2017 tablet_replica.cc:333] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.052733  2017 raft_consensus.cc:2243] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.053519  2017 raft_consensus.cc:2272] T 43f2eb5d0e914ac8902db6526e43200d P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.056687  2017 tablet_replica.cc:333] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.057303  2017 raft_consensus.cc:2243] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.058182  2017 raft_consensus.cc:2272] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.060451  2017 tablet_replica.cc:333] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.061025  2017 raft_consensus.cc:2243] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.061959  2017 raft_consensus.cc:2272] T 1b976eb9a341499782230fa96a66b761 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:52.064837 10486 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
I20260709 12:16:52.065431  2017 tablet_replica.cc:333] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.066641  2017 raft_consensus.cc:2243] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.067382  2017 raft_consensus.cc:2272] T 939740892dbd49998223a0e99abde7be P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:52.068463 10486 consensus_peers.cc:597] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 -> Peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Couldn't send request to peer 021c49ecd5974a54a3b690aa43e71f69. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.070402  2017 tablet_replica.cc:333] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.071233  2017 raft_consensus.cc:2243] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.072203  2017 raft_consensus.cc:2272] T 60a88f4f23074e17ab636800f20c5f96 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.075023  2017 tablet_replica.cc:333] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.075681  2017 raft_consensus.cc:2243] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.076278  2017 raft_consensus.cc:2272] T ed1b191848c049f9aa1a4bf2546f949a P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.079599  2017 tablet_replica.cc:333] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.080482  2017 raft_consensus.cc:2243] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.081141  2017 raft_consensus.cc:2272] T 8549089965d1470ea422dc0922dd65c8 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.083585  2017 tablet_replica.cc:333] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.084182  2017 raft_consensus.cc:2243] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.084697  2017 raft_consensus.cc:2272] T 82fbe8b6741d46329ab34fd5e8b39eec P 021c49ecd5974a54a3b690aa43e71f69 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.087129  2017 tablet_replica.cc:333] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.087769  2017 raft_consensus.cc:2243] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.088409  2017 raft_consensus.cc:2272] T 2d0a12c537a741a99c8330569ae05c49 P 021c49ecd5974a54a3b690aa43e71f69 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.090847  2017 tablet_replica.cc:333] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.091461  2017 raft_consensus.cc:2243] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.092504  2017 raft_consensus.cc:2272] T 835e250034f84f2bbc21be0bc3719256 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.095031  2017 tablet_replica.cc:333] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.095726  2017 raft_consensus.cc:2243] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.096714  2017 raft_consensus.cc:2272] T a95dabc712c5492f8bf78e2b9815abcb P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.099100  2017 tablet_replica.cc:333] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.099722  2017 raft_consensus.cc:2243] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.100181  2017 raft_consensus.cc:2272] T 2eed7f33591243b481c4e67e9fb1f099 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.102602  2017 tablet_replica.cc:333] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.103405  2017 raft_consensus.cc:2243] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.103958  2017 raft_consensus.cc:2272] T ddfcc3ae5546483b9d7bbc62da36e533 P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.106508  2017 tablet_replica.cc:333] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.107074  2017 raft_consensus.cc:2243] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.107654  2017 raft_consensus.cc:2272] T 036301d981ab4f54baaec35aaa421934 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.109917  2017 tablet_replica.cc:333] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.110463  2017 raft_consensus.cc:2243] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.111373  2017 raft_consensus.cc:2272] T 50da356720e64811bf28f97fccb37476 P 021c49ecd5974a54a3b690aa43e71f69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.113819  2017 tablet_replica.cc:333] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.114363  2017 raft_consensus.cc:2243] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.114827  2017 raft_consensus.cc:2272] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 021c49ecd5974a54a3b690aa43e71f69 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.117781  2017 tablet_replica.cc:333] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69: stopping tablet replica
I20260709 12:16:52.118302  2017 raft_consensus.cc:2243] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.118737  2017 raft_consensus.cc:2272] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 021c49ecd5974a54a3b690aa43e71f69 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:52.137295 10412 consensus_peers.cc:597] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b -> Peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Couldn't send request to peer 021c49ecd5974a54a3b690aa43e71f69. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.165495  2017 tablet_server.cc:196] TabletServer@127.1.248.65:0 shutdown complete.
I20260709 12:16:52.213336  2017 tablet_server.cc:179] TabletServer@127.1.248.66:0 shutting down...
W20260709 12:16:52.238168 10412 consensus_peers.cc:597] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b -> Peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Couldn't send request to peer 021c49ecd5974a54a3b690aa43e71f69. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:42929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:52.248771 10486 consensus_peers.cc:597] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 -> Peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Couldn't send request to peer 021c49ecd5974a54a3b690aa43e71f69. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:42929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.249284  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:52.250036  2017 tablet_replica.cc:333] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.250882  2017 raft_consensus.cc:2243] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.251582  2017 raft_consensus.cc:2272] T 60a88f4f23074e17ab636800f20c5f96 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.254590  2017 tablet_replica.cc:333] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.255261  2017 raft_consensus.cc:2243] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.256219  2017 raft_consensus.cc:2272] T 43f2eb5d0e914ac8902db6526e43200d P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:52.256836 10412 consensus_peers.cc:597] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b -> Peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Couldn't send request to peer 021c49ecd5974a54a3b690aa43e71f69. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:42929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.258999  2017 tablet_replica.cc:333] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.259893  2017 raft_consensus.cc:2243] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.260550  2017 raft_consensus.cc:2272] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:52.263710 10489 consensus_peers.cc:597] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 -> Peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Couldn't send request to peer 5f70ed38144548d197978cda555dc43b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.263983  2017 tablet_replica.cc:333] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.264765  2017 raft_consensus.cc:2243] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.265305  2017 raft_consensus.cc:2272] T 8549089965d1470ea422dc0922dd65c8 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.267752  2017 tablet_replica.cc:333] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.268389  2017 raft_consensus.cc:2243] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.269274  2017 raft_consensus.cc:2272] T ed1b191848c049f9aa1a4bf2546f949a P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.271624  2017 tablet_replica.cc:333] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.272254  2017 raft_consensus.cc:2243] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.273211  2017 raft_consensus.cc:2272] T f2c6a6ac6ab847f79486a416a8978e53 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.275842  2017 tablet_replica.cc:333] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.276461  2017 raft_consensus.cc:2243] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.277014  2017 raft_consensus.cc:2272] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 5f70ed38144548d197978cda555dc43b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.279312  2017 tablet_replica.cc:333] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.279964  2017 raft_consensus.cc:2243] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.280445  2017 raft_consensus.cc:2272] T 50da356720e64811bf28f97fccb37476 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.282881  2017 tablet_replica.cc:333] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.283564  2017 raft_consensus.cc:2243] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.284303  2017 raft_consensus.cc:2272] T 939740892dbd49998223a0e99abde7be P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.287359  2017 tablet_replica.cc:333] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
W20260709 12:16:52.287714 10486 consensus_peers.cc:597] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 -> Peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Couldn't send request to peer 021c49ecd5974a54a3b690aa43e71f69. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:42929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.288386  2017 raft_consensus.cc:2243] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.289041  2017 raft_consensus.cc:2272] T 1b976eb9a341499782230fa96a66b761 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.291373  2017 tablet_replica.cc:333] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.292119  2017 raft_consensus.cc:2243] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.292578  2017 raft_consensus.cc:2272] T 835e250034f84f2bbc21be0bc3719256 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.294656  2017 tablet_replica.cc:333] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.295214  2017 raft_consensus.cc:2243] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.295710  2017 raft_consensus.cc:2272] T a95dabc712c5492f8bf78e2b9815abcb P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.297744  2017 tablet_replica.cc:333] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.298259  2017 raft_consensus.cc:2243] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.298674  2017 raft_consensus.cc:2272] T 2eed7f33591243b481c4e67e9fb1f099 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.300882  2017 tablet_replica.cc:333] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.301398  2017 raft_consensus.cc:2243] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.302207  2017 raft_consensus.cc:2272] T ddfcc3ae5546483b9d7bbc62da36e533 P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.305020  2017 tablet_replica.cc:333] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.305738  2017 raft_consensus.cc:2243] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.306793  2017 raft_consensus.cc:2272] T 036301d981ab4f54baaec35aaa421934 P 5f70ed38144548d197978cda555dc43b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.309226  2017 tablet_replica.cc:333] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.309751  2017 raft_consensus.cc:2243] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.310602  2017 raft_consensus.cc:2272] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 5f70ed38144548d197978cda555dc43b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.312744  2017 tablet_replica.cc:333] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.313252  2017 raft_consensus.cc:2243] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.313788  2017 raft_consensus.cc:2272] T 82fbe8b6741d46329ab34fd5e8b39eec P 5f70ed38144548d197978cda555dc43b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.315984  2017 tablet_replica.cc:333] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b: stopping tablet replica
I20260709 12:16:52.316411  2017 raft_consensus.cc:2243] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.316888  2017 raft_consensus.cc:2272] T 2d0a12c537a741a99c8330569ae05c49 P 5f70ed38144548d197978cda555dc43b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:52.327365 10486 consensus_peers.cc:597] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 -> Peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Couldn't send request to peer 021c49ecd5974a54a3b690aa43e71f69. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:42929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.359962  2017 tablet_server.cc:196] TabletServer@127.1.248.66:0 shutdown complete.
W20260709 12:16:52.367977 10489 consensus_peers.cc:597] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 -> Peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Couldn't send request to peer 5f70ed38144548d197978cda555dc43b. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:41657: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:52.393362 10486 consensus_peers.cc:597] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 -> Peer 021c49ecd5974a54a3b690aa43e71f69 (127.1.248.65:42929): Couldn't send request to peer 021c49ecd5974a54a3b690aa43e71f69. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:42929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.401899  2017 tablet_server.cc:179] TabletServer@127.1.248.67:0 shutting down...
I20260709 12:16:52.430902  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:52.431806  2017 tablet_replica.cc:333] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.432823  2017 raft_consensus.cc:2243] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.433570  2017 raft_consensus.cc:2272] T 60a88f4f23074e17ab636800f20c5f96 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.435851  2017 tablet_replica.cc:333] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.436390  2017 raft_consensus.cc:2243] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.436843  2017 raft_consensus.cc:2272] T 9b4daa002b4542c5a99a8a5eaa64adf6 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.439008  2017 tablet_replica.cc:333] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.439823  2017 raft_consensus.cc:2243] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.440366  2017 raft_consensus.cc:2272] T f2c6a6ac6ab847f79486a416a8978e53 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.442544  2017 tablet_replica.cc:333] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.443094  2017 raft_consensus.cc:2243] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.444024  2017 raft_consensus.cc:2272] T 939740892dbd49998223a0e99abde7be P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.446337  2017 tablet_replica.cc:333] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.446957  2017 raft_consensus.cc:2243] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.447471  2017 raft_consensus.cc:2272] T 1b976eb9a341499782230fa96a66b761 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.450433  2017 tablet_replica.cc:333] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.451303  2017 raft_consensus.cc:2243] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.452028  2017 raft_consensus.cc:2272] T 43f2eb5d0e914ac8902db6526e43200d P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:52.453531 10489 consensus_peers.cc:597] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 -> Peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Couldn't send request to peer 5f70ed38144548d197978cda555dc43b. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:41657: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.454947  2017 tablet_replica.cc:333] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.455744  2017 raft_consensus.cc:2243] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.456305  2017 raft_consensus.cc:2272] T 87b3ea2ebbe24f64814fbbba1bf09cfd P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.458735  2017 tablet_replica.cc:333] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.459373  2017 raft_consensus.cc:2243] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.459955  2017 raft_consensus.cc:2272] T ed1b191848c049f9aa1a4bf2546f949a P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.462399  2017 tablet_replica.cc:333] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.463105  2017 raft_consensus.cc:2243] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.464172  2017 raft_consensus.cc:2272] T 8549089965d1470ea422dc0922dd65c8 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:52.466640 10489 consensus_peers.cc:597] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 -> Peer 5f70ed38144548d197978cda555dc43b (127.1.248.66:41657): Couldn't send request to peer 5f70ed38144548d197978cda555dc43b. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:41657: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.467098  2017 tablet_replica.cc:333] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.467886  2017 raft_consensus.cc:2243] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.468828  2017 raft_consensus.cc:2272] T 82fbe8b6741d46329ab34fd5e8b39eec P 173593b73f1d4418957c253a8bfcb969 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.471388  2017 tablet_replica.cc:333] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.472090  2017 raft_consensus.cc:2243] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.472992  2017 raft_consensus.cc:2272] T 2d0a12c537a741a99c8330569ae05c49 P 173593b73f1d4418957c253a8bfcb969 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.475209  2017 tablet_replica.cc:333] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.475819  2017 raft_consensus.cc:2243] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.476334  2017 raft_consensus.cc:2272] T a95dabc712c5492f8bf78e2b9815abcb P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.478763  2017 tablet_replica.cc:333] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.479380  2017 raft_consensus.cc:2243] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.480014  2017 raft_consensus.cc:2272] T 835e250034f84f2bbc21be0bc3719256 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.482277  2017 tablet_replica.cc:333] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.482865  2017 raft_consensus.cc:2243] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.483397  2017 raft_consensus.cc:2272] T 036301d981ab4f54baaec35aaa421934 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.485677  2017 tablet_replica.cc:333] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.486279  2017 raft_consensus.cc:2243] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.486816  2017 raft_consensus.cc:2272] T ddfcc3ae5546483b9d7bbc62da36e533 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.489078  2017 tablet_replica.cc:333] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.489657  2017 raft_consensus.cc:2243] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.490568  2017 raft_consensus.cc:2272] T 2eed7f33591243b481c4e67e9fb1f099 P 173593b73f1d4418957c253a8bfcb969 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.492951  2017 tablet_replica.cc:333] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.493522  2017 raft_consensus.cc:2243] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.494046  2017 raft_consensus.cc:2272] T 50da356720e64811bf28f97fccb37476 P 173593b73f1d4418957c253a8bfcb969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.496172  2017 tablet_replica.cc:333] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969: stopping tablet replica
I20260709 12:16:52.496698  2017 raft_consensus.cc:2243] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.497645  2017 raft_consensus.cc:2272] T 11baa72ed6a64d1f9ab1ee8f5f29e574 P 173593b73f1d4418957c253a8bfcb969 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.558868  2017 tablet_server.cc:196] TabletServer@127.1.248.67:0 shutdown complete.
I20260709 12:16:52.596194  2017 master.cc:562] Master@127.1.248.126:38283 shutting down...
I20260709 12:16:52.622818  2017 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.623494  2017 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.623842  2017 tablet_replica.cc:333] T 00000000000000000000000000000000 P 40139625d4174d37a16225fc485aa107: stopping tablet replica
I20260709 12:16:52.663048  2017 master.cc:584] Master@127.1.248.126:38283 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21328 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:16:52.717412  2017 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.248.126:39979
I20260709 12:16:52.718613  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:52.724506 10872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.724560 10873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.725744 10875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:52.727353  2017 server_base.cc:1061] running on GCE node
I20260709 12:16:52.728547  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:52.728729  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:52.728845  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599412728834 us; error 0 us; skew 500 ppm
I20260709 12:16:52.729292  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:52.731695  2017 webserver.cc:533] Webserver started at http://127.1.248.126:41397/ using document root <none> and password file <none>
I20260709 12:16:52.732128  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:52.732280  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:52.732491  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:52.733592  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/master-0-root/instance:
uuid: "b0567c0499094425b8db45d4c7c6bd57"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-z9f9"
I20260709 12:16:52.738279  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:16:52.741674 10880 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.742403  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:52.742688  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/master-0-root
uuid: "b0567c0499094425b8db45d4c7c6bd57"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-z9f9"
I20260709 12:16:52.742923  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:52.759331  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:52.760670  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:52.802496  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.126:39979
I20260709 12:16:52.802596 10931 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.126:39979 every 8 connection(s)
I20260709 12:16:52.806543 10932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.817895 10932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57: Bootstrap starting.
I20260709 12:16:52.822825 10932 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.827056 10932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57: No bootstrap required, opened a new log
I20260709 12:16:52.829319 10932 raft_consensus.cc:359] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0567c0499094425b8db45d4c7c6bd57" member_type: VOTER }
I20260709 12:16:52.829741 10932 raft_consensus.cc:385] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.829913 10932 raft_consensus.cc:740] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0567c0499094425b8db45d4c7c6bd57, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.830410 10932 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0567c0499094425b8db45d4c7c6bd57" member_type: VOTER }
I20260709 12:16:52.830839 10932 raft_consensus.cc:399] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:52.831022 10932 raft_consensus.cc:493] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:52.831229 10932 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:52.835703 10932 raft_consensus.cc:515] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0567c0499094425b8db45d4c7c6bd57" member_type: VOTER }
I20260709 12:16:52.836154 10932 leader_election.cc:304] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0567c0499094425b8db45d4c7c6bd57; no voters: 
I20260709 12:16:52.837177 10932 leader_election.cc:290] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:52.837592 10935 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:52.838954 10935 raft_consensus.cc:697] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [term 1 LEADER]: Becoming Leader. State: Replica: b0567c0499094425b8db45d4c7c6bd57, State: Running, Role: LEADER
I20260709 12:16:52.839715 10935 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0567c0499094425b8db45d4c7c6bd57" member_type: VOTER }
I20260709 12:16:52.840206 10932 sys_catalog.cc:565] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:52.843319 10936 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0567c0499094425b8db45d4c7c6bd57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0567c0499094425b8db45d4c7c6bd57" member_type: VOTER } }
I20260709 12:16:52.843974 10936 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:52.844240 10937 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0567c0499094425b8db45d4c7c6bd57. Latest consensus state: current_term: 1 leader_uuid: "b0567c0499094425b8db45d4c7c6bd57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0567c0499094425b8db45d4c7c6bd57" member_type: VOTER } }
I20260709 12:16:52.845824 10937 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:52.850178 10940 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:52.858578 10940 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:52.859568  2017 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:52.867648 10940 catalog_manager.cc:1383] Generated new cluster ID: 340920e6f40f4d7bb8df2b979e157289
I20260709 12:16:52.867998 10940 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:52.884555 10940 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:52.885878 10940 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:52.896992 10940 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57: Generated new TSK 0
I20260709 12:16:52.897635 10940 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:52.925921  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:52.932142 10953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.933321 10954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:52.934988  2017 server_base.cc:1061] running on GCE node
W20260709 12:16:52.934969 10956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:52.936460  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:52.936657  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:52.936784  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599412936773 us; error 0 us; skew 500 ppm
I20260709 12:16:52.937439  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:52.939934  2017 webserver.cc:533] Webserver started at http://127.1.248.65:33925/ using document root <none> and password file <none>
I20260709 12:16:52.940377  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:52.940532  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:52.940745  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:52.941867  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-0-root/instance:
uuid: "667de35363974f9da69460a1a11fcd7a"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-z9f9"
I20260709 12:16:52.946635  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:16:52.949949 10961 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.950711  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:52.950999  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-0-root
uuid: "667de35363974f9da69460a1a11fcd7a"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-z9f9"
I20260709 12:16:52.951297  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:52.965045  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:52.966271  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:52.967849  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:52.970072  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:52.970307  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.970541  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:52.970721  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:53.011201  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.65:37145
I20260709 12:16:53.011307 11023 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.65:37145 every 8 connection(s)
I20260709 12:16:53.016275  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:53.024183 11028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:53.026688 11029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:53.029676 11031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:53.031409  2017 server_base.cc:1061] running on GCE node
I20260709 12:16:53.032042 11024 heartbeater.cc:344] Connected to a master server at 127.1.248.126:39979
I20260709 12:16:53.032485 11024 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:53.032612  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:53.032928  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:53.033106  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599413033086 us; error 0 us; skew 500 ppm
I20260709 12:16:53.033383 11024 heartbeater.cc:507] Master 127.1.248.126:39979 requested a full tablet report, sending...
I20260709 12:16:53.033746  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:53.035746 10897 ts_manager.cc:194] Registered new tserver with Master: 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145)
I20260709 12:16:53.036393  2017 webserver.cc:533] Webserver started at http://127.1.248.66:40945/ using document root <none> and password file <none>
I20260709 12:16:53.036947  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:53.037161  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:53.037422  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:53.037801 10897 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44724
I20260709 12:16:53.038610  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-1-root/instance:
uuid: "0c5eee91948c4ef6ae617f1a4365c327"
format_stamp: "Formatted at 2026-07-09 12:16:53 on dist-test-slave-z9f9"
I20260709 12:16:53.043373  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:16:53.046916 11036 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:53.047776  2017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:53.048074  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-1-root
uuid: "0c5eee91948c4ef6ae617f1a4365c327"
format_stamp: "Formatted at 2026-07-09 12:16:53 on dist-test-slave-z9f9"
I20260709 12:16:53.048365  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:53.059300  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:53.060557  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:53.061973  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:53.064260  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:53.064486  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:53.064724  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:53.064893  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:53.105877  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.66:42597
I20260709 12:16:53.105994 11098 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.66:42597 every 8 connection(s)
I20260709 12:16:53.110836  2017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:53.118424 11102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:53.120095 11103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:53.122078  2017 server_base.cc:1061] running on GCE node
W20260709 12:16:53.122426 11105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:53.123539  2017 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:16:53.123589 11099 heartbeater.cc:344] Connected to a master server at 127.1.248.126:39979
W20260709 12:16:53.123876  2017 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:53.124082 11099 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:53.124114  2017 hybrid_clock.cc:648] HybridClock initialized: now 1783599413124092 us; error 0 us; skew 500 ppm
I20260709 12:16:53.125155  2017 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:53.125196 11099 heartbeater.cc:507] Master 127.1.248.126:39979 requested a full tablet report, sending...
I20260709 12:16:53.127782 10897 ts_manager.cc:194] Registered new tserver with Master: 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:53.128232  2017 webserver.cc:533] Webserver started at http://127.1.248.67:46853/ using document root <none> and password file <none>
I20260709 12:16:53.128767  2017 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:53.128990  2017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:53.129254  2017 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:53.129410 10897 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44732
I20260709 12:16:53.130695  2017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-2-root/instance:
uuid: "72b516593c964645a094a1d75249794c"
format_stamp: "Formatted at 2026-07-09 12:16:53 on dist-test-slave-z9f9"
I20260709 12:16:53.135321  2017 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:16:53.139238 11110 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:53.140130  2017 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:16:53.140457  2017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-2-root
uuid: "72b516593c964645a094a1d75249794c"
format_stamp: "Formatted at 2026-07-09 12:16:53 on dist-test-slave-z9f9"
I20260709 12:16:53.140755  2017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskHassxH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599108657414-2017-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:53.165094  2017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:53.166319  2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:53.167797  2017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:53.170040  2017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:53.170264  2017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:53.170496  2017 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:53.170691  2017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:53.211002  2017 rpc_server.cc:307] RPC server started. Bound to: 127.1.248.67:42445
I20260709 12:16:53.211105 11172 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.248.67:42445 every 8 connection(s)
I20260709 12:16:53.225711 11173 heartbeater.cc:344] Connected to a master server at 127.1.248.126:39979
I20260709 12:16:53.226195 11173 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:53.227018 11173 heartbeater.cc:507] Master 127.1.248.126:39979 requested a full tablet report, sending...
I20260709 12:16:53.229174 10897 ts_manager.cc:194] Registered new tserver with Master: 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:53.229341  2017 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015344352s
I20260709 12:16:53.230641 10897 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44746
I20260709 12:16:53.255800 10897 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44760:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:53.258596 10897 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:53.326573 10989 tablet_service.cc:1511] Processing CreateTablet for tablet 42a94ce16cb54e3dac0eaca3be800878 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:53.328099 10989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a94ce16cb54e3dac0eaca3be800878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.332646 10988 tablet_service.cc:1511] Processing CreateTablet for tablet 686fbecbc317411aaa96587b3515a573 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:53.334187 10988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 686fbecbc317411aaa96587b3515a573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.336081 10987 tablet_service.cc:1511] Processing CreateTablet for tablet c7a2cae1159243e0ad6a4da92a55c539 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:53.337541 10987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a2cae1159243e0ad6a4da92a55c539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.340369 10986 tablet_service.cc:1511] Processing CreateTablet for tablet 31fe758f4455438dbf0b1c4b81e279f5 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:53.341784 10986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31fe758f4455438dbf0b1c4b81e279f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.349015 10985 tablet_service.cc:1511] Processing CreateTablet for tablet b37f7e31a966476690133d6ead87c211 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:53.350445 10985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37f7e31a966476690133d6ead87c211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.353523 10984 tablet_service.cc:1511] Processing CreateTablet for tablet 926d5800295e45f892c7c5337ef16cfa (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:53.354975 10984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926d5800295e45f892c7c5337ef16cfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.356618 11137 tablet_service.cc:1511] Processing CreateTablet for tablet 686fbecbc317411aaa96587b3515a573 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:53.357163 10983 tablet_service.cc:1511] Processing CreateTablet for tablet 694ac3e0e6ac402f81ba5d2e66a5f020 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:53.358058 11137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 686fbecbc317411aaa96587b3515a573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.358485 10983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 694ac3e0e6ac402f81ba5d2e66a5f020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.360606 11135 tablet_service.cc:1511] Processing CreateTablet for tablet 31fe758f4455438dbf0b1c4b81e279f5 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:53.362008 11135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31fe758f4455438dbf0b1c4b81e279f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.361718 11133 tablet_service.cc:1511] Processing CreateTablet for tablet 926d5800295e45f892c7c5337ef16cfa (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:53.363088 11133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926d5800295e45f892c7c5337ef16cfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.363813 11064 tablet_service.cc:1511] Processing CreateTablet for tablet 42a94ce16cb54e3dac0eaca3be800878 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:53.364660 11132 tablet_service.cc:1511] Processing CreateTablet for tablet 694ac3e0e6ac402f81ba5d2e66a5f020 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:53.365199 11064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a94ce16cb54e3dac0eaca3be800878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.365985 11132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 694ac3e0e6ac402f81ba5d2e66a5f020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.367295 11056 tablet_service.cc:1511] Processing CreateTablet for tablet c7b660204384458b8e72a9ff2d272fbe (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:53.368680 11057 tablet_service.cc:1511] Processing CreateTablet for tablet 7ecc18d3bf7748c5aea3b0caf2b289d1 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:53.369131 11056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b660204384458b8e72a9ff2d272fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.370114 11057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ecc18d3bf7748c5aea3b0caf2b289d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.373771 11131 tablet_service.cc:1511] Processing CreateTablet for tablet 7ecc18d3bf7748c5aea3b0caf2b289d1 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:53.375680 11131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ecc18d3bf7748c5aea3b0caf2b289d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.397274 10982 tablet_service.cc:1511] Processing CreateTablet for tablet 7ecc18d3bf7748c5aea3b0caf2b289d1 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:53.398829 10982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ecc18d3bf7748c5aea3b0caf2b289d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.399271 11130 tablet_service.cc:1511] Processing CreateTablet for tablet c7b660204384458b8e72a9ff2d272fbe (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:53.404201 11138 tablet_service.cc:1511] Processing CreateTablet for tablet 42a94ce16cb54e3dac0eaca3be800878 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:53.404947 11062 tablet_service.cc:1511] Processing CreateTablet for tablet c7a2cae1159243e0ad6a4da92a55c539 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:53.360608 11134 tablet_service.cc:1511] Processing CreateTablet for tablet b37f7e31a966476690133d6ead87c211 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:53.408519 11059 tablet_service.cc:1511] Processing CreateTablet for tablet 926d5800295e45f892c7c5337ef16cfa (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:53.410751 11136 tablet_service.cc:1511] Processing CreateTablet for tablet c7a2cae1159243e0ad6a4da92a55c539 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:53.416501 11058 tablet_service.cc:1511] Processing CreateTablet for tablet 694ac3e0e6ac402f81ba5d2e66a5f020 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:53.418780 10981 tablet_service.cc:1511] Processing CreateTablet for tablet c7b660204384458b8e72a9ff2d272fbe (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:53.420224 10981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b660204384458b8e72a9ff2d272fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.422000 11061 tablet_service.cc:1511] Processing CreateTablet for tablet 31fe758f4455438dbf0b1c4b81e279f5 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:53.427546 11063 tablet_service.cc:1511] Processing CreateTablet for tablet 686fbecbc317411aaa96587b3515a573 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:53.407214 11060 tablet_service.cc:1511] Processing CreateTablet for tablet b37f7e31a966476690133d6ead87c211 (DEFAULT_TABLE table=test-workload [id=31bf3c878aab439dae82b46a4dba846c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:53.430163 11130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b660204384458b8e72a9ff2d272fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.431250 11136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a2cae1159243e0ad6a4da92a55c539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.434057 11062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a2cae1159243e0ad6a4da92a55c539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.434794 11061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31fe758f4455438dbf0b1c4b81e279f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.435791 11059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926d5800295e45f892c7c5337ef16cfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.439747 11058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 694ac3e0e6ac402f81ba5d2e66a5f020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.454990 11063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 686fbecbc317411aaa96587b3515a573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.472620 11134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37f7e31a966476690133d6ead87c211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.496120 11060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37f7e31a966476690133d6ead87c211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.502041 11138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a94ce16cb54e3dac0eaca3be800878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.515357 11188 tablet_bootstrap.cc:492] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:53.536628 11188 tablet_bootstrap.cc:654] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.580592 11190 tablet_bootstrap.cc:492] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:53.629403 11188 tablet_bootstrap.cc:492] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:53.630046 11188 ts_tablet_manager.cc:1403] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.115s	user 0.009s	sys 0.004s
I20260709 12:16:53.670691 11190 tablet_bootstrap.cc:654] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.681255 11190 tablet_bootstrap.cc:492] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:53.681571 11191 tablet_bootstrap.cc:492] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:53.681833 11190 ts_tablet_manager.cc:1403] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.102s	user 0.007s	sys 0.010s
I20260709 12:16:53.685240 11190 raft_consensus.cc:359] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.686072 11190 raft_consensus.cc:385] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.686403 11190 raft_consensus.cc:740] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.687191 11190 consensus_queue.cc:260] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.688510 11191 tablet_bootstrap.cc:654] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.696456 11190 ts_tablet_manager.cc:1434] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.004s
I20260709 12:16:53.697800 11190 tablet_bootstrap.cc:492] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:53.702491 11191 tablet_bootstrap.cc:492] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:53.703081 11191 ts_tablet_manager.cc:1403] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.004s
I20260709 12:16:53.706310 11191 raft_consensus.cc:359] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.707067 11191 raft_consensus.cc:385] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.707369 11191 raft_consensus.cc:740] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.708264 11191 consensus_queue.cc:260] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.709113 11190 tablet_bootstrap.cc:654] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.715466 11190 tablet_bootstrap.cc:492] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:53.716022 11190 ts_tablet_manager.cc:1403] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 12:16:53.717696 11191 ts_tablet_manager.cc:1434] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.004s
I20260709 12:16:53.718537 11173 heartbeater.cc:499] Master 127.1.248.126:39979 was elected leader, sending a full tablet report...
I20260709 12:16:53.718842 11190 raft_consensus.cc:359] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.719609 11190 raft_consensus.cc:385] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.719815 11191 tablet_bootstrap.cc:492] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:53.719901 11190 raft_consensus.cc:740] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.720913 11190 consensus_queue.cc:260] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.722987 11190 ts_tablet_manager.cc:1434] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:16:53.727465 11191 tablet_bootstrap.cc:654] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.733707 11191 tablet_bootstrap.cc:492] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:53.734604 11191 ts_tablet_manager.cc:1403] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:16:53.737478 11191 raft_consensus.cc:359] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.738238 11191 raft_consensus.cc:385] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.738823 11191 raft_consensus.cc:740] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.739517 11191 consensus_queue.cc:260] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.741827 11191 ts_tablet_manager.cc:1434] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:53.743053 11191 tablet_bootstrap.cc:492] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:53.749125 11191 tablet_bootstrap.cc:654] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.755141 11191 tablet_bootstrap.cc:492] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:53.755676 11191 ts_tablet_manager.cc:1403] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:16:53.758571 11191 raft_consensus.cc:359] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.759321 11191 raft_consensus.cc:385] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.759660 11191 raft_consensus.cc:740] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.760705 11190 tablet_bootstrap.cc:492] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:53.760371 11191 consensus_queue.cc:260] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.762735 11191 ts_tablet_manager.cc:1434] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:16:53.768249 11190 tablet_bootstrap.cc:654] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.770951 11195 raft_consensus.cc:493] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.771544 11195 raft_consensus.cc:515] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.772253 11191 tablet_bootstrap.cc:492] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c: Bootstrap starting.
W20260709 12:16:53.774034 11174 tablet.cc:2406] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:53.779759 11191 tablet_bootstrap.cc:654] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.782802 11190 tablet_bootstrap.cc:492] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:53.783388 11190 ts_tablet_manager.cc:1403] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.009s
I20260709 12:16:53.785354 11191 tablet_bootstrap.cc:492] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:53.785969 11191 ts_tablet_manager.cc:1403] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.009s
I20260709 12:16:53.786772 11190 raft_consensus.cc:359] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.787542 11195 leader_election.cc:290] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:53.787595 11190 raft_consensus.cc:385] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.785997 11099 heartbeater.cc:499] Master 127.1.248.126:39979 was elected leader, sending a full tablet report...
I20260709 12:16:53.791715 11190 raft_consensus.cc:740] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.792754 11190 consensus_queue.cc:260] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.795152 11190 ts_tablet_manager.cc:1434] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:16:53.797125 11190 tablet_bootstrap.cc:492] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:53.789335 11191 raft_consensus.cc:359] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.798667 11191 raft_consensus.cc:385] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.799010 11191 raft_consensus.cc:740] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.799862 11191 consensus_queue.cc:260] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.802030 11191 ts_tablet_manager.cc:1434] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:16:53.802914 11191 tablet_bootstrap.cc:492] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:53.803877 11190 tablet_bootstrap.cc:654] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.809317 11191 tablet_bootstrap.cc:654] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.814715 11190 tablet_bootstrap.cc:492] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:53.815172 11190 ts_tablet_manager.cc:1403] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:16:53.820515 11190 raft_consensus.cc:359] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.821130 11190 raft_consensus.cc:385] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.821388 11190 raft_consensus.cc:740] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.822046 11190 consensus_queue.cc:260] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.824304 11190 ts_tablet_manager.cc:1434] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:16:53.825414 11190 tablet_bootstrap.cc:492] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:53.826889 11191 tablet_bootstrap.cc:492] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:53.827553 11191 ts_tablet_manager.cc:1403] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.015s
I20260709 12:16:53.830463 11191 raft_consensus.cc:359] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.831022 11191 raft_consensus.cc:385] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.831277 11191 raft_consensus.cc:740] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.831939 11190 tablet_bootstrap.cc:654] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.831933 11191 consensus_queue.cc:260] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.834863 11191 ts_tablet_manager.cc:1434] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:53.837689 11190 tablet_bootstrap.cc:492] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:53.838256 11190 ts_tablet_manager.cc:1403] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 12:16:53.841183 11190 raft_consensus.cc:359] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.841866 11190 raft_consensus.cc:385] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.842183 11190 raft_consensus.cc:740] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.843115 11190 consensus_queue.cc:260] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.845577 11190 ts_tablet_manager.cc:1434] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:53.846414 11190 tablet_bootstrap.cc:492] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:53.847900 11191 tablet_bootstrap.cc:492] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:53.853111 11190 tablet_bootstrap.cc:654] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.854864 11191 tablet_bootstrap.cc:654] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:53.868898 10945 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:53.869477 11191 tablet_bootstrap.cc:492] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:53.870086 11191 ts_tablet_manager.cc:1403] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 12:16:53.882468 11190 tablet_bootstrap.cc:492] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:53.883100 11190 ts_tablet_manager.cc:1403] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.014s
I20260709 12:16:53.884507 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31fe758f4455438dbf0b1c4b81e279f5" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:53.885341 11074 raft_consensus.cc:2468] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 0.
I20260709 12:16:53.886771 11113 leader_election.cc:304] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:53.887643 11195 raft_consensus.cc:2804] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:53.888049 11195 raft_consensus.cc:493] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:53.888394 11195 raft_consensus.cc:3060] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.889674 11208 raft_consensus.cc:493] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.890213 11208 raft_consensus.cc:515] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.893437 11193 raft_consensus.cc:493] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.893453 11208 leader_election.cc:290] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:53.894217 11208 raft_consensus.cc:493] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.894076 11193 raft_consensus.cc:515] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.894731 11208 raft_consensus.cc:515] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.896358 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b660204384458b8e72a9ff2d272fbe" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:53.897109 11074 raft_consensus.cc:2468] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 0.
I20260709 12:16:53.897567 11191 raft_consensus.cc:359] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.898324 11191 raft_consensus.cc:385] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.898406 11113 leader_election.cc:304] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:53.898663 11191 raft_consensus.cc:740] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.898469 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f7e31a966476690133d6ead87c211" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:53.899287 11208 leader_election.cc:290] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:53.899886 11208 raft_consensus.cc:2804] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:53.899638 11191 consensus_queue.cc:260] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.900275 11208 raft_consensus.cc:493] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:53.900633 11208 raft_consensus.cc:3060] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.902071 11191 ts_tablet_manager.cc:1434] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:16:53.903213 11191 tablet_bootstrap.cc:492] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:53.899521 11074 raft_consensus.cc:2468] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 0.
I20260709 12:16:53.904289 11188 raft_consensus.cc:359] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.907897 11190 raft_consensus.cc:359] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.908828 11208 raft_consensus.cc:515] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.909379 11193 leader_election.cc:290] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:53.914811 11195 raft_consensus.cc:515] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.920795 11190 raft_consensus.cc:385] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.922164 11190 raft_consensus.cc:740] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.922966 11190 consensus_queue.cc:260] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.925727 11190 ts_tablet_manager.cc:1434] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:16:53.924036 11195 leader_election.cc:290] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:53.923897 11113 leader_election.cc:304] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:53.929076 11190 tablet_bootstrap.cc:492] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:53.924424 11208 leader_election.cc:290] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:53.930030 11208 raft_consensus.cc:2804] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:53.930437 11208 raft_consensus.cc:493] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:53.930841 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b660204384458b8e72a9ff2d272fbe" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:53.931527 11073 raft_consensus.cc:3060] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.934300 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31fe758f4455438dbf0b1c4b81e279f5" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:53.934985 11074 raft_consensus.cc:3060] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.919632 11188 raft_consensus.cc:385] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.935678 11188 raft_consensus.cc:740] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.936683 11188 consensus_queue.cc:260] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.937727 11190 tablet_bootstrap.cc:654] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.942085 11024 heartbeater.cc:499] Master 127.1.248.126:39979 was elected leader, sending a full tablet report...
I20260709 12:16:53.946874 11210 raft_consensus.cc:493] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.947559 11210 raft_consensus.cc:515] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.949399 11190 tablet_bootstrap.cc:492] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:53.949944 11190 ts_tablet_manager.cc:1403] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 12:16:53.950757 11188 ts_tablet_manager.cc:1434] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.320s	user 0.017s	sys 0.002s
I20260709 12:16:53.951851 11188 tablet_bootstrap.cc:492] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:53.952979 11190 raft_consensus.cc:359] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.953775 11190 raft_consensus.cc:385] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.954071 11190 raft_consensus.cc:740] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.954982 11190 consensus_queue.cc:260] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.955782 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b660204384458b8e72a9ff2d272fbe" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:53.957273 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31fe758f4455438dbf0b1c4b81e279f5" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:53.957690 11190 ts_tablet_manager.cc:1434] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:53.958009 10995 raft_consensus.cc:3060] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.930873 11208 raft_consensus.cc:3060] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.958863 11190 tablet_bootstrap.cc:492] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:53.958768 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f7e31a966476690133d6ead87c211" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:53.957178 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31fe758f4455438dbf0b1c4b81e279f5" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:53.957923 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b660204384458b8e72a9ff2d272fbe" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:53.966270 11190 tablet_bootstrap.cc:654] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.967355 10995 raft_consensus.cc:2468] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 1.
I20260709 12:16:53.967695 11074 raft_consensus.cc:2468] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 1.
I20260709 12:16:53.966820 11208 raft_consensus.cc:515] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
W20260709 12:16:53.968652 11114 leader_election.cc:343] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:53.969630 11114 leader_election.cc:343] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.970409 11195 raft_consensus.cc:493] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.976488 11195 raft_consensus.cc:515] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:53.978819 11195 leader_election.cc:290] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
W20260709 12:16:53.972154 11114 leader_election.cc:343] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.985677 11188 tablet_bootstrap.cc:654] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.973343 11113 leader_election.cc:304] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:53.974633 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f7e31a966476690133d6ead87c211" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:53.987567 11074 raft_consensus.cc:3060] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.970830 11208 leader_election.cc:290] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:53.984193 11210 leader_election.cc:290] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:53.946029 11191 tablet_bootstrap.cc:654] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.994871 11210 raft_consensus.cc:2804] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:53.995383 11210 raft_consensus.cc:697] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Leader. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:53.996423 11210 consensus_queue.cc:237] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.001470 11072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926d5800295e45f892c7c5337ef16cfa" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:54.002152 11071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecc18d3bf7748c5aea3b0caf2b289d1" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:54.003336 11071 raft_consensus.cc:2468] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 0.
W20260709 12:16:54.005095 11113 leader_election.cc:343] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.006168 11113 leader_election.cc:304] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:54.007650 11208 raft_consensus.cc:2804] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.007777 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926d5800295e45f892c7c5337ef16cfa" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:54.008249 11208 raft_consensus.cc:493] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.008809 11208 raft_consensus.cc:3060] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.010406 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecc18d3bf7748c5aea3b0caf2b289d1" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
W20260709 12:16:54.011912 11114 leader_election.cc:343] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.012507 11114 leader_election.cc:304] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72b516593c964645a094a1d75249794c; no voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.013825 11195 raft_consensus.cc:2749] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.014729 11073 raft_consensus.cc:2468] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 1.
W20260709 12:16:54.015460 11114 leader_election.cc:343] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.975834 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f7e31a966476690133d6ead87c211" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
W20260709 12:16:54.021837 11114 leader_election.cc:343] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.022998 11113 leader_election.cc:304] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.026676 11195 raft_consensus.cc:2804] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.027504 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694ac3e0e6ac402f81ba5d2e66a5f020" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
W20260709 12:16:54.029279 11040 leader_election.cc:343] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.029019 11208 raft_consensus.cc:515] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.032056 11191 tablet_bootstrap.cc:492] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:54.033013 11191 ts_tablet_manager.cc:1403] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.007s
I20260709 12:16:54.035643 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecc18d3bf7748c5aea3b0caf2b289d1" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:54.036160 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694ac3e0e6ac402f81ba5d2e66a5f020" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:54.036396 11208 leader_election.cc:290] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:54.036976 11148 raft_consensus.cc:2468] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 0.
W20260709 12:16:54.037705 11114 leader_election.cc:343] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.040184 11037 leader_election.cc:304] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.041515 11193 raft_consensus.cc:2804] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.042013 11193 raft_consensus.cc:493] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.041693 11191 raft_consensus.cc:359] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.042459 11193 raft_consensus.cc:3060] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.042913 11191 raft_consensus.cc:385] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.043344 11191 raft_consensus.cc:740] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.046130 11191 consensus_queue.cc:260] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.039127 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecc18d3bf7748c5aea3b0caf2b289d1" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:54.049788 11073 raft_consensus.cc:3060] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.018340 11074 raft_consensus.cc:2468] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 1.
I20260709 12:16:54.055488 11193 raft_consensus.cc:515] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.057855 11191 ts_tablet_manager.cc:1434] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:16:54.059494 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694ac3e0e6ac402f81ba5d2e66a5f020" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:54.061187 11190 tablet_bootstrap.cc:492] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
W20260709 12:16:54.061283 11040 leader_election.cc:343] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.062876 11193 leader_election.cc:290] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.062037 11190 ts_tablet_manager.cc:1403] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.103s	user 0.039s	sys 0.031s
I20260709 12:16:54.065095 11191 tablet_bootstrap.cc:492] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:54.065279 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694ac3e0e6ac402f81ba5d2e66a5f020" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:54.065953 11148 raft_consensus.cc:3060] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.066556 10894 catalog_manager.cc:5697] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c reported cstate change: term changed from 0 to 1, leader changed from <none> to 72b516593c964645a094a1d75249794c (127.1.248.67). New cstate: current_term: 1 leader_uuid: "72b516593c964645a094a1d75249794c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:54.070242 11073 raft_consensus.cc:2468] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 1.
I20260709 12:16:54.066556 11190 raft_consensus.cc:359] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.074698 11148 raft_consensus.cc:2468] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 1.
I20260709 12:16:54.075513 11113 leader_election.cc:304] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.077016 11191 tablet_bootstrap.cc:654] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.077301 11190 raft_consensus.cc:385] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.077770 11190 raft_consensus.cc:740] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.078282 11037 leader_election.cc:304] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.078738 11190 consensus_queue.cc:260] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.079639 11193 raft_consensus.cc:2804] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.076131 11195 raft_consensus.cc:697] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Leader. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:54.081822 11195 consensus_queue.cc:237] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.083851 11221 raft_consensus.cc:2804] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.085728 11221 raft_consensus.cc:697] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Leader. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:54.089893 11113 leader_election.cc:304] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.086972 11221 consensus_queue.cc:237] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.097604 11210 raft_consensus.cc:2804] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.098573 11210 raft_consensus.cc:697] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Leader. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:54.099802 11210 consensus_queue.cc:237] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.118779 11193 raft_consensus.cc:697] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Becoming Leader. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:54.119673 11224 raft_consensus.cc:493] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.120064 11193 consensus_queue.cc:237] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.120309 11224 raft_consensus.cc:515] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.124956 11190 ts_tablet_manager.cc:1434] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.061s	user 0.013s	sys 0.020s
I20260709 12:16:54.126278 11190 tablet_bootstrap.cc:492] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:54.126763 11191 tablet_bootstrap.cc:492] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:54.127337 11191 ts_tablet_manager.cc:1403] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.007s
I20260709 12:16:54.127501 11224 leader_election.cc:290] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.128679 11188 tablet_bootstrap.cc:492] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:54.129254 11188 ts_tablet_manager.cc:1403] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.178s	user 0.049s	sys 0.071s
I20260709 12:16:54.130178 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a94ce16cb54e3dac0eaca3be800878" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:54.130575 11191 raft_consensus.cc:359] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.131481 11191 raft_consensus.cc:385] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:54.131881 11040 leader_election.cc:343] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.133641 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a94ce16cb54e3dac0eaca3be800878" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:54.131798 11191 raft_consensus.cc:740] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.135644 11190 tablet_bootstrap.cc:654] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:54.135830 11037 leader_election.cc:343] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72b516593c964645a094a1d75249794c (127.1.248.67:42445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.136351 11037 leader_election.cc:304] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327; no voters: 667de35363974f9da69460a1a11fcd7a, 72b516593c964645a094a1d75249794c
I20260709 12:16:54.137225 11224 raft_consensus.cc:2749] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.136988 11191 consensus_queue.cc:260] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.137984 11188 raft_consensus.cc:359] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.138949 11188 raft_consensus.cc:385] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.139381 11188 raft_consensus.cc:740] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.140640 11188 consensus_queue.cc:260] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.141511 11191 ts_tablet_manager.cc:1434] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:16:54.144040 11188 ts_tablet_manager.cc:1434] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:16:54.144578 11191 tablet_bootstrap.cc:492] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:54.145267 11188 tablet_bootstrap.cc:492] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:54.153318 11188 tablet_bootstrap.cc:654] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.182495 11191 tablet_bootstrap.cc:654] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.190081 11190 tablet_bootstrap.cc:492] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:54.190562 11190 ts_tablet_manager.cc:1403] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.037s
I20260709 12:16:54.191963 11188 tablet_bootstrap.cc:492] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:54.192552 11188 ts_tablet_manager.cc:1403] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.024s
I20260709 12:16:54.193468 11190 raft_consensus.cc:359] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.194212 11190 raft_consensus.cc:385] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.194550 11190 raft_consensus.cc:740] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.193893 10894 catalog_manager.cc:5697] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c reported cstate change: term changed from 0 to 1, leader changed from <none> to 72b516593c964645a094a1d75249794c (127.1.248.67). New cstate: current_term: 1 leader_uuid: "72b516593c964645a094a1d75249794c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:54.195343 11190 consensus_queue.cc:260] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.195811 11188 raft_consensus.cc:359] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.196688 11188 raft_consensus.cc:385] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.197050 11188 raft_consensus.cc:740] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.197779 11190 ts_tablet_manager.cc:1434] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:54.196893 10894 catalog_manager.cc:5697] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c reported cstate change: term changed from 0 to 1, leader changed from <none> to 72b516593c964645a094a1d75249794c (127.1.248.67). New cstate: current_term: 1 leader_uuid: "72b516593c964645a094a1d75249794c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:54.198045 11188 consensus_queue.cc:260] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.199944 10894 catalog_manager.cc:5697] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c reported cstate change: term changed from 0 to 1, leader changed from <none> to 72b516593c964645a094a1d75249794c (127.1.248.67). New cstate: current_term: 1 leader_uuid: "72b516593c964645a094a1d75249794c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:54.201915 11188 ts_tablet_manager.cc:1434] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:54.203161 11188 tablet_bootstrap.cc:492] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:54.206274 11191 tablet_bootstrap.cc:492] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:54.206920 11191 ts_tablet_manager.cc:1403] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.014s
I20260709 12:16:54.206063 10895 catalog_manager.cc:5697] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.207993 11221 raft_consensus.cc:493] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.208561 11221 raft_consensus.cc:515] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.210037 11191 raft_consensus.cc:359] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.210901 11221 leader_election.cc:290] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:54.210819 11191 raft_consensus.cc:385] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.212288 11191 raft_consensus.cc:740] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.212610 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:54.213317 11073 raft_consensus.cc:2468] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 0.
I20260709 12:16:54.213093 11191 consensus_queue.cc:260] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.214429 11188 tablet_bootstrap.cc:654] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.214895 11113 leader_election.cc:304] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:54.215873 11221 raft_consensus.cc:2804] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.216260 11221 raft_consensus.cc:493] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.216610 11221 raft_consensus.cc:3060] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.217361 11193 raft_consensus.cc:493] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.218048 11193 raft_consensus.cc:515] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.211678 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
W20260709 12:16:54.220753 11114 leader_election.cc:343] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.223762 11193 leader_election.cc:290] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.224588 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926d5800295e45f892c7c5337ef16cfa" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:54.224985 11191 ts_tablet_manager.cc:1434] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 12:16:54.225630 11195 raft_consensus.cc:493] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.226109 11195 raft_consensus.cc:515] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.228123 11195 leader_election.cc:290] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:54.228844 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926d5800295e45f892c7c5337ef16cfa" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:54.229440 11148 raft_consensus.cc:2468] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 0.
W20260709 12:16:54.230358 11040 leader_election.cc:343] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.230651 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a94ce16cb54e3dac0eaca3be800878" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
W20260709 12:16:54.232002 11114 leader_election.cc:343] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.232378 11037 leader_election.cc:304] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.233304 11193 raft_consensus.cc:2804] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.233734 11193 raft_consensus.cc:493] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.234124 11193 raft_consensus.cc:3060] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.234370 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a94ce16cb54e3dac0eaca3be800878" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:54.235039 11073 raft_consensus.cc:2468] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 0.
I20260709 12:16:54.236368 11113 leader_election.cc:304] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.237552 11195 raft_consensus.cc:2804] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.237915 11195 raft_consensus.cc:493] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.238277 11195 raft_consensus.cc:3060] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.242540 11193 raft_consensus.cc:515] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.245656 11193 leader_election.cc:290] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.245723 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926d5800295e45f892c7c5337ef16cfa" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
W20260709 12:16:54.247157 11040 leader_election.cc:343] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.247776 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926d5800295e45f892c7c5337ef16cfa" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:54.248322 11148 raft_consensus.cc:3060] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.253204 11195 raft_consensus.cc:515] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.257164 11195 leader_election.cc:290] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:54.258062 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a94ce16cb54e3dac0eaca3be800878" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:54.258728 11073 raft_consensus.cc:3060] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.259878 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a94ce16cb54e3dac0eaca3be800878" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:54.259634 11221 raft_consensus.cc:515] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
W20260709 12:16:54.265431 11114 leader_election.cc:343] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.267937 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
W20260709 12:16:54.269853 11114 leader_election.cc:343] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.268002 11148 raft_consensus.cc:2468] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 1.
I20260709 12:16:54.271654 11221 leader_election.cc:290] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:54.272076 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:54.272766 11074 raft_consensus.cc:3060] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.272892 11037 leader_election.cc:304] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.273337 11188 tablet_bootstrap.cc:492] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:54.273892 11193 raft_consensus.cc:2804] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.273908 11188 ts_tablet_manager.cc:1403] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.071s	user 0.033s	sys 0.030s
I20260709 12:16:54.274744 11193 raft_consensus.cc:697] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Becoming Leader. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:54.274994 11073 raft_consensus.cc:2468] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 1.
I20260709 12:16:54.275709 11193 consensus_queue.cc:237] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.276473 11113 leader_election.cc:304] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.277709 11221 raft_consensus.cc:2804] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.278208 11221 raft_consensus.cc:697] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Leader. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:54.278187 11188 raft_consensus.cc:359] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.279309 11188 raft_consensus.cc:385] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.279775 11188 raft_consensus.cc:740] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.280893 11188 consensus_queue.cc:260] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.282016 11074 raft_consensus.cc:2468] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 1.
I20260709 12:16:54.284667 11113 leader_election.cc:304] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.285244 11188 ts_tablet_manager.cc:1434] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:16:54.285964 11195 raft_consensus.cc:2804] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.279619 11221 consensus_queue.cc:237] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.286729 11195 raft_consensus.cc:697] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Leader. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:54.286661 11188 tablet_bootstrap.cc:492] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:54.290277 11215 raft_consensus.cc:493] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.290858 11215 raft_consensus.cc:515] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.296676 11215 leader_election.cc:290] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.297078 11188 tablet_bootstrap.cc:654] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.297366 11215 raft_consensus.cc:493] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.297911 11215 raft_consensus.cc:515] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.302629 10897 catalog_manager.cc:5697] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.287696 11195 consensus_queue.cc:237] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.316166 11215 leader_election.cc:290] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.312139 11221 raft_consensus.cc:493] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.317615 11221 raft_consensus.cc:515] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.320488 11221 leader_election.cc:290] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:54.323453 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "686fbecbc317411aaa96587b3515a573" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:54.324261 10995 raft_consensus.cc:2468] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 0.
I20260709 12:16:54.324914 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "686fbecbc317411aaa96587b3515a573" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:54.325655 11074 raft_consensus.cc:2468] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 0.
I20260709 12:16:54.328832 10894 catalog_manager.cc:5697] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c reported cstate change: term changed from 0 to 1, leader changed from <none> to 72b516593c964645a094a1d75249794c (127.1.248.67). New cstate: current_term: 1 leader_uuid: "72b516593c964645a094a1d75249794c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:54.330024 11113 leader_election.cc:304] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:54.330924 11221 raft_consensus.cc:2804] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.331295 11221 raft_consensus.cc:493] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.331642 11221 raft_consensus.cc:3060] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.332718 11188 tablet_bootstrap.cc:492] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:54.333354 11188 ts_tablet_manager.cc:1403] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.009s
I20260709 12:16:54.337994 11188 raft_consensus.cc:359] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.338735 11188 raft_consensus.cc:385] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.339036 11188 raft_consensus.cc:740] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.339918 11188 consensus_queue.cc:260] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.342603 11188 ts_tablet_manager.cc:1434] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:16:54.343639 11188 tablet_bootstrap.cc:492] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:54.346668 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b660204384458b8e72a9ff2d272fbe" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:54.347680 11073 raft_consensus.cc:2393] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 667de35363974f9da69460a1a11fcd7a in current term 1: Already voted for candidate 72b516593c964645a094a1d75249794c in this term.
I20260709 12:16:54.346608 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "686fbecbc317411aaa96587b3515a573" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:54.348559 11074 raft_consensus.cc:2468] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 0.
I20260709 12:16:54.350764 10964 leader_election.cc:304] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 
I20260709 12:16:54.351406 11188 tablet_bootstrap.cc:654] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.351691 11240 raft_consensus.cc:2804] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.352146 11240 raft_consensus.cc:493] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.352463 11240 raft_consensus.cc:3060] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.351576 11221 raft_consensus.cc:515] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.357023 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "686fbecbc317411aaa96587b3515a573" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:54.357105 11221 leader_election.cc:290] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:54.358249 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "686fbecbc317411aaa96587b3515a573" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:54.359054 11148 raft_consensus.cc:2393] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 667de35363974f9da69460a1a11fcd7a in current term 1: Already voted for candidate 72b516593c964645a094a1d75249794c in this term.
I20260709 12:16:54.358897 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b660204384458b8e72a9ff2d272fbe" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:54.361166 10962 leader_election.cc:304] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a; no voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c
I20260709 12:16:54.361928 11215 raft_consensus.cc:3060] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.357252 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "686fbecbc317411aaa96587b3515a573" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:54.364221 11074 raft_consensus.cc:3060] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.374996 11074 raft_consensus.cc:2468] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 1.
I20260709 12:16:54.376726 11113 leader_election.cc:304] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:54.377869 11221 raft_consensus.cc:2804] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.378878 11221 raft_consensus.cc:697] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Leader. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:54.377872 11215 raft_consensus.cc:2749] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.380102 11221 consensus_queue.cc:237] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.382194 10894 catalog_manager.cc:5697] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c reported cstate change: term changed from 0 to 1, leader changed from <none> to 72b516593c964645a094a1d75249794c (127.1.248.67). New cstate: current_term: 1 leader_uuid: "72b516593c964645a094a1d75249794c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:54.380606 11240 raft_consensus.cc:515] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.391763 11240 leader_election.cc:290] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 election: Requested vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.391804 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "686fbecbc317411aaa96587b3515a573" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:54.392999 11074 raft_consensus.cc:2393] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 667de35363974f9da69460a1a11fcd7a in current term 1: Already voted for candidate 72b516593c964645a094a1d75249794c in this term.
I20260709 12:16:54.393810 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "686fbecbc317411aaa96587b3515a573" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:54.392161 10995 raft_consensus.cc:2393] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 72b516593c964645a094a1d75249794c in current term 1: Already voted for candidate 667de35363974f9da69460a1a11fcd7a in this term.
I20260709 12:16:54.396561 10962 leader_election.cc:304] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a; no voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c
I20260709 12:16:54.398204 11240 raft_consensus.cc:2749] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.408942 11188 tablet_bootstrap.cc:492] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:54.408838 11195 consensus_queue.cc:1048] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:54.409670 11188 ts_tablet_manager.cc:1403] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.066s	user 0.045s	sys 0.018s
I20260709 12:16:54.412493 11188 raft_consensus.cc:359] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.413210 11188 raft_consensus.cc:385] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.413501 11188 raft_consensus.cc:740] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.414340 11188 consensus_queue.cc:260] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.417009 11188 ts_tablet_manager.cc:1434] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:54.417373 10894 catalog_manager.cc:5697] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c reported cstate change: term changed from 0 to 1, leader changed from <none> to 72b516593c964645a094a1d75249794c (127.1.248.67). New cstate: current_term: 1 leader_uuid: "72b516593c964645a094a1d75249794c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:54.418466 11188 tablet_bootstrap.cc:492] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:54.423797 11195 consensus_queue.cc:1048] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.425491 11240 raft_consensus.cc:493] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.426105 11240 raft_consensus.cc:515] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.428299 11240 leader_election.cc:290] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.429831 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecc18d3bf7748c5aea3b0caf2b289d1" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:54.430739 11073 raft_consensus.cc:2393] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 667de35363974f9da69460a1a11fcd7a in current term 1: Already voted for candidate 72b516593c964645a094a1d75249794c in this term.
I20260709 12:16:54.430554 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecc18d3bf7748c5aea3b0caf2b289d1" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:54.431906 11188 tablet_bootstrap.cc:654] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.432246 10964 leader_election.cc:304] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a; no voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c
I20260709 12:16:54.436388 11240 raft_consensus.cc:3060] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.451748 11188 tablet_bootstrap.cc:492] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:54.452409 11188 ts_tablet_manager.cc:1403] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.007s
I20260709 12:16:54.454188 11240 raft_consensus.cc:2749] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.455734 11188 raft_consensus.cc:359] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.456808 11188 raft_consensus.cc:385] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.457202 11188 raft_consensus.cc:740] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.458225 11188 consensus_queue.cc:260] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.461822 11188 ts_tablet_manager.cc:1434] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:16:54.462787 11188 tablet_bootstrap.cc:492] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:54.468570 11188 tablet_bootstrap.cc:654] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.472736 11188 tablet_bootstrap.cc:492] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:54.473163 11188 ts_tablet_manager.cc:1403] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:16:54.475041 11188 raft_consensus.cc:359] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.475575 11188 raft_consensus.cc:385] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.475800 11188 raft_consensus.cc:740] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.476377 11188 consensus_queue.cc:260] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.477921 11188 ts_tablet_manager.cc:1434] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:16:54.478893 11188 tablet_bootstrap.cc:492] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:54.484395 11188 tablet_bootstrap.cc:654] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.488797 11188 tablet_bootstrap.cc:492] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:54.489310 11188 ts_tablet_manager.cc:1403] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:16:54.491818 11188 raft_consensus.cc:359] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.492492 11188 raft_consensus.cc:385] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.492755 11188 raft_consensus.cc:740] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.493448 11188 consensus_queue.cc:260] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.495350 11188 ts_tablet_manager.cc:1434] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:54.495801 11195 consensus_queue.cc:1048] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.510628 11210 consensus_queue.cc:1048] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.516292 11147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42a94ce16cb54e3dac0eaca3be800878"
dest_uuid: "72b516593c964645a094a1d75249794c"
mode: GRACEFUL
new_leader_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:33304
I20260709 12:16:54.516888 11147 raft_consensus.cc:606] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Received request to transfer leadership to TS 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.522709 11147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "686fbecbc317411aaa96587b3515a573"
dest_uuid: "72b516593c964645a094a1d75249794c"
mode: GRACEFUL
new_leader_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:33304
I20260709 12:16:54.523505 11147 raft_consensus.cc:606] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Received request to transfer leadership to TS 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.530609 11147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539"
dest_uuid: "72b516593c964645a094a1d75249794c"
mode: GRACEFUL
new_leader_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:33304
I20260709 12:16:54.531245 11147 raft_consensus.cc:606] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Received request to transfer leadership to TS 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.536494 11147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31fe758f4455438dbf0b1c4b81e279f5"
dest_uuid: "72b516593c964645a094a1d75249794c"
mode: GRACEFUL
new_leader_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:33304
I20260709 12:16:54.536971 11147 raft_consensus.cc:606] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Received request to transfer leadership to TS 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:54.541999 11147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b37f7e31a966476690133d6ead87c211"
dest_uuid: "72b516593c964645a094a1d75249794c"
mode: GRACEFUL
new_leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
 from {username='slave'} at 127.0.0.1:33304
I20260709 12:16:54.542498 11147 raft_consensus.cc:606] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Received request to transfer leadership to TS 0c5eee91948c4ef6ae617f1a4365c327
I20260709 12:16:54.545380 11215 raft_consensus.cc:493] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.546100 11215 raft_consensus.cc:515] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.548259 11215 leader_election.cc:290] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.548856 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694ac3e0e6ac402f81ba5d2e66a5f020" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:54.549431 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694ac3e0e6ac402f81ba5d2e66a5f020" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:54.550246 11147 raft_consensus.cc:2393] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 667de35363974f9da69460a1a11fcd7a in current term 1: Already voted for candidate 0c5eee91948c4ef6ae617f1a4365c327 in this term.
I20260709 12:16:54.551173 10962 leader_election.cc:304] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a; no voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c
I20260709 12:16:54.552049 11215 raft_consensus.cc:3060] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.554126 11147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ecc18d3bf7748c5aea3b0caf2b289d1"
dest_uuid: "72b516593c964645a094a1d75249794c"
mode: GRACEFUL
new_leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
 from {username='slave'} at 127.0.0.1:33304
I20260709 12:16:54.554674 11147 raft_consensus.cc:606] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Received request to transfer leadership to TS 0c5eee91948c4ef6ae617f1a4365c327
I20260709 12:16:54.558329 11215 raft_consensus.cc:2749] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.560283 11215 raft_consensus.cc:493] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.560695 11215 raft_consensus.cc:515] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.562273 11215 leader_election.cc:290] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.563208 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a94ce16cb54e3dac0eaca3be800878" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:54.563524 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a94ce16cb54e3dac0eaca3be800878" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:54.564173 11074 raft_consensus.cc:2393] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 667de35363974f9da69460a1a11fcd7a in current term 1: Already voted for candidate 72b516593c964645a094a1d75249794c in this term.
I20260709 12:16:54.565300 10962 leader_election.cc:304] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a; no voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c
I20260709 12:16:54.565953 11215 raft_consensus.cc:3060] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.567092 11210 consensus_queue.cc:1048] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.572902 11215 raft_consensus.cc:2749] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.573770 11210 consensus_queue.cc:1048] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.605790 11193 consensus_queue.cc:1048] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.615924 11223 consensus_queue.cc:1048] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:16:54.644064 10928 debug-util.cc:398] Leaking SignalData structure 0x7b0800075c60 after lost signal to thread 2020
W20260709 12:16:54.645280 10928 debug-util.cc:398] Leaking SignalData structure 0x7b080003d260 after lost signal to thread 10931
I20260709 12:16:54.647701 11215 raft_consensus.cc:493] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.648270 11215 raft_consensus.cc:515] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.650974 11215 leader_election.cc:290] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.651170 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:54.651762 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:54.652166 11074 raft_consensus.cc:2393] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 667de35363974f9da69460a1a11fcd7a in current term 1: Already voted for candidate 72b516593c964645a094a1d75249794c in this term.
I20260709 12:16:54.653527 10962 leader_election.cc:304] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a; no voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c
I20260709 12:16:54.654388 11215 raft_consensus.cc:3060] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.659497 11215 raft_consensus.cc:2749] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.671243 11215 raft_consensus.cc:493] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.671813 11215 raft_consensus.cc:515] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.673646 11215 leader_election.cc:290] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.674857 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f7e31a966476690133d6ead87c211" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:54.674857 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f7e31a966476690133d6ead87c211" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:54.675940 11074 raft_consensus.cc:2393] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 667de35363974f9da69460a1a11fcd7a in current term 1: Already voted for candidate 72b516593c964645a094a1d75249794c in this term.
I20260709 12:16:54.677104 10964 leader_election.cc:304] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a; no voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c
I20260709 12:16:54.677845 11215 raft_consensus.cc:3060] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.683264 11215 raft_consensus.cc:2749] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.695533 10995 raft_consensus.cc:3060] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.706348 11224 consensus_queue.cc:1048] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.711526 11221 consensus_queue.cc:1048] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:54.720676 11226 consensus_queue.cc:1048] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.732247 11210 consensus_queue.cc:1048] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:54.756841 11195 raft_consensus.cc:993] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c: : Instructing follower 0c5eee91948c4ef6ae617f1a4365c327 to start an election
I20260709 12:16:54.757355 11210 raft_consensus.cc:1081] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Signalling peer 0c5eee91948c4ef6ae617f1a4365c327 to start an election
I20260709 12:16:54.759397 11074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b37f7e31a966476690133d6ead87c211"
dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
 from {username='slave'} at 127.0.0.1:46308
I20260709 12:16:54.760160 11074 raft_consensus.cc:493] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:54.761067 11074 raft_consensus.cc:3060] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.769248 11221 consensus_queue.cc:1048] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:54.769604 11074 raft_consensus.cc:515] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.772213 11074 leader_election.cc:290] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 2 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.772944 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f7e31a966476690133d6ead87c211" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:54.773675 10998 raft_consensus.cc:3060] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.778345 11210 raft_consensus.cc:993] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c: : Instructing follower 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:54.778878 11210 raft_consensus.cc:1081] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Signalling peer 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:54.780941 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37f7e31a966476690133d6ead87c211" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:54.781051 10999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "686fbecbc317411aaa96587b3515a573"
dest_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:33282
I20260709 12:16:54.781602 11147 raft_consensus.cc:3055] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.782388 11147 raft_consensus.cc:740] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:54.782403 10999 raft_consensus.cc:493] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:54.783737 10999 raft_consensus.cc:3060] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.785427 11147 consensus_queue.cc:260] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.789273 11221 consensus_queue.cc:1048] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.790009 11147 raft_consensus.cc:3060] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.796981 10998 raft_consensus.cc:2468] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 2.
I20260709 12:16:54.794835 10999 raft_consensus.cc:515] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.798084 11040 leader_election.cc:304] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 
I20260709 12:16:54.798931 11223 raft_consensus.cc:2804] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:54.799413 11210 consensus_queue.cc:1048] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:54.799458 11223 raft_consensus.cc:697] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 LEADER]: Becoming Leader. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:54.800745 11223 consensus_queue.cc:237] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.803088 11147 raft_consensus.cc:2468] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 2.
I20260709 12:16:54.812116 10999 leader_election.cc:290] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Requested vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.814779 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "686fbecbc317411aaa96587b3515a573" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:54.819609 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "686fbecbc317411aaa96587b3515a573" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:54.825348 11147 raft_consensus.cc:3055] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.826192 11210 raft_consensus.cc:993] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c: : Instructing follower 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:54.827404 11208 raft_consensus.cc:1081] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Signalling peer 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:54.829370 10999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539"
dest_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:33282
I20260709 12:16:54.829998 10999 raft_consensus.cc:493] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:54.830399 10999 raft_consensus.cc:3060] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.831718 11147 raft_consensus.cc:740] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:54.832789 11147 consensus_queue.cc:260] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.834208 11147 raft_consensus.cc:3060] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.838667 10999 raft_consensus.cc:515] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.839953 10997 raft_consensus.cc:1240] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Rejecting Update request from peer 72b516593c964645a094a1d75249794c for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.843961 11208 consensus_queue.cc:1048] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.849272 11210 consensus_queue.cc:1048] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.850725 11195 consensus_queue.cc:1059] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.851675 11195 raft_consensus.cc:3055] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.852028 11195 raft_consensus.cc:740] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:54.852952 11195 consensus_queue.cc:260] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.853922 11195 raft_consensus.cc:3060] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:54.855863 11210 consensus_queue.cc:1175] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0c5eee91948c4ef6ae617f1a4365c327" responder_term: 1 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:16:54.861863 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:54.862161 10999 leader_election.cc:290] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Requested vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.862660 11073 raft_consensus.cc:3060] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.864254 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:54.864630 11147 raft_consensus.cc:2468] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 2.
I20260709 12:16:54.866008 10962 leader_election.cc:304] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a, 72b516593c964645a094a1d75249794c; no voters: 0c5eee91948c4ef6ae617f1a4365c327
I20260709 12:16:54.867561 11215 raft_consensus.cc:2804] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:54.868070 11215 raft_consensus.cc:697] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Becoming Leader. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Running, Role: LEADER
I20260709 12:16:54.868920 11215 consensus_queue.cc:237] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.871752 11073 raft_consensus.cc:2468] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 2.
I20260709 12:16:54.872995 10964 leader_election.cc:304] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 
I20260709 12:16:54.873778 11240 raft_consensus.cc:2804] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:54.874862 11208 raft_consensus.cc:993] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c: : Instructing follower 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:54.875545 11208 raft_consensus.cc:1081] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Signalling peer 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:54.884601 10995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42a94ce16cb54e3dac0eaca3be800878"
dest_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:33282
I20260709 12:16:54.885335 10995 raft_consensus.cc:493] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:54.885761 10995 raft_consensus.cc:3060] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.894006 10995 raft_consensus.cc:515] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.874926 10897 catalog_manager.cc:5697] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 reported cstate change: term changed from 1 to 2, leader changed from 72b516593c964645a094a1d75249794c (127.1.248.67) to 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.897257 11072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a94ce16cb54e3dac0eaca3be800878" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:54.898049 11148 raft_consensus.cc:2468] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 2.
I20260709 12:16:54.901758 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a94ce16cb54e3dac0eaca3be800878" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:54.902642 11147 raft_consensus.cc:3055] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.903038 11147 raft_consensus.cc:740] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:54.904084 11147 consensus_queue.cc:260] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.905138 11147 raft_consensus.cc:3060] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.913754 10995 leader_election.cc:290] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Requested vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:54.916481 11240 raft_consensus.cc:697] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Becoming Leader. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Running, Role: LEADER
I20260709 12:16:54.917502 11240 consensus_queue.cc:237] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.920852 11147 raft_consensus.cc:2468] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 2.
I20260709 12:16:54.922156 10962 leader_election.cc:304] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a, 72b516593c964645a094a1d75249794c; no voters: 0c5eee91948c4ef6ae617f1a4365c327
I20260709 12:16:54.923120 11270 raft_consensus.cc:2804] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:54.923666 11270 raft_consensus.cc:697] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Becoming Leader. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Running, Role: LEADER
I20260709 12:16:54.924539 11270 consensus_queue.cc:237] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:54.932525 10897 catalog_manager.cc:5697] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a reported cstate change: term changed from 1 to 2, leader changed from 72b516593c964645a094a1d75249794c (127.1.248.67) to 667de35363974f9da69460a1a11fcd7a (127.1.248.65). New cstate: current_term: 2 leader_uuid: "667de35363974f9da69460a1a11fcd7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.934101 10897 catalog_manager.cc:5697] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a reported cstate change: term changed from 1 to 2, leader changed from 72b516593c964645a094a1d75249794c (127.1.248.67) to 667de35363974f9da69460a1a11fcd7a (127.1.248.65). New cstate: current_term: 2 leader_uuid: "667de35363974f9da69460a1a11fcd7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.935078 10897 catalog_manager.cc:5697] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a reported cstate change: term changed from 1 to 2, leader changed from 72b516593c964645a094a1d75249794c (127.1.248.67) to 667de35363974f9da69460a1a11fcd7a (127.1.248.65). New cstate: current_term: 2 leader_uuid: "667de35363974f9da69460a1a11fcd7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.037240 11221 raft_consensus.cc:993] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c: : Instructing follower 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:55.037725 11210 raft_consensus.cc:1081] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Signalling peer 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:55.039539 10995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31fe758f4455438dbf0b1c4b81e279f5"
dest_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:33282
I20260709 12:16:55.040053 10995 raft_consensus.cc:493] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:55.040369 10995 raft_consensus.cc:3060] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.045516 11210 raft_consensus.cc:993] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c: : Instructing follower 0c5eee91948c4ef6ae617f1a4365c327 to start an election
I20260709 12:16:55.046147 11221 raft_consensus.cc:1081] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Signalling peer 0c5eee91948c4ef6ae617f1a4365c327 to start an election
I20260709 12:16:55.048180 11074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ecc18d3bf7748c5aea3b0caf2b289d1"
dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
 from {username='slave'} at 127.0.0.1:46308
I20260709 12:16:55.048030 10995 raft_consensus.cc:515] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:55.049053 11074 raft_consensus.cc:493] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:55.049501 11074 raft_consensus.cc:3060] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.051402 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31fe758f4455438dbf0b1c4b81e279f5" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:55.052111 10995 leader_election.cc:290] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Requested vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:55.052132 11073 raft_consensus.cc:3060] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.053572 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31fe758f4455438dbf0b1c4b81e279f5" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:55.054171 11147 raft_consensus.cc:3055] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.054471 11147 raft_consensus.cc:740] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:55.055255 11147 consensus_queue.cc:260] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:55.056413 11147 raft_consensus.cc:3060] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.058405 11074 raft_consensus.cc:515] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:55.060871 11073 raft_consensus.cc:2468] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 2.
I20260709 12:16:55.062357 10964 leader_election.cc:304] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 
I20260709 12:16:55.063009 11074 leader_election.cc:290] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 2 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:55.063351 11270 raft_consensus.cc:2804] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:55.063602 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecc18d3bf7748c5aea3b0caf2b289d1" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:55.064124 11270 raft_consensus.cc:697] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Becoming Leader. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Running, Role: LEADER
I20260709 12:16:55.064352 11148 raft_consensus.cc:3055] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.064769 11148 raft_consensus.cc:740] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:55.065101 11270 consensus_queue.cc:237] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:55.065593 11148 consensus_queue.cc:260] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:55.066804 11148 raft_consensus.cc:3060] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.066870 11147 raft_consensus.cc:2468] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 2.
I20260709 12:16:55.068337 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecc18d3bf7748c5aea3b0caf2b289d1" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:55.069236 10995 raft_consensus.cc:3060] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.075178 10897 catalog_manager.cc:5697] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a reported cstate change: term changed from 1 to 2, leader changed from 72b516593c964645a094a1d75249794c (127.1.248.67) to 667de35363974f9da69460a1a11fcd7a (127.1.248.65). New cstate: current_term: 2 leader_uuid: "667de35363974f9da69460a1a11fcd7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.077293 11148 raft_consensus.cc:2468] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 2.
I20260709 12:16:55.077293 10995 raft_consensus.cc:2468] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 2.
I20260709 12:16:55.080161 11037 leader_election.cc:304] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:55.081197 11223 raft_consensus.cc:2804] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:55.081687 11223 raft_consensus.cc:697] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 LEADER]: Becoming Leader. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:55.082557 11223 consensus_queue.cc:237] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:55.090025 10897 catalog_manager.cc:5697] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 reported cstate change: term changed from 1 to 2, leader changed from 72b516593c964645a094a1d75249794c (127.1.248.67) to 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.328069 11148 raft_consensus.cc:1275] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.330089 11270 consensus_queue.cc:1048] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:55.351058 11074 raft_consensus.cc:3060] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.365772 10995 raft_consensus.cc:1275] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Refusing update from remote peer 0c5eee91948c4ef6ae617f1a4365c327: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.368005 11223 consensus_queue.cc:1048] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:55.373023 11148 raft_consensus.cc:1275] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Refusing update from remote peer 0c5eee91948c4ef6ae617f1a4365c327: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.376757 11147 raft_consensus.cc:1275] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.377339 11226 consensus_queue.cc:1048] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:55.378158 11074 raft_consensus.cc:1275] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.378715 11215 consensus_queue.cc:1048] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:55.380476 11270 consensus_queue.cc:1048] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:55.393518 11073 raft_consensus.cc:1275] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.400997 11270 consensus_queue.cc:1048] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:55.421082 11147 raft_consensus.cc:1275] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.430532 11270 consensus_queue.cc:1048] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:55.436494 11073 raft_consensus.cc:3060] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.449342 11073 raft_consensus.cc:1275] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.451555 11215 consensus_queue.cc:1048] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.510268 11073 raft_consensus.cc:1275] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.512569 11270 consensus_queue.cc:1048] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:55.525493 11147 raft_consensus.cc:1275] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.527452 11215 consensus_queue.cc:1048] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:55.638970 11147 raft_consensus.cc:1275] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Refusing update from remote peer 0c5eee91948c4ef6ae617f1a4365c327: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.640611 11193 consensus_queue.cc:1048] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:55.652731 10999 raft_consensus.cc:1275] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Refusing update from remote peer 0c5eee91948c4ef6ae617f1a4365c327: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.654426 11193 consensus_queue.cc:1048] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.598253 10897 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44768:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:57.602577 10897 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:57.665994 10983 tablet_service.cc:1511] Processing CreateTablet for tablet 92ea9155e6eb42aaab6dca1d90e73e06 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:57.666900 11063 tablet_service.cc:1511] Processing CreateTablet for tablet 92ea9155e6eb42aaab6dca1d90e73e06 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:57.667937 10983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ea9155e6eb42aaab6dca1d90e73e06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.668218 11063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ea9155e6eb42aaab6dca1d90e73e06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.674381 11138 tablet_service.cc:1511] Processing CreateTablet for tablet 92ea9155e6eb42aaab6dca1d90e73e06 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:57.676108 11138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ea9155e6eb42aaab6dca1d90e73e06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.681932 10984 tablet_service.cc:1511] Processing CreateTablet for tablet f1e42be7e8d644f995ad8c564a37cdad (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:57.683593 10984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e42be7e8d644f995ad8c564a37cdad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.684484 11059 tablet_service.cc:1511] Processing CreateTablet for tablet f1e42be7e8d644f995ad8c564a37cdad (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:57.685992 11059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e42be7e8d644f995ad8c564a37cdad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.709527 11292 tablet_bootstrap.cc:492] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:57.709769 11136 tablet_service.cc:1511] Processing CreateTablet for tablet f1e42be7e8d644f995ad8c564a37cdad (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:57.711373 11136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e42be7e8d644f995ad8c564a37cdad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.718679 11291 tablet_bootstrap.cc:492] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:57.723099 10987 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0f2078ccf4481289101c6b917a6944 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:57.724846 10987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0f2078ccf4481289101c6b917a6944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.726909 11293 tablet_bootstrap.cc:492] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:57.734612 11293 tablet_bootstrap.cc:654] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.735128 11063 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0f2078ccf4481289101c6b917a6944 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:57.736670 11063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0f2078ccf4481289101c6b917a6944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.737502 11292 tablet_bootstrap.cc:654] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.744266 11291 tablet_bootstrap.cc:654] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.751593 11293 tablet_bootstrap.cc:492] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:57.752336 11293 ts_tablet_manager.cc:1403] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.011s
I20260709 12:16:57.753710 11292 tablet_bootstrap.cc:492] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:57.754423 11292 ts_tablet_manager.cc:1403] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.000s
I20260709 12:16:57.755944 11293 raft_consensus.cc:359] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.756800 11293 raft_consensus.cc:385] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.757174 11293 raft_consensus.cc:740] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.757802 11292 raft_consensus.cc:359] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.758703 11292 raft_consensus.cc:385] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.759034 11292 raft_consensus.cc:740] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.760210 11138 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0f2078ccf4481289101c6b917a6944 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:57.761531 11138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0f2078ccf4481289101c6b917a6944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.761119 11292 consensus_queue.cc:260] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.767521 10983 tablet_service.cc:1511] Processing CreateTablet for tablet a1e152a4a95c4afc9e940b2626d68463 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:57.769049 10983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e152a4a95c4afc9e940b2626d68463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.758100 11293 consensus_queue.cc:260] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.784718 11064 tablet_service.cc:1511] Processing CreateTablet for tablet a1e152a4a95c4afc9e940b2626d68463 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:57.786192 11064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e152a4a95c4afc9e940b2626d68463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.796833 11137 tablet_service.cc:1511] Processing CreateTablet for tablet a1e152a4a95c4afc9e940b2626d68463 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:57.798365 11137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e152a4a95c4afc9e940b2626d68463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.797398 11292 ts_tablet_manager.cc:1434] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:16:57.804589 11293 ts_tablet_manager.cc:1434] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 12:16:57.818796 11292 tablet_bootstrap.cc:492] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:57.828083 11279 raft_consensus.cc:493] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.828691 11279 raft_consensus.cc:515] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.829813 11293 tablet_bootstrap.cc:492] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:57.832350 11291 tablet_bootstrap.cc:492] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:57.832358 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea9155e6eb42aaab6dca1d90e73e06" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:57.832988 11291 ts_tablet_manager.cc:1403] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.115s	user 0.004s	sys 0.015s
I20260709 12:16:57.833689 11147 raft_consensus.cc:2468] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 0.
I20260709 12:16:57.834281 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea9155e6eb42aaab6dca1d90e73e06" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:57.835395 11037 leader_election.cc:304] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:57.837976 10987 tablet_service.cc:1511] Processing CreateTablet for tablet e6b93883f8e34609929d18ac7d59ab20 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:57.838785 11291 raft_consensus.cc:359] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.839365 10987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b93883f8e34609929d18ac7d59ab20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.839613 11291 raft_consensus.cc:385] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.839962 11291 raft_consensus.cc:740] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.839854 11136 tablet_service.cc:1511] Processing CreateTablet for tablet e6b93883f8e34609929d18ac7d59ab20 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:57.841118 11136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b93883f8e34609929d18ac7d59ab20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.840778 11291 consensus_queue.cc:260] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.844024 11291 ts_tablet_manager.cc:1434] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.006s
I20260709 12:16:57.845185 11291 tablet_bootstrap.cc:492] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:57.849279 11292 tablet_bootstrap.cc:654] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:57.849468 11040 leader_election.cc:343] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.852900 11291 tablet_bootstrap.cc:654] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.857652 11293 tablet_bootstrap.cc:654] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.831146 11279 leader_election.cc:290] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:57.860535 11279 raft_consensus.cc:2804] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.860965 11279 raft_consensus.cc:493] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.861364 11279 raft_consensus.cc:3060] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.868371 11138 tablet_service.cc:1511] Processing CreateTablet for tablet a4b002cad4fd45cfb1d13d2b0ff26d3b (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:57.869868 11138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b002cad4fd45cfb1d13d2b0ff26d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.874393 11132 tablet_service.cc:1511] Processing CreateTablet for tablet d3242a956aba4c4284672cc7c90585ff (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:57.877537 10984 tablet_service.cc:1511] Processing CreateTablet for tablet d3242a956aba4c4284672cc7c90585ff (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:57.878329 11059 tablet_service.cc:1511] Processing CreateTablet for tablet a4b002cad4fd45cfb1d13d2b0ff26d3b (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:57.878907 10984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3242a956aba4c4284672cc7c90585ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.878975 11064 tablet_service.cc:1511] Processing CreateTablet for tablet e6b93883f8e34609929d18ac7d59ab20 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:57.879639 11059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b002cad4fd45cfb1d13d2b0ff26d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.880352 11064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b93883f8e34609929d18ac7d59ab20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.885309 11132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3242a956aba4c4284672cc7c90585ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.893332 11291 tablet_bootstrap.cc:492] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:57.894194 11291 ts_tablet_manager.cc:1403] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.009s
I20260709 12:16:57.906261 10987 tablet_service.cc:1511] Processing CreateTablet for tablet ffcd2e71435d4a06a669df60515259ce (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:57.896191 11292 tablet_bootstrap.cc:492] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:57.907920 11292 ts_tablet_manager.cc:1403] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.009s
I20260709 12:16:57.907951 10987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffcd2e71435d4a06a669df60515259ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.913894 11293 tablet_bootstrap.cc:492] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:57.858999 10983 tablet_service.cc:1511] Processing CreateTablet for tablet a4b002cad4fd45cfb1d13d2b0ff26d3b (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:57.914606 11293 ts_tablet_manager.cc:1403] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.001s
I20260709 12:16:57.922510 11293 raft_consensus.cc:359] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.914359 11131 tablet_service.cc:1511] Processing CreateTablet for tablet ffcd2e71435d4a06a669df60515259ce (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:57.926383 11291 raft_consensus.cc:359] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.928167 11291 raft_consensus.cc:385] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.928606 11291 raft_consensus.cc:740] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.930894 11291 consensus_queue.cc:260] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.941268 11291 ts_tablet_manager.cc:1434] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:16:57.929591 11292 raft_consensus.cc:359] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.928202 10983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b002cad4fd45cfb1d13d2b0ff26d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.931916 11063 tablet_service.cc:1511] Processing CreateTablet for tablet d3242a956aba4c4284672cc7c90585ff (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:57.935829 11131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffcd2e71435d4a06a669df60515259ce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:57.949021 10945 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:57.936772 11062 tablet_service.cc:1511] Processing CreateTablet for tablet ffcd2e71435d4a06a669df60515259ce (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:57.952416 11062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffcd2e71435d4a06a669df60515259ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.956957 10985 tablet_service.cc:1511] Processing CreateTablet for tablet 22b19f87359c4239b90f7efb60167dd9 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:57.958346 10985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b19f87359c4239b90f7efb60167dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.964207 11063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3242a956aba4c4284672cc7c90585ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.929052 11293 raft_consensus.cc:385] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.965530 11293 raft_consensus.cc:740] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.966612 11293 consensus_queue.cc:260] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.968252 11279 raft_consensus.cc:515] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.969440 11293 ts_tablet_manager.cc:1434] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 12:16:57.969892 11292 raft_consensus.cc:385] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.970357 11292 raft_consensus.cc:740] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.971382 11292 consensus_queue.cc:260] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:57.974195 11292 ts_tablet_manager.cc:1434] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.004s
I20260709 12:16:57.973944 11059 tablet_service.cc:1511] Processing CreateTablet for tablet 22b19f87359c4239b90f7efb60167dd9 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:57.976725 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea9155e6eb42aaab6dca1d90e73e06" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:57.999881 11147 raft_consensus.cc:3060] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.000344 11059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b19f87359c4239b90f7efb60167dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:58.000123 11132 tablet_service.cc:1511] Processing CreateTablet for tablet 22b19f87359c4239b90f7efb60167dd9 (DEFAULT_TABLE table=soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:58.001530 11132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b19f87359c4239b90f7efb60167dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:57.982507 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea9155e6eb42aaab6dca1d90e73e06" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:58.003765 10995 raft_consensus.cc:3060] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.011504 11292 tablet_bootstrap.cc:492] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:58.024179 10995 raft_consensus.cc:2468] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 1.
I20260709 12:16:58.025753 11040 leader_election.cc:304] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 
I20260709 12:16:58.026860 11301 raft_consensus.cc:2804] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.984431 11291 tablet_bootstrap.cc:492] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:57.990926 11279 leader_election.cc:290] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.027829 11301 raft_consensus.cc:697] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Becoming Leader. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:58.028895 11301 consensus_queue.cc:237] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.026777 11147 raft_consensus.cc:2468] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 1.
I20260709 12:16:57.988400 11293 tablet_bootstrap.cc:492] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:58.036895 11291 tablet_bootstrap.cc:654] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.044907 11292 tablet_bootstrap.cc:654] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.047237 11293 tablet_bootstrap.cc:654] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.062583 11279 raft_consensus.cc:493] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.063223 11279 raft_consensus.cc:515] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.067531 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f2078ccf4481289101c6b917a6944" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:58.068127 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f2078ccf4481289101c6b917a6944" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:58.068204 11147 raft_consensus.cc:2468] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 0.
I20260709 12:16:58.054477 11291 tablet_bootstrap.cc:492] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:58.071802 11291 ts_tablet_manager.cc:1403] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.017s
I20260709 12:16:58.075119 11291 raft_consensus.cc:359] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.075989 11291 raft_consensus.cc:385] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:58.076088 11040 leader_election.cc:343] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.076377 11291 raft_consensus.cc:740] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.078752 11291 consensus_queue.cc:260] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.078956 11037 leader_election.cc:304] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:58.081887 11297 raft_consensus.cc:2804] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.082280 11297 raft_consensus.cc:493] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.082619 11297 raft_consensus.cc:3060] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.087592 11279 leader_election.cc:290] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.074566 10895 catalog_manager.cc:5697] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.095345 11293 tablet_bootstrap.cc:492] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:58.096189 11293 ts_tablet_manager.cc:1403] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.108s	user 0.009s	sys 0.006s
I20260709 12:16:58.107661 11293 raft_consensus.cc:359] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.108634 11293 raft_consensus.cc:385] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.109084 11293 raft_consensus.cc:740] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.110129 11293 consensus_queue.cc:260] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.104959 11297 raft_consensus.cc:515] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.112931 11293 ts_tablet_manager.cc:1434] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:16:58.116825 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f2078ccf4481289101c6b917a6944" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:58.120154 10995 raft_consensus.cc:3060] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.120645 11291 ts_tablet_manager.cc:1434] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.002s
I20260709 12:16:58.121820 11291 tablet_bootstrap.cc:492] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:58.117230 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f2078ccf4481289101c6b917a6944" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:58.123760 11147 raft_consensus.cc:3060] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.126943 10995 raft_consensus.cc:2468] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 1.
I20260709 12:16:58.128698 11293 tablet_bootstrap.cc:492] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:58.117797 11297 leader_election.cc:290] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.119081 11292 tablet_bootstrap.cc:492] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:58.140516 11293 tablet_bootstrap.cc:654] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.134382 11040 leader_election.cc:304] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 
I20260709 12:16:58.139727 11147 raft_consensus.cc:2468] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 1.
I20260709 12:16:58.143275 11297 raft_consensus.cc:2804] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.132808 11291 tablet_bootstrap.cc:654] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.140633 11292 ts_tablet_manager.cc:1403] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.129s	user 0.017s	sys 0.007s
I20260709 12:16:58.144145 11297 raft_consensus.cc:697] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Becoming Leader. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:58.145777 11297 consensus_queue.cc:237] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.150516 11292 raft_consensus.cc:359] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.153599 11292 raft_consensus.cc:385] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.154058 11292 raft_consensus.cc:740] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.155074 11292 consensus_queue.cc:260] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.160645 11306 raft_consensus.cc:493] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.161204 11306 raft_consensus.cc:515] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.161641 11293 tablet_bootstrap.cc:492] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:58.162212 11293 ts_tablet_manager.cc:1403] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.005s
I20260709 12:16:58.164671 11306 leader_election.cc:290] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.165267 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e42be7e8d644f995ad8c564a37cdad" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:58.165917 11293 raft_consensus.cc:359] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.166707 11293 raft_consensus.cc:385] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.166790 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e42be7e8d644f995ad8c564a37cdad" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:58.167083 11293 raft_consensus.cc:740] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.167250 11291 tablet_bootstrap.cc:492] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:58.167703 11148 raft_consensus.cc:2468] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 0.
I20260709 12:16:58.167898 11291 ts_tablet_manager.cc:1403] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.009s
I20260709 12:16:58.168061 11293 consensus_queue.cc:260] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.169411 10962 leader_election.cc:304] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:58.170607 11293 ts_tablet_manager.cc:1434] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:58.170761 11073 raft_consensus.cc:2468] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 0.
I20260709 12:16:58.171217 11291 raft_consensus.cc:359] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.172014 11291 raft_consensus.cc:385] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.172096 11293 tablet_bootstrap.cc:492] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:58.173866 11292 ts_tablet_manager.cc:1434] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:16:58.172355 11291 raft_consensus.cc:740] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.175988 11291 consensus_queue.cc:260] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.179409 11280 raft_consensus.cc:2804] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.177695 11292 tablet_bootstrap.cc:492] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:58.179808 11280 raft_consensus.cc:493] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.180205 11280 raft_consensus.cc:3060] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.189311 11280 raft_consensus.cc:515] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.191447 11280 leader_election.cc:290] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 election: Requested vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.192862 11293 tablet_bootstrap.cc:654] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.193725 11292 tablet_bootstrap.cc:654] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.195030 11291 ts_tablet_manager.cc:1434] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
I20260709 12:16:58.194931 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e42be7e8d644f995ad8c564a37cdad" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:58.195819 11279 raft_consensus.cc:493] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.196703 11291 tablet_bootstrap.cc:492] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:58.196349 11279 raft_consensus.cc:515] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.203464 11291 tablet_bootstrap.cc:654] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.203327 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e152a4a95c4afc9e940b2626d68463" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:58.193598 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e42be7e8d644f995ad8c564a37cdad" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:58.205404 11279 leader_election.cc:290] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.209637 11073 raft_consensus.cc:3060] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.208633 10895 catalog_manager.cc:5697] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.195806 11147 raft_consensus.cc:3060] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:58.205727 11037 leader_election.cc:343] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72b516593c964645a094a1d75249794c (127.1.248.67:42445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.206120 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e152a4a95c4afc9e940b2626d68463" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:58.216871 10995 raft_consensus.cc:2468] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 0.
I20260709 12:16:58.218580 11040 leader_election.cc:304] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 72b516593c964645a094a1d75249794c
I20260709 12:16:58.220096 11279 raft_consensus.cc:2804] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.220535 11279 raft_consensus.cc:493] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.220685 11073 raft_consensus.cc:2468] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 1.
I20260709 12:16:58.220995 11279 raft_consensus.cc:3060] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.224479 10964 leader_election.cc:304] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 
I20260709 12:16:58.225679 11280 raft_consensus.cc:2804] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.226292 11280 raft_consensus.cc:697] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [term 1 LEADER]: Becoming Leader. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Running, Role: LEADER
I20260709 12:16:58.227392 11280 consensus_queue.cc:237] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.287737 11293 tablet_bootstrap.cc:492] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:58.288568 11293 ts_tablet_manager.cc:1403] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.117s	user 0.020s	sys 0.038s
I20260709 12:16:58.292985 11293 raft_consensus.cc:359] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.294188 11293 raft_consensus.cc:385] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.294626 11293 raft_consensus.cc:740] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.295845 11293 consensus_queue.cc:260] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.314215 11293 ts_tablet_manager.cc:1434] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 12:16:58.320204 11279 raft_consensus.cc:515] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.321866 11147 raft_consensus.cc:2468] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 1.
I20260709 12:16:58.324812 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e152a4a95c4afc9e940b2626d68463" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:58.325270 11292 tablet_bootstrap.cc:492] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:58.325466 10995 raft_consensus.cc:3060] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.325881 11292 ts_tablet_manager.cc:1403] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.148s	user 0.022s	sys 0.040s
I20260709 12:16:58.325906 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e152a4a95c4afc9e940b2626d68463" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c"
W20260709 12:16:58.327564 11037 leader_election.cc:343] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72b516593c964645a094a1d75249794c (127.1.248.67:42445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.328239 11293 tablet_bootstrap.cc:492] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:58.325989 11279 leader_election.cc:290] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.332778 11292 raft_consensus.cc:359] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.333887 11292 raft_consensus.cc:385] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.334251 11292 raft_consensus.cc:740] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.335119 11292 consensus_queue.cc:260] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.337437 11293 tablet_bootstrap.cc:654] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.335721 11291 tablet_bootstrap.cc:492] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:58.340860 11291 ts_tablet_manager.cc:1403] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.144s	user 0.032s	sys 0.032s
I20260709 12:16:58.344120 11291 raft_consensus.cc:359] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.344924 11291 raft_consensus.cc:385] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.345338 11291 raft_consensus.cc:740] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.346086 11291 consensus_queue.cc:260] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.346545 10995 raft_consensus.cc:2468] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 1.
I20260709 12:16:58.348937 11291 ts_tablet_manager.cc:1434] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:58.350821 11291 tablet_bootstrap.cc:492] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:58.355881 11040 leader_election.cc:304] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 72b516593c964645a094a1d75249794c
I20260709 12:16:58.357388 11301 raft_consensus.cc:2804] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.357874 11301 raft_consensus.cc:697] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Becoming Leader. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:58.358709 11301 consensus_queue.cc:237] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.360163 10897 catalog_manager.cc:5697] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a reported cstate change: term changed from 0 to 1, leader changed from <none> to 667de35363974f9da69460a1a11fcd7a (127.1.248.65). New cstate: current_term: 1 leader_uuid: "667de35363974f9da69460a1a11fcd7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.361676 11291 tablet_bootstrap.cc:654] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.371161 10895 catalog_manager.cc:5697] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.378237 11292 ts_tablet_manager.cc:1434] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 12:16:58.379845 11292 tablet_bootstrap.cc:492] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:58.391925 11291 tablet_bootstrap.cc:492] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:58.392570 11292 tablet_bootstrap.cc:654] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.394578 11293 tablet_bootstrap.cc:492] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:58.395218 11293 ts_tablet_manager.cc:1403] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.019s
I20260709 12:16:58.396271 11291 ts_tablet_manager.cc:1403] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.010s
I20260709 12:16:58.404354 11293 raft_consensus.cc:359] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.407094 11293 raft_consensus.cc:385] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.407498 11293 raft_consensus.cc:740] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.408463 11293 consensus_queue.cc:260] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.410964 11293 ts_tablet_manager.cc:1434] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.006s
I20260709 12:16:58.406275 11291 raft_consensus.cc:359] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.411443 11291 raft_consensus.cc:385] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.411823 11291 raft_consensus.cc:740] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.412612 11291 consensus_queue.cc:260] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.415190 11291 ts_tablet_manager.cc:1434] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:16:58.417618 11291 tablet_bootstrap.cc:492] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:58.424616 11291 tablet_bootstrap.cc:654] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.416584 11293 tablet_bootstrap.cc:492] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:58.431413 11293 tablet_bootstrap.cc:654] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.446460 11293 tablet_bootstrap.cc:492] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:58.447714 11293 ts_tablet_manager.cc:1403] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.004s
I20260709 12:16:58.450883 11293 raft_consensus.cc:359] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.454440 11291 tablet_bootstrap.cc:492] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:58.455376 11291 ts_tablet_manager.cc:1403] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.003s
I20260709 12:16:58.456970 11293 raft_consensus.cc:385] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.457408 11293 raft_consensus.cc:740] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
W20260709 12:16:58.457695 11113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:42597, user_credentials={real_user=slave}} blocked reactor thread for 64763.8us
I20260709 12:16:58.458328 11293 consensus_queue.cc:260] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.459287 11291 raft_consensus.cc:359] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.461112 11301 consensus_queue.cc:1048] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.469409 11293 ts_tablet_manager.cc:1434] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:16:58.471462 11291 raft_consensus.cc:385] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.472420 11291 raft_consensus.cc:740] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.474232 11291 consensus_queue.cc:260] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.478645 11293 tablet_bootstrap.cc:492] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:58.486749 11293 tablet_bootstrap.cc:654] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.488963 11292 tablet_bootstrap.cc:492] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:58.489782 11292 ts_tablet_manager.cc:1403] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.110s	user 0.029s	sys 0.052s
I20260709 12:16:58.492942 11292 raft_consensus.cc:359] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.493713 11292 raft_consensus.cc:385] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.494010 11292 raft_consensus.cc:740] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.497138 11291 ts_tablet_manager.cc:1434] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:16:58.499285 11293 tablet_bootstrap.cc:492] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:58.499971 11293 ts_tablet_manager.cc:1403] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 12:16:58.505014 11293 raft_consensus.cc:359] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.505853 11293 raft_consensus.cc:385] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.506188 11293 raft_consensus.cc:740] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.507072 11293 consensus_queue.cc:260] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.514175 11301 raft_consensus.cc:493] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.514680 11301 raft_consensus.cc:515] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.494764 11292 consensus_queue.cc:260] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.517951 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd2e71435d4a06a669df60515259ce" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:58.518648 10997 raft_consensus.cc:2468] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 0.
I20260709 12:16:58.520108 11040 leader_election.cc:304] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 
I20260709 12:16:58.520356 11291 tablet_bootstrap.cc:492] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:58.521090 11297 raft_consensus.cc:2804] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.521507 11297 raft_consensus.cc:493] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.521867 11297 raft_consensus.cc:3060] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.523769 11292 ts_tablet_manager.cc:1434] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.002s
I20260709 12:16:58.524834 11292 tablet_bootstrap.cc:492] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:58.535540 11301 leader_election.cc:290] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.541360 11292 tablet_bootstrap.cc:654] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.543327 11279 consensus_queue.cc:1048] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.549155 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd2e71435d4a06a669df60515259ce" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
W20260709 12:16:58.550796 11037 leader_election.cc:343] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72b516593c964645a094a1d75249794c (127.1.248.67:42445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.555346 11297 raft_consensus.cc:515] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.557240 11325 consensus_queue.cc:1048] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.558904 11292 tablet_bootstrap.cc:492] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:58.559537 11292 ts_tablet_manager.cc:1403] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.001s
I20260709 12:16:58.560436 11291 tablet_bootstrap.cc:654] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.562883 11292 raft_consensus.cc:359] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.563910 11292 raft_consensus.cc:385] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.564332 11292 raft_consensus.cc:740] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.565357 11292 consensus_queue.cc:260] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.569276 11292 ts_tablet_manager.cc:1434] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:16:58.570631 11292 tablet_bootstrap.cc:492] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:58.572592 11291 tablet_bootstrap.cc:492] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:58.573201 11291 ts_tablet_manager.cc:1403] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.008s
I20260709 12:16:58.577490 11292 tablet_bootstrap.cc:654] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.576145 11291 raft_consensus.cc:359] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.578895 11291 raft_consensus.cc:385] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.579234 11291 raft_consensus.cc:740] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.580118 11291 consensus_queue.cc:260] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.584029 11293 ts_tablet_manager.cc:1434] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 12:16:58.584172 11291 ts_tablet_manager.cc:1434] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:16:58.589542 11291 tablet_bootstrap.cc:492] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a: Bootstrap starting.
I20260709 12:16:58.593855 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd2e71435d4a06a669df60515259ce" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:58.594780 10999 raft_consensus.cc:3060] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.596109 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd2e71435d4a06a669df60515259ce" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c"
W20260709 12:16:58.597740 11037 leader_election.cc:343] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72b516593c964645a094a1d75249794c (127.1.248.67:42445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.585336 11293 tablet_bootstrap.cc:492] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327: Bootstrap starting.
I20260709 12:16:58.605904 11279 raft_consensus.cc:493] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.606060 11325 consensus_queue.cc:1048] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:58.606572 11279 raft_consensus.cc:515] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.608712 11279 leader_election.cc:290] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.610620 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b19f87359c4239b90f7efb60167dd9" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:58.611349 10998 raft_consensus.cc:2468] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 0.
I20260709 12:16:58.611402 10999 raft_consensus.cc:2468] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 1.
I20260709 12:16:58.611500 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b19f87359c4239b90f7efb60167dd9" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:58.612537 11317 raft_consensus.cc:493] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:58.613066 11037 leader_election.cc:343] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72b516593c964645a094a1d75249794c (127.1.248.67:42445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.613027 11317 raft_consensus.cc:515] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.615114 11291 tablet_bootstrap.cc:654] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.601032 11297 leader_election.cc:290] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.617607 11040 leader_election.cc:304] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 72b516593c964645a094a1d75249794c
I20260709 12:16:58.618993 11040 leader_election.cc:304] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 72b516593c964645a094a1d75249794c
I20260709 12:16:58.619730 11297 raft_consensus.cc:2804] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.640045 11297 raft_consensus.cc:493] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.642083 11297 raft_consensus.cc:3060] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.621311 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b93883f8e34609929d18ac7d59ab20" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:58.621534 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b93883f8e34609929d18ac7d59ab20" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:58.627898 11292 tablet_bootstrap.cc:492] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:58.663265 11073 raft_consensus.cc:2468] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 0.
I20260709 12:16:58.620167 11317 leader_election.cc:290] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:58.620661 11279 raft_consensus.cc:2804] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.663398 11292 ts_tablet_manager.cc:1403] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.017s
I20260709 12:16:58.639046 11280 raft_consensus.cc:493] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.664340 11279 raft_consensus.cc:697] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Becoming Leader. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:58.664573 11280 raft_consensus.cc:515] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.665681 11279 consensus_queue.cc:237] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.667054 11292 raft_consensus.cc:359] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.667881 11292 raft_consensus.cc:385] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.668284 10999 raft_consensus.cc:2468] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 0.
I20260709 12:16:58.668350 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b93883f8e34609929d18ac7d59ab20" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:58.668387 11292 raft_consensus.cc:740] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.669263 11148 raft_consensus.cc:2468] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 0.
I20260709 12:16:58.669773 11292 consensus_queue.cc:260] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.670650 10962 leader_election.cc:304] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:58.667078 11280 leader_election.cc:290] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.671612 11306 raft_consensus.cc:2804] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.672046 11113 leader_election.cc:304] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:58.672497 11306 raft_consensus.cc:493] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.672917 11306 raft_consensus.cc:3060] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.673398 11221 raft_consensus.cc:2804] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.673794 11221 raft_consensus.cc:493] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.674111 11221 raft_consensus.cc:3060] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.674757 11292 ts_tablet_manager.cc:1434] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:16:58.675954 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b93883f8e34609929d18ac7d59ab20" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:58.676621 11073 raft_consensus.cc:2468] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 0.
I20260709 12:16:58.692270 11306 raft_consensus.cc:515] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.695818 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b93883f8e34609929d18ac7d59ab20" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:58.696486 11073 raft_consensus.cc:3060] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.708986 11292 tablet_bootstrap.cc:492] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:58.716509 11291 tablet_bootstrap.cc:492] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a: No bootstrap required, opened a new log
I20260709 12:16:58.717111 11291 ts_tablet_manager.cc:1403] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a: Time spent bootstrapping tablet: real 0.128s	user 0.033s	sys 0.042s
I20260709 12:16:58.717366 11337 consensus_queue.cc:1048] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.719990 11306 leader_election.cc:290] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 election: Requested vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.725931 11297 raft_consensus.cc:515] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.727641 11293 tablet_bootstrap.cc:654] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.728142 11292 tablet_bootstrap.cc:654] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.728392 11221 raft_consensus.cc:515] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.714004 11073 raft_consensus.cc:2468] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 1.
I20260709 12:16:58.731102 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b93883f8e34609929d18ac7d59ab20" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:58.739319 11148 raft_consensus.cc:2393] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 667de35363974f9da69460a1a11fcd7a in current term 1: Already voted for candidate 72b516593c964645a094a1d75249794c in this term.
I20260709 12:16:58.731791 11291 raft_consensus.cc:359] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.733428 11297 leader_election.cc:290] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.734449 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b19f87359c4239b90f7efb60167dd9" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:58.740676 11291 raft_consensus.cc:385] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.740998 11291 raft_consensus.cc:740] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.740998 10964 leader_election.cc:304] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 72b516593c964645a094a1d75249794c
W20260709 12:16:58.741819 11037 leader_election.cc:343] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72b516593c964645a094a1d75249794c (127.1.248.67:42445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.736321 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b19f87359c4239b90f7efb60167dd9" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:58.741918 11291 consensus_queue.cc:260] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.742425 11280 raft_consensus.cc:2804] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.742813 10999 raft_consensus.cc:3060] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.744459 11291 ts_tablet_manager.cc:1434] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:16:58.743969 10897 catalog_manager.cc:5697] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.746690 11279 raft_consensus.cc:493] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.747171 11279 raft_consensus.cc:515] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.747910 11317 raft_consensus.cc:493] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.748420 11317 raft_consensus.cc:515] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.749362 11279 leader_election.cc:290] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.750602 11317 leader_election.cc:290] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:58.751485 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b002cad4fd45cfb1d13d2b0ff26d3b" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:58.752213 10997 raft_consensus.cc:2468] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 0.
I20260709 12:16:58.753649 11040 leader_election.cc:304] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 
I20260709 12:16:58.754650 11279 raft_consensus.cc:2804] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.755070 11279 raft_consensus.cc:493] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.755488 11279 raft_consensus.cc:3060] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.756016 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b002cad4fd45cfb1d13d2b0ff26d3b" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c" is_pre_election: true
I20260709 12:16:58.756740 11147 raft_consensus.cc:2468] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 0.
I20260709 12:16:58.758802 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3242a956aba4c4284672cc7c90585ff" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:58.759552 10997 raft_consensus.cc:2468] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 0.
I20260709 12:16:58.760906 11114 leader_election.cc:304] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:58.761679 11292 tablet_bootstrap.cc:492] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:58.762058 11317 raft_consensus.cc:2804] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.762266 11292 ts_tablet_manager.cc:1403] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.010s
I20260709 12:16:58.763589 11317 raft_consensus.cc:493] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.763935 11280 raft_consensus.cc:697] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 1 LEADER]: Becoming Leader. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Running, Role: LEADER
I20260709 12:16:58.764129 11317 raft_consensus.cc:3060] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.765019 11280 consensus_queue.cc:237] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.766445 11292 raft_consensus.cc:359] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.767153 11292 raft_consensus.cc:385] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.767447 11292 raft_consensus.cc:740] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.768183 11292 consensus_queue.cc:260] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.762985 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3242a956aba4c4284672cc7c90585ff" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
W20260709 12:16:58.770754 11113 leader_election.cc:343] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.777415 11337 consensus_queue.cc:1048] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.771701 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b93883f8e34609929d18ac7d59ab20" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:58.796651 11221 leader_election.cc:290] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:58.799918 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b93883f8e34609929d18ac7d59ab20" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:58.800818 11074 raft_consensus.cc:2393] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 72b516593c964645a094a1d75249794c in current term 1: Already voted for candidate 667de35363974f9da69460a1a11fcd7a in this term.
I20260709 12:16:58.821463 11113 leader_election.cc:304] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72b516593c964645a094a1d75249794c; no voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:58.822543 11221 raft_consensus.cc:2749] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:58.823585 11279 raft_consensus.cc:515] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.828603 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b002cad4fd45cfb1d13d2b0ff26d3b" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:58.829566 11148 raft_consensus.cc:3060] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.827302 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b002cad4fd45cfb1d13d2b0ff26d3b" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:58.830348 10997 raft_consensus.cc:3060] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.830245 10999 raft_consensus.cc:2468] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 1.
I20260709 12:16:58.831777 11040 leader_election.cc:304] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 72b516593c964645a094a1d75249794c
I20260709 12:16:58.833112 11297 raft_consensus.cc:2804] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.833813 11297 raft_consensus.cc:697] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Becoming Leader. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:58.834640 11297 consensus_queue.cc:237] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.829588 11293 tablet_bootstrap.cc:492] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327: No bootstrap required, opened a new log
I20260709 12:16:58.839610 10997 raft_consensus.cc:2468] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 1.
I20260709 12:16:58.840432 11293 ts_tablet_manager.cc:1403] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327: Time spent bootstrapping tablet: real 0.255s	user 0.006s	sys 0.014s
I20260709 12:16:58.841395 11040 leader_election.cc:304] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 
I20260709 12:16:58.842394 11325 raft_consensus.cc:2804] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.842913 11325 raft_consensus.cc:697] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Becoming Leader. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:58.843782 11325 consensus_queue.cc:237] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.846320 11293 raft_consensus.cc:359] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.850812 11293 raft_consensus.cc:385] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.851812 11293 raft_consensus.cc:740] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.848822 11148 raft_consensus.cc:2468] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 1.
I20260709 12:16:58.860134 11293 consensus_queue.cc:260] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.827227 11279 leader_election.cc:290] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:58.867174 11148 raft_consensus.cc:3060] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.849251 11317 raft_consensus.cc:515] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.869211 11293 ts_tablet_manager.cc:1434] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.004s
I20260709 12:16:58.879945 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3242a956aba4c4284672cc7c90585ff" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:58.880477 11292 ts_tablet_manager.cc:1434] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.117s	user 0.034s	sys 0.041s
I20260709 12:16:58.880520 10997 raft_consensus.cc:3060] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.885560 10897 catalog_manager.cc:5697] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a reported cstate change: term changed from 0 to 1, leader changed from <none> to 667de35363974f9da69460a1a11fcd7a (127.1.248.65). New cstate: current_term: 1 leader_uuid: "667de35363974f9da69460a1a11fcd7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.886778 10997 raft_consensus.cc:2468] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 1.
I20260709 12:16:58.888630 11114 leader_election.cc:304] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:58.889590 11292 tablet_bootstrap.cc:492] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c: Bootstrap starting.
I20260709 12:16:58.889928 11345 raft_consensus.cc:2804] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.891338 11345 raft_consensus.cc:697] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Leader. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:58.892612 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3242a956aba4c4284672cc7c90585ff" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:58.893537 11317 leader_election.cc:290] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:58.893626 11074 raft_consensus.cc:3060] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.897116 10896 catalog_manager.cc:5697] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.899742 11292 tablet_bootstrap.cc:654] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.900456 11325 consensus_queue.cc:1048] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:58.901630 11074 raft_consensus.cc:2468] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 1.
I20260709 12:16:58.899117 10896 catalog_manager.cc:5697] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66). New cstate: current_term: 1 leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.892341 11345 consensus_queue.cc:237] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.945215 11292 tablet_bootstrap.cc:492] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c: No bootstrap required, opened a new log
I20260709 12:16:58.948875 11297 consensus_queue.cc:1048] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.949255 11292 ts_tablet_manager.cc:1403] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.010s
I20260709 12:16:58.965186 10894 catalog_manager.cc:5697] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c reported cstate change: term changed from 0 to 1, leader changed from <none> to 72b516593c964645a094a1d75249794c (127.1.248.67). New cstate: current_term: 1 leader_uuid: "72b516593c964645a094a1d75249794c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.966847 11292 raft_consensus.cc:359] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:58.967713 11292 raft_consensus.cc:385] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.968014 11292 raft_consensus.cc:740] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.968896 11292 consensus_queue.cc:260] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
W20260709 12:16:58.970337 10945 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:58.971321 11292 ts_tablet_manager.cc:1434] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.001s
I20260709 12:16:59.082275 11074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92ea9155e6eb42aaab6dca1d90e73e06"
dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
mode: GRACEFUL
new_leader_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:46320
I20260709 12:16:59.082931 11074 raft_consensus.cc:606] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Received request to transfer leadership to TS 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:59.084934 11345 raft_consensus.cc:493] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.085523 11345 raft_consensus.cc:515] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.087294 11345 leader_election.cc:290] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:59.088157 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b19f87359c4239b90f7efb60167dd9" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667de35363974f9da69460a1a11fcd7a" is_pre_election: true
I20260709 12:16:59.089035 10997 raft_consensus.cc:2393] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72b516593c964645a094a1d75249794c in current term 1: Already voted for candidate 0c5eee91948c4ef6ae617f1a4365c327 in this term.
I20260709 12:16:59.089299 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b19f87359c4239b90f7efb60167dd9" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327" is_pre_election: true
I20260709 12:16:59.090966 11113 leader_election.cc:304] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72b516593c964645a094a1d75249794c; no voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:59.091786 11345 raft_consensus.cc:3060] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.093691 11074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a0f2078ccf4481289101c6b917a6944"
dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
mode: GRACEFUL
new_leader_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:46320
I20260709 12:16:59.094359 11074 raft_consensus.cc:606] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Received request to transfer leadership to TS 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:59.098868 11345 raft_consensus.cc:2749] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.100348 11074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1e152a4a95c4afc9e940b2626d68463"
dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
mode: GRACEFUL
new_leader_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:46320
I20260709 12:16:59.100939 11074 raft_consensus.cc:606] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Received request to transfer leadership to TS 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:59.116901 10997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6b93883f8e34609929d18ac7d59ab20"
dest_uuid: "667de35363974f9da69460a1a11fcd7a"
mode: GRACEFUL
new_leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
 from {username='slave'} at 127.0.0.1:33298
I20260709 12:16:59.117738 10997 raft_consensus.cc:606] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 1 LEADER]: Received request to transfer leadership to TS 0c5eee91948c4ef6ae617f1a4365c327
I20260709 12:16:59.122005 11297 raft_consensus.cc:993] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327: : Instructing follower 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:59.122498 11297 raft_consensus.cc:1081] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Signalling peer 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:59.124370 10997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92ea9155e6eb42aaab6dca1d90e73e06"
dest_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:33296
I20260709 12:16:59.125121 10997 raft_consensus.cc:493] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.125592 10997 raft_consensus.cc:3060] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.129112 11147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3242a956aba4c4284672cc7c90585ff"
dest_uuid: "72b516593c964645a094a1d75249794c"
mode: GRACEFUL
new_leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
 from {username='slave'} at 127.0.0.1:33304
I20260709 12:16:59.129698 11147 raft_consensus.cc:606] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Received request to transfer leadership to TS 0c5eee91948c4ef6ae617f1a4365c327
I20260709 12:16:59.134766 10997 raft_consensus.cc:515] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.138013 11074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea9155e6eb42aaab6dca1d90e73e06" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:59.138235 10997 leader_election.cc:290] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Requested vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:59.138684 11074 raft_consensus.cc:3055] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.139098 11074 raft_consensus.cc:740] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:59.139338 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea9155e6eb42aaab6dca1d90e73e06" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:59.139703 11073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22b19f87359c4239b90f7efb60167dd9"
dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
mode: GRACEFUL
new_leader_uuid: "72b516593c964645a094a1d75249794c"
 from {username='slave'} at 127.0.0.1:46320
I20260709 12:16:59.140007 11147 raft_consensus.cc:3060] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.140328 11073 raft_consensus.cc:606] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Received request to transfer leadership to TS 72b516593c964645a094a1d75249794c
I20260709 12:16:59.142299 11074 consensus_queue.cc:260] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.143936 11074 raft_consensus.cc:3060] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.148643 11147 raft_consensus.cc:2468] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 2.
I20260709 12:16:59.150218 10962 leader_election.cc:304] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:59.151145 11280 raft_consensus.cc:2804] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.151672 11280 raft_consensus.cc:697] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Becoming Leader. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Running, Role: LEADER
I20260709 12:16:59.152585 11280 consensus_queue.cc:237] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.153815 11074 raft_consensus.cc:2468] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 2.
I20260709 12:16:59.157577 11279 consensus_queue.cc:1048] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:59.162541 10896 catalog_manager.cc:5697] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a reported cstate change: term changed from 1 to 2, leader changed from 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66) to 667de35363974f9da69460a1a11fcd7a (127.1.248.65). New cstate: current_term: 2 leader_uuid: "667de35363974f9da69460a1a11fcd7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.168126 11147 raft_consensus.cc:3060] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.179118 11301 consensus_queue.cc:1048] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.228161 11344 consensus_queue.cc:1048] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.244283 11344 consensus_queue.cc:1048] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:59.252648 11280 raft_consensus.cc:993] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a: : Instructing follower 0c5eee91948c4ef6ae617f1a4365c327 to start an election
I20260709 12:16:59.253136 11280 raft_consensus.cc:1081] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 1 LEADER]: Signalling peer 0c5eee91948c4ef6ae617f1a4365c327 to start an election
I20260709 12:16:59.254892 11074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6b93883f8e34609929d18ac7d59ab20"
dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
 from {username='slave'} at 127.0.0.1:46314
I20260709 12:16:59.259627 11074 raft_consensus.cc:493] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.260058 11074 raft_consensus.cc:3060] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.287945 11074 raft_consensus.cc:515] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.288959 11073 raft_consensus.cc:1240] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Rejecting Update request from peer 667de35363974f9da69460a1a11fcd7a for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.290875 11074 leader_election.cc:290] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 2 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:59.292569 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b93883f8e34609929d18ac7d59ab20" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:59.293059 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b93883f8e34609929d18ac7d59ab20" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:59.293287 11148 raft_consensus.cc:3060] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.293735 10997 raft_consensus.cc:3055] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.294098 10997 raft_consensus.cc:740] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Running, Role: LEADER
I20260709 12:16:59.296217 10997 consensus_queue.cc:260] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.297389 10997 raft_consensus.cc:3060] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:59.299400 11338 consensus_queue.cc:1175] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0c5eee91948c4ef6ae617f1a4365c327" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 667de35363974f9da69460a1a11fcd7a for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:16:59.301780 11148 raft_consensus.cc:2468] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 2.
I20260709 12:16:59.303095 11037 leader_election.cc:304] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:59.304023 11301 raft_consensus.cc:2804] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.304536 11301 raft_consensus.cc:697] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 LEADER]: Becoming Leader. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:59.305392 11301 consensus_queue.cc:237] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.307157 10997 raft_consensus.cc:2468] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 2.
I20260709 12:16:59.313176 10896 catalog_manager.cc:5697] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 reported cstate change: term changed from 1 to 2, leader changed from 667de35363974f9da69460a1a11fcd7a (127.1.248.65) to 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.330590 11343 consensus_queue.cc:1048] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.335191 11301 consensus_queue.cc:1048] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:59.341164 11317 raft_consensus.cc:993] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c: : Instructing follower 0c5eee91948c4ef6ae617f1a4365c327 to start an election
I20260709 12:16:59.341667 11317 raft_consensus.cc:1081] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Signalling peer 0c5eee91948c4ef6ae617f1a4365c327 to start an election
I20260709 12:16:59.345579 11072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3242a956aba4c4284672cc7c90585ff"
dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
 from {username='slave'} at 127.0.0.1:46308
I20260709 12:16:59.346174 11072 raft_consensus.cc:493] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.346570 11072 raft_consensus.cc:3060] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.349339 11317 consensus_queue.cc:1048] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:59.362949 11072 raft_consensus.cc:515] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.372902 11072 leader_election.cc:290] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 2 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:59.373804 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3242a956aba4c4284672cc7c90585ff" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:59.386912 11148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3242a956aba4c4284672cc7c90585ff" candidate_uuid: "0c5eee91948c4ef6ae617f1a4365c327" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:59.387563 11148 raft_consensus.cc:3055] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.387687 11301 consensus_queue.cc:1048] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.388203 11326 consensus_queue.cc:1048] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:59.387995 11148 raft_consensus.cc:740] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:59.398473 11148 consensus_queue.cc:260] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.400462 11148 raft_consensus.cc:3060] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.410668 11148 raft_consensus.cc:2468] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5eee91948c4ef6ae617f1a4365c327 in term 2.
I20260709 12:16:59.412264 11326 raft_consensus.cc:993] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327: : Instructing follower 72b516593c964645a094a1d75249794c to start an election
I20260709 12:16:59.412932 11326 raft_consensus.cc:1081] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Signalling peer 72b516593c964645a094a1d75249794c to start an election
I20260709 12:16:59.416654 11325 raft_consensus.cc:993] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327: : Instructing follower 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:59.417214 11325 raft_consensus.cc:1081] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Signalling peer 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:59.420073 11037 leader_election.cc:304] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:59.420804 11146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22b19f87359c4239b90f7efb60167dd9"
dest_uuid: "72b516593c964645a094a1d75249794c"
 from {username='slave'} at 127.0.0.1:33296
I20260709 12:16:59.421288 11301 raft_consensus.cc:2804] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.421555 11146 raft_consensus.cc:493] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.421860 11301 raft_consensus.cc:697] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 LEADER]: Becoming Leader. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:59.422066 11146 raft_consensus.cc:3060] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.422812 11301 consensus_queue.cc:237] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.425562 10997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1e152a4a95c4afc9e940b2626d68463"
dest_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:33296
I20260709 12:16:59.426272 10997 raft_consensus.cc:493] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.426671 10997 raft_consensus.cc:3060] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.425433 11297 consensus_queue.cc:1048] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.438328 10997 raft_consensus.cc:515] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.441143 10997 leader_election.cc:290] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Requested vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:59.442332 11072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e152a4a95c4afc9e940b2626d68463" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:59.443243 11072 raft_consensus.cc:3055] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.443691 11072 raft_consensus.cc:740] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:59.444787 11072 consensus_queue.cc:260] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.446313 11072 raft_consensus.cc:3060] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.442363 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e152a4a95c4afc9e940b2626d68463" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:59.448838 11147 raft_consensus.cc:3060] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.440820 11146 raft_consensus.cc:515] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.458961 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b19f87359c4239b90f7efb60167dd9" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:16:59.460999 11148 raft_consensus.cc:1240] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Rejecting Update request from peer 0c5eee91948c4ef6ae617f1a4365c327 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.463541 11301 consensus_queue.cc:1059] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.464610 11301 raft_consensus.cc:3055] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.464672 11146 leader_election.cc:290] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 2 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:16:59.465152 11301 raft_consensus.cc:740] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:59.455224 10894 catalog_manager.cc:5697] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 reported cstate change: term changed from 1 to 2, leader changed from 72b516593c964645a094a1d75249794c (127.1.248.67) to 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66). New cstate: current_term: 2 leader_uuid: "0c5eee91948c4ef6ae617f1a4365c327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.466357 11301 consensus_queue.cc:260] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.468015 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b19f87359c4239b90f7efb60167dd9" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:59.468968 11301 raft_consensus.cc:3060] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.479914 11147 raft_consensus.cc:2468] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 2.
I20260709 12:16:59.481268 10962 leader_election.cc:304] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:16:59.482152 11338 raft_consensus.cc:2804] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.482630 11338 raft_consensus.cc:697] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Becoming Leader. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Running, Role: LEADER
I20260709 12:16:59.483479 11338 consensus_queue.cc:237] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.486140 11072 raft_consensus.cc:2468] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 2.
I20260709 12:16:59.490478 11073 raft_consensus.cc:2468] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 2.
I20260709 12:16:59.492677 11113 leader_election.cc:304] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 667de35363974f9da69460a1a11fcd7a
I20260709 12:16:59.493947 11317 raft_consensus.cc:2804] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.494481 11317 raft_consensus.cc:697] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 2 LEADER]: Becoming Leader. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:16:59.495441 11317 consensus_queue.cc:237] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.500731 11325 raft_consensus.cc:993] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327: : Instructing follower 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:59.501164 11325 raft_consensus.cc:1081] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Signalling peer 667de35363974f9da69460a1a11fcd7a to start an election
I20260709 12:16:59.503888 10999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a0f2078ccf4481289101c6b917a6944"
dest_uuid: "667de35363974f9da69460a1a11fcd7a"
 from {username='slave'} at 127.0.0.1:33296
I20260709 12:16:59.506162 10999 raft_consensus.cc:493] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.506829 10999 raft_consensus.cc:3060] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.506158 10895 catalog_manager.cc:5697] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c reported cstate change: term changed from 1 to 2, leader changed from 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66) to 72b516593c964645a094a1d75249794c (127.1.248.67). New cstate: current_term: 2 leader_uuid: "72b516593c964645a094a1d75249794c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.513314 10999 raft_consensus.cc:515] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.515765 10999 leader_election.cc:290] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Requested vote from peers 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597), 72b516593c964645a094a1d75249794c (127.1.248.67:42445)
I20260709 12:16:59.516369 11147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f2078ccf4481289101c6b917a6944" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b516593c964645a094a1d75249794c"
I20260709 12:16:59.517047 11147 raft_consensus.cc:3060] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.516516 11073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f2078ccf4481289101c6b917a6944" candidate_uuid: "667de35363974f9da69460a1a11fcd7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:16:59.518020 11073 raft_consensus.cc:3055] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.518430 11073 raft_consensus.cc:740] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:16:59.518589 10894 catalog_manager.cc:5697] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a reported cstate change: term changed from 1 to 2, leader changed from 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66) to 667de35363974f9da69460a1a11fcd7a (127.1.248.65). New cstate: current_term: 2 leader_uuid: "667de35363974f9da69460a1a11fcd7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.519317 11073 consensus_queue.cc:260] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.520788 11073 raft_consensus.cc:3060] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.528039 11073 raft_consensus.cc:2468] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 2.
I20260709 12:16:59.529759 10964 leader_election.cc:304] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 667de35363974f9da69460a1a11fcd7a; no voters: 
I20260709 12:16:59.530458 11147 raft_consensus.cc:2468] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667de35363974f9da69460a1a11fcd7a in term 2.
I20260709 12:16:59.531172 11337 raft_consensus.cc:2804] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.531714 11337 raft_consensus.cc:697] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Becoming Leader. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Running, Role: LEADER
I20260709 12:16:59.532624 11337 consensus_queue.cc:237] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:16:59.539672 11072 raft_consensus.cc:1275] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.541790 11337 consensus_queue.cc:1048] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:59.545554 10894 catalog_manager.cc:5697] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a reported cstate change: term changed from 1 to 2, leader changed from 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66) to 667de35363974f9da69460a1a11fcd7a (127.1.248.65). New cstate: current_term: 2 leader_uuid: "667de35363974f9da69460a1a11fcd7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.552505 11147 raft_consensus.cc:1275] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.554761 11338 consensus_queue.cc:1048] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:59.727874 11146 raft_consensus.cc:1275] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Refusing update from remote peer 0c5eee91948c4ef6ae617f1a4365c327: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.729315 11301 consensus_queue.cc:1048] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:59.738095 10999 raft_consensus.cc:1275] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Refusing update from remote peer 0c5eee91948c4ef6ae617f1a4365c327: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.739876 11325 consensus_queue.cc:1048] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:59.901868 10997 raft_consensus.cc:3060] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.908100 10997 raft_consensus.cc:1275] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Refusing update from remote peer 0c5eee91948c4ef6ae617f1a4365c327: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.909502 11325 consensus_queue.cc:1048] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:59.919826 11147 raft_consensus.cc:1275] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Refusing update from remote peer 0c5eee91948c4ef6ae617f1a4365c327: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.920885 11146 raft_consensus.cc:1275] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.923202 10997 raft_consensus.cc:3060] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.923082 11306 consensus_queue.cc:1048] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:59.926064 11297 consensus_queue.cc:1048] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:59.933374 10997 raft_consensus.cc:1275] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Refusing update from remote peer 72b516593c964645a094a1d75249794c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.935072 11317 consensus_queue.cc:1048] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:59.952973 11072 raft_consensus.cc:1275] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.972563 11072 raft_consensus.cc:1275] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Refusing update from remote peer 72b516593c964645a094a1d75249794c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:59.974345 11317 consensus_queue.cc:1048] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:59.976011 11306 consensus_queue.cc:1048] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:00.061861 11073 raft_consensus.cc:1275] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:00.063308 11306 consensus_queue.cc:1048] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:00.073385 11147 raft_consensus.cc:1275] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Refusing update from remote peer 667de35363974f9da69460a1a11fcd7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:00.075910 11306 consensus_queue.cc:1048] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:02.150007 10894 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44768:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:17:02.169829 10894 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44768:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:17:02.258775  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:02.337379 11413 tablet.cc:1724] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.340269 11414 tablet.cc:1724] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.348994 11415 tablet.cc:1724] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.344244 11416 tablet.cc:1724] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.385324 11421 tablet.cc:1724] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.405608 11074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "926d5800295e45f892c7c5337ef16cfa"
dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
mode: GRACEFUL
new_leader_uuid: "72b516593c964645a094a1d75249794c"
 from {username='slave'} at 127.0.0.1:46328
I20260709 12:17:02.406698 11074 raft_consensus.cc:606] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Received request to transfer leadership to TS 72b516593c964645a094a1d75249794c
W20260709 12:17:02.432483 10964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:42597, user_credentials={real_user=slave}} blocked reactor thread for 58422.7us
W20260709 12:17:02.442880 10962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.67:42445, user_credentials={real_user=slave}} blocked reactor thread for 71037.4us
W20260709 12:17:02.533828 11040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:37145, user_credentials={real_user=slave}} blocked reactor thread for 53561.2us
I20260709 12:17:02.535481 11428 tablet.cc:1724] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.536533 11416 tablet.cc:1724] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.547622 11435 tablet.cc:1724] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.579778 11433 tablet.cc:1724] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.447265 11421 tablet.cc:1724] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.592473 11441 tablet.cc:1724] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.563227 11440 tablet.cc:1724] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.602473 11414 tablet.cc:1724] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.616178 11444 tablet.cc:1724] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.620182 11415 tablet.cc:1724] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.647007 11435 tablet.cc:1724] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.627378 11416 tablet.cc:1724] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.651540 11421 tablet.cc:1724] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:17:02.663847 11040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.65:37145, user_credentials={real_user=slave}} blocked reactor thread for 106535us
I20260709 12:17:02.669966 11428 tablet.cc:1724] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.671805 11413 tablet.cc:1724] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.699607 11435 tablet.cc:1724] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.703838 11447 raft_consensus.cc:993] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327: : Instructing follower 72b516593c964645a094a1d75249794c to start an election
I20260709 12:17:02.704458 11376 raft_consensus.cc:1081] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Signalling peer 72b516593c964645a094a1d75249794c to start an election
I20260709 12:17:02.689160 11441 tablet.cc:1724] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.712453 11143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "926d5800295e45f892c7c5337ef16cfa"
dest_uuid: "72b516593c964645a094a1d75249794c"
 from {username='slave'} at 127.0.0.1:33296
I20260709 12:17:02.713074 11143 raft_consensus.cc:493] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:02.713423 11143 raft_consensus.cc:3060] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.683354 11414 tablet.cc:1724] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.686892 11440 tablet.cc:1724] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.747784 11143 raft_consensus.cc:515] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:17:02.750191 11143 leader_election.cc:290] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 2 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:17:02.750897 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926d5800295e45f892c7c5337ef16cfa" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:17:02.751550 10995 raft_consensus.cc:3060] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.733317 11444 tablet.cc:1724] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.755703 11072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926d5800295e45f892c7c5337ef16cfa" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:17:02.756373 11072 raft_consensus.cc:3055] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:02.756672 11072 raft_consensus.cc:740] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c5eee91948c4ef6ae617f1a4365c327, State: Running, Role: LEADER
I20260709 12:17:02.757479 11072 consensus_queue.cc:260] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:17:02.758631 11072 raft_consensus.cc:3060] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.772776 10995 raft_consensus.cc:2468] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 2.
W20260709 12:17:02.777894 10964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.248.66:42597, user_credentials={real_user=slave}} blocked reactor thread for 67640us
I20260709 12:17:02.778877 11114 leader_election.cc:304] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667de35363974f9da69460a1a11fcd7a, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:17:02.780804 11428 tablet.cc:1724] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.781370 11421 tablet.cc:1724] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:02.782930 11436 raft_consensus.cc:2804] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:02.783529 11436 raft_consensus.cc:697] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 2 LEADER]: Becoming Leader. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:17:02.784984 11436 consensus_queue.cc:237] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:17:02.791349 10995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539"
dest_uuid: "667de35363974f9da69460a1a11fcd7a"
mode: GRACEFUL
new_leader_uuid: "72b516593c964645a094a1d75249794c"
 from {username='slave'} at 127.0.0.1:33300
I20260709 12:17:02.792193 10995 raft_consensus.cc:606] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Received request to transfer leadership to TS 72b516593c964645a094a1d75249794c
I20260709 12:17:02.793804  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:02.794185 11072 raft_consensus.cc:2468] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 2.
I20260709 12:17:02.794509  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:02.809815 10894 catalog_manager.cc:6242] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57: soft_deleted_table [id=067f83d6d24a455f944ba632a3d9d7fb] alter complete (version 1)
I20260709 12:17:02.820423 10895 catalog_manager.cc:5697] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c reported cstate change: term changed from 1 to 2, leader changed from 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66) to 72b516593c964645a094a1d75249794c (127.1.248.67). New cstate: current_term: 2 leader_uuid: "72b516593c964645a094a1d75249794c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:02.830756 11450 raft_consensus.cc:993] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a: : Instructing follower 72b516593c964645a094a1d75249794c to start an election
I20260709 12:17:02.831192 11280 raft_consensus.cc:1081] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Signalling peer 72b516593c964645a094a1d75249794c to start an election
I20260709 12:17:02.835795 11144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539"
dest_uuid: "72b516593c964645a094a1d75249794c"
 from {username='slave'} at 127.0.0.1:33300
I20260709 12:17:02.836308 11144 raft_consensus.cc:493] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:02.836637 11144 raft_consensus.cc:3060] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.842243 11144 raft_consensus.cc:515] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:17:02.844090 11144 leader_election.cc:290] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 3 election: Requested vote from peers 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145), 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597)
I20260709 12:17:02.844854 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "667de35363974f9da69460a1a11fcd7a"
I20260709 12:17:02.845264 11072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a2cae1159243e0ad6a4da92a55c539" candidate_uuid: "72b516593c964645a094a1d75249794c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c5eee91948c4ef6ae617f1a4365c327"
I20260709 12:17:02.845474 10997 raft_consensus.cc:3055] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:02.845923 11072 raft_consensus.cc:3060] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.845920 10997 raft_consensus.cc:740] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 667de35363974f9da69460a1a11fcd7a, State: Running, Role: LEADER
I20260709 12:17:02.847246 10997 consensus_queue.cc:260] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:17:02.848416 10997 raft_consensus.cc:3060] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.851759 11072 raft_consensus.cc:2468] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 3.
I20260709 12:17:02.852815 11113 leader_election.cc:304] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5eee91948c4ef6ae617f1a4365c327, 72b516593c964645a094a1d75249794c; no voters: 
I20260709 12:17:02.853380 10997 raft_consensus.cc:2468] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b516593c964645a094a1d75249794c in term 3.
I20260709 12:17:02.853531 11436 raft_consensus.cc:2804] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:02.854087 11436 raft_consensus.cc:697] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 3 LEADER]: Becoming Leader. State: Replica: 72b516593c964645a094a1d75249794c, State: Running, Role: LEADER
I20260709 12:17:02.854960 11436 consensus_queue.cc:237] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } }
I20260709 12:17:02.862861 10895 catalog_manager.cc:5697] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c reported cstate change: term changed from 2 to 3, leader changed from 667de35363974f9da69460a1a11fcd7a (127.1.248.65) to 72b516593c964645a094a1d75249794c (127.1.248.67). New cstate: current_term: 3 leader_uuid: "72b516593c964645a094a1d75249794c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b516593c964645a094a1d75249794c" member_type: VOTER last_known_addr { host: "127.1.248.67" port: 42445 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:03.208746 11072 raft_consensus.cc:1275] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Refusing update from remote peer 72b516593c964645a094a1d75249794c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.210165 11436 consensus_queue.cc:1048] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:03.221477 10997 raft_consensus.cc:1275] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Refusing update from remote peer 72b516593c964645a094a1d75249794c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.223625 11436 consensus_queue.cc:1048] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:03.430402 11073 raft_consensus.cc:1275] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 3 FOLLOWER]: Refusing update from remote peer 72b516593c964645a094a1d75249794c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:03.431644 11436 consensus_queue.cc:1048] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5eee91948c4ef6ae617f1a4365c327" member_type: VOTER last_known_addr { host: "127.1.248.66" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:03.442951 10997 raft_consensus.cc:1275] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 3 FOLLOWER]: Refusing update from remote peer 72b516593c964645a094a1d75249794c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:03.444525 11436 consensus_queue.cc:1048] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [LEADER]: Connected to new peer: Peer: permanent_uuid: "667de35363974f9da69460a1a11fcd7a" member_type: VOTER last_known_addr { host: "127.1.248.65" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:03.795926  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:03.801604  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:03.801972  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:04.803226  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:04.808516  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:04.808925  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:05.810364  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:05.817231  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:05.817726  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:07.629240  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:07.634815  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:07.635301  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:17:08.319626 11169 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9060 after lost signal to thread 2020
W20260709 12:17:08.321069 11169 debug-util.cc:398] Leaking SignalData structure 0x7b08000efae0 after lost signal to thread 10931
W20260709 12:17:08.322276 11169 debug-util.cc:398] Leaking SignalData structure 0x7b0800313520 after lost signal to thread 11023
W20260709 12:17:08.323372 11169 debug-util.cc:398] Leaking SignalData structure 0x7b08001afe40 after lost signal to thread 11098
W20260709 12:17:08.324339 11169 debug-util.cc:398] Leaking SignalData structure 0x7b080013bc60 after lost signal to thread 11172
I20260709 12:17:08.636420  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:08.643291  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:08.643750  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:09.644827  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:09.651962  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:09.652432  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:10.653367  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:10.659999  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:10.660568  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:11.661537  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:11.666644  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:11.667047  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:12.668020  2017 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:12.673612  2017 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:12.674026  2017 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:13.731537  2017 tablet_server.cc:179] TabletServer@127.1.248.65:0 shutting down...
W20260709 12:17:13.741155 11040 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260709 12:17:13.748697 11040 consensus_peers.cc:597] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 -> Peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Couldn't send request to peer 667de35363974f9da69460a1a11fcd7a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:13.749321 11040 consensus_peers.cc:597] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 -> Peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Couldn't send request to peer 667de35363974f9da69460a1a11fcd7a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:13.776137  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:13.776981  2017 tablet_replica.cc:333] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.777976  2017 raft_consensus.cc:2243] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.778820  2017 raft_consensus.cc:2272] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.781526  2017 tablet_replica.cc:333] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.782292  2017 raft_consensus.cc:2243] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.782852  2017 raft_consensus.cc:2272] T 22b19f87359c4239b90f7efb60167dd9 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.785351  2017 tablet_replica.cc:333] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.785966  2017 raft_consensus.cc:2243] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:13.786929  2017 raft_consensus.cc:2272] T a1e152a4a95c4afc9e940b2626d68463 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.789981  2017 tablet_replica.cc:333] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.790591  2017 raft_consensus.cc:2243] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:13.791672  2017 raft_consensus.cc:2272] T 92ea9155e6eb42aaab6dca1d90e73e06 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.794209  2017 tablet_replica.cc:333] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.794945  2017 raft_consensus.cc:2243] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:13.796192  2017 raft_consensus.cc:2272] T 31fe758f4455438dbf0b1c4b81e279f5 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.799240  2017 tablet_replica.cc:333] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.799928  2017 raft_consensus.cc:2243] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.800505  2017 raft_consensus.cc:2272] T c7a2cae1159243e0ad6a4da92a55c539 P 667de35363974f9da69460a1a11fcd7a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.803063  2017 tablet_replica.cc:333] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.803771  2017 raft_consensus.cc:2243] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.804352  2017 raft_consensus.cc:2272] T e6b93883f8e34609929d18ac7d59ab20 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.806789  2017 tablet_replica.cc:333] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.807447  2017 raft_consensus.cc:2243] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.807971  2017 raft_consensus.cc:2272] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.810299  2017 tablet_replica.cc:333] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.810870  2017 raft_consensus.cc:2243] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.811488  2017 raft_consensus.cc:2272] T ffcd2e71435d4a06a669df60515259ce P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.814244  2017 tablet_replica.cc:333] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.814787  2017 raft_consensus.cc:2243] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.815194  2017 raft_consensus.cc:2272] T 926d5800295e45f892c7c5337ef16cfa P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.817514  2017 tablet_replica.cc:333] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.818040  2017 raft_consensus.cc:2243] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.818439  2017 raft_consensus.cc:2272] T b37f7e31a966476690133d6ead87c211 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.820708  2017 tablet_replica.cc:333] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.821274  2017 raft_consensus.cc:2243] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.821889  2017 raft_consensus.cc:2272] T d3242a956aba4c4284672cc7c90585ff P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.825260  2017 tablet_replica.cc:333] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.825839  2017 raft_consensus.cc:2243] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:13.826753  2017 raft_consensus.cc:2272] T 686fbecbc317411aaa96587b3515a573 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.829195  2017 tablet_replica.cc:333] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.829768  2017 raft_consensus.cc:2243] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:13.830660  2017 raft_consensus.cc:2272] T 42a94ce16cb54e3dac0eaca3be800878 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.832974  2017 tablet_replica.cc:333] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.833529  2017 raft_consensus.cc:2243] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:13.834374  2017 raft_consensus.cc:2272] T f1e42be7e8d644f995ad8c564a37cdad P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.836653  2017 tablet_replica.cc:333] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.837194  2017 raft_consensus.cc:2243] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.837671  2017 raft_consensus.cc:2272] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.840390  2017 tablet_replica.cc:333] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.840983  2017 raft_consensus.cc:2243] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:13.842065  2017 raft_consensus.cc:2272] T 8a0f2078ccf4481289101c6b917a6944 P 667de35363974f9da69460a1a11fcd7a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:13.843520 11040 consensus_peers.cc:597] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 -> Peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Couldn't send request to peer 667de35363974f9da69460a1a11fcd7a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:13.844796  2017 tablet_replica.cc:333] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a: stopping tablet replica
I20260709 12:17:13.845445  2017 raft_consensus.cc:2243] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.845947  2017 raft_consensus.cc:2272] T c7b660204384458b8e72a9ff2d272fbe P 667de35363974f9da69460a1a11fcd7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.893240  2017 tablet_server.cc:196] TabletServer@127.1.248.65:0 shutdown complete.
I20260709 12:17:13.946105  2017 tablet_server.cc:179] TabletServer@127.1.248.66:0 shutting down...
I20260709 12:17:13.983659  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:13.984562  2017 tablet_replica.cc:333] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:13.985673  2017 raft_consensus.cc:2243] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.986498  2017 raft_consensus.cc:2272] T 22b19f87359c4239b90f7efb60167dd9 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.988999  2017 tablet_replica.cc:333] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:13.989578  2017 raft_consensus.cc:2243] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:13.990423  2017 raft_consensus.cc:2272] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.993302  2017 tablet_replica.cc:333] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:13.994051  2017 raft_consensus.cc:2243] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.994694  2017 raft_consensus.cc:2272] T c7b660204384458b8e72a9ff2d272fbe P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.997552  2017 tablet_replica.cc:333] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:13.998425  2017 raft_consensus.cc:2243] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:13.999085 11114 consensus_peers.cc:597] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c -> Peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Couldn't send request to peer 667de35363974f9da69460a1a11fcd7a. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:37145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:13.999135  2017 raft_consensus.cc:2272] T 8a0f2078ccf4481289101c6b917a6944 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.001943  2017 tablet_replica.cc:333] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.002573  2017 raft_consensus.cc:2243] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.003121  2017 raft_consensus.cc:2272] T a1e152a4a95c4afc9e940b2626d68463 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.005520  2017 tablet_replica.cc:333] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.006100  2017 raft_consensus.cc:2243] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.006637  2017 raft_consensus.cc:2272] T 92ea9155e6eb42aaab6dca1d90e73e06 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.009227  2017 tablet_replica.cc:333] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.009855  2017 raft_consensus.cc:2243] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:14.010962  2017 raft_consensus.cc:2272] T d3242a956aba4c4284672cc7c90585ff P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.013273  2017 tablet_replica.cc:333] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.013944  2017 raft_consensus.cc:2243] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.014536  2017 raft_consensus.cc:2272] T 42a94ce16cb54e3dac0eaca3be800878 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.016913  2017 tablet_replica.cc:333] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.017494  2017 raft_consensus.cc:2243] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.018011  2017 raft_consensus.cc:2272] T 686fbecbc317411aaa96587b3515a573 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.020258  2017 tablet_replica.cc:333] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.020820  2017 raft_consensus.cc:2243] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.021304  2017 raft_consensus.cc:2272] T 31fe758f4455438dbf0b1c4b81e279f5 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.023599  2017 tablet_replica.cc:333] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.024163  2017 raft_consensus.cc:2243] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.024718  2017 raft_consensus.cc:2272] T c7a2cae1159243e0ad6a4da92a55c539 P 0c5eee91948c4ef6ae617f1a4365c327 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.026914  2017 tablet_replica.cc:333] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.027598  2017 raft_consensus.cc:2243] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:14.028519  2017 raft_consensus.cc:2272] T ffcd2e71435d4a06a669df60515259ce P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.031024  2017 tablet_replica.cc:333] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.031607  2017 raft_consensus.cc:2243] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.032114  2017 raft_consensus.cc:2272] T 926d5800295e45f892c7c5337ef16cfa P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.034410  2017 tablet_replica.cc:333] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.034960  2017 raft_consensus.cc:2243] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:14.035868  2017 raft_consensus.cc:2272] T b37f7e31a966476690133d6ead87c211 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.038192  2017 tablet_replica.cc:333] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.038810  2017 raft_consensus.cc:2243] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:14.039711  2017 raft_consensus.cc:2272] T e6b93883f8e34609929d18ac7d59ab20 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.041960  2017 tablet_replica.cc:333] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.042510  2017 raft_consensus.cc:2243] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:14.043493  2017 raft_consensus.cc:2272] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 0c5eee91948c4ef6ae617f1a4365c327 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.045723  2017 tablet_replica.cc:333] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.046204  2017 raft_consensus.cc:2243] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.046749  2017 raft_consensus.cc:2272] T f1e42be7e8d644f995ad8c564a37cdad P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.049049  2017 tablet_replica.cc:333] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327: stopping tablet replica
I20260709 12:17:14.049515  2017 raft_consensus.cc:2243] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:14.050441  2017 raft_consensus.cc:2272] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 0c5eee91948c4ef6ae617f1a4365c327 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:14.071653 11114 consensus_peers.cc:597] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c -> Peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Couldn't send request to peer 667de35363974f9da69460a1a11fcd7a. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:37145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:14.094960  2017 tablet_server.cc:196] TabletServer@127.1.248.66:0 shutdown complete.
W20260709 12:17:14.112378 11114 consensus_peers.cc:597] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c -> Peer 667de35363974f9da69460a1a11fcd7a (127.1.248.65:37145): Couldn't send request to peer 667de35363974f9da69460a1a11fcd7a. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.65:37145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:14.137898  2017 tablet_server.cc:179] TabletServer@127.1.248.67:0 shutting down...
W20260709 12:17:14.144603 11113 consensus_peers.cc:597] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c -> Peer 0c5eee91948c4ef6ae617f1a4365c327 (127.1.248.66:42597): Couldn't send request to peer 0c5eee91948c4ef6ae617f1a4365c327. Status: Network error: Client connection negotiation failed: client connection to 127.1.248.66:42597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:14.171675  2017 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:14.172549  2017 tablet_replica.cc:333] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.173257  2017 raft_consensus.cc:2243] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:14.174194  2017 raft_consensus.cc:2272] T 22b19f87359c4239b90f7efb60167dd9 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.176545  2017 tablet_replica.cc:333] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.177253  2017 raft_consensus.cc:2243] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.177836  2017 raft_consensus.cc:2272] T a4b002cad4fd45cfb1d13d2b0ff26d3b P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.180361  2017 tablet_replica.cc:333] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.180939  2017 raft_consensus.cc:2243] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:14.181886  2017 raft_consensus.cc:2272] T c7b660204384458b8e72a9ff2d272fbe P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.184109  2017 tablet_replica.cc:333] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.184693  2017 raft_consensus.cc:2243] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.185159  2017 raft_consensus.cc:2272] T 8a0f2078ccf4481289101c6b917a6944 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.187398  2017 tablet_replica.cc:333] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.188041  2017 raft_consensus.cc:2243] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.188555  2017 raft_consensus.cc:2272] T a1e152a4a95c4afc9e940b2626d68463 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.190738  2017 tablet_replica.cc:333] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.191323  2017 raft_consensus.cc:2243] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.191916  2017 raft_consensus.cc:2272] T 92ea9155e6eb42aaab6dca1d90e73e06 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.193944  2017 tablet_replica.cc:333] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.194514  2017 raft_consensus.cc:2243] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.194978  2017 raft_consensus.cc:2272] T 31fe758f4455438dbf0b1c4b81e279f5 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.197106  2017 tablet_replica.cc:333] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.197643  2017 raft_consensus.cc:2243] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:14.198503  2017 raft_consensus.cc:2272] T c7a2cae1159243e0ad6a4da92a55c539 P 72b516593c964645a094a1d75249794c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.200615  2017 tablet_replica.cc:333] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.201143  2017 raft_consensus.cc:2243] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.201653  2017 raft_consensus.cc:2272] T d3242a956aba4c4284672cc7c90585ff P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.203794  2017 tablet_replica.cc:333] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.204355  2017 raft_consensus.cc:2243] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.204869  2017 raft_consensus.cc:2272] T 42a94ce16cb54e3dac0eaca3be800878 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.207677  2017 tablet_replica.cc:333] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.208240  2017 raft_consensus.cc:2243] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.208721  2017 raft_consensus.cc:2272] T 686fbecbc317411aaa96587b3515a573 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.210806  2017 tablet_replica.cc:333] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.211347  2017 raft_consensus.cc:2243] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.211855  2017 raft_consensus.cc:2272] T f1e42be7e8d644f995ad8c564a37cdad P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.214051  2017 tablet_replica.cc:333] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.214576  2017 raft_consensus.cc:2243] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.215044  2017 raft_consensus.cc:2272] T 694ac3e0e6ac402f81ba5d2e66a5f020 P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.217197  2017 tablet_replica.cc:333] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.217729  2017 raft_consensus.cc:2243] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.218199  2017 raft_consensus.cc:2272] T e6b93883f8e34609929d18ac7d59ab20 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.220203  2017 tablet_replica.cc:333] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.220752  2017 raft_consensus.cc:2243] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.221257  2017 raft_consensus.cc:2272] T 7ecc18d3bf7748c5aea3b0caf2b289d1 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.223335  2017 tablet_replica.cc:333] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.223906  2017 raft_consensus.cc:2243] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.224390  2017 raft_consensus.cc:2272] T b37f7e31a966476690133d6ead87c211 P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.226541  2017 tablet_replica.cc:333] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.227041  2017 raft_consensus.cc:2243] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.227550  2017 raft_consensus.cc:2272] T ffcd2e71435d4a06a669df60515259ce P 72b516593c964645a094a1d75249794c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.229707  2017 tablet_replica.cc:333] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c: stopping tablet replica
I20260709 12:17:14.230226  2017 raft_consensus.cc:2243] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:14.231142  2017 raft_consensus.cc:2272] T 926d5800295e45f892c7c5337ef16cfa P 72b516593c964645a094a1d75249794c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.292230  2017 tablet_server.cc:196] TabletServer@127.1.248.67:0 shutdown complete.
I20260709 12:17:14.332629  2017 master.cc:562] Master@127.1.248.126:39979 shutting down...
I20260709 12:17:14.356555  2017 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:14.357221  2017 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.357582  2017 tablet_replica.cc:333] T 00000000000000000000000000000000 P b0567c0499094425b8db45d4c7c6bd57: stopping tablet replica
I20260709 12:17:14.411106  2017 master.cc:584] Master@127.1.248.126:39979 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21750 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (43079 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (325625 ms total)
[  PASSED  ] 8 tests.
I20260709 12:17:14.470649  2017 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2272 messages since previous log ~32 seconds ago
I20260709 12:17:14.470904  2017 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2279 messages since previous log ~33 seconds ago
I20260709 12:17:14.471122  2017 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2279 messages since previous log ~33 seconds ago
I20260709 12:17:14.471339  2017 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~51 seconds ago
I20260709 12:17:14.471621  2017 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~51 seconds ago
I20260709 12:17:14.471813  2017 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~178 seconds ago
I20260709 12:17:14.472048  2017 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 4 messages since previous log ~225 seconds ago
I20260709 12:17:14.472353  2017 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 12:17:14.472671  2017 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 51 messages since previous log ~20 seconds ago
